INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:32:04,918 - lava_callback - INFO - Received callback for node 69dedc09f490930782fb6e62 2026-04-15 00:32:04,931 - lava_callback - INFO - Starting async job submit for node 69dedc09f490930782fb6e62 INFO: 172.21.0.1:58532 - "POST /node/69dedc09f490930782fb6e62 HTTP/1.0" 202 Accepted 2026-04-15 00:32:04,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:04,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:04,995 - lava_callback - DEBUG - Processing node 69dedc09f490930782fb6e62: baseline-arm 2026-04-15 00:32:05,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:05,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:05,528 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/log.txt.gz 2026-04-15 00:32:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:05,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:05,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/lava-logs.yaml 2026-04-15 00:32:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:06,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:06,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/lava_callback.json.gz 2026-04-15 00:32:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:06,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 00:32:06,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:06,126 - lava_callback - INFO - Completed processing callback for node 69dedc09f490930782fb6e62 INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:32:36,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:36,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:37:34,251 - lava_callback - INFO - Received callback for node 69dc3ac25dbfa74e32f96e93 INFO: 172.21.0.1:42192 - "POST /node/69dc3ac25dbfa74e32f96e93 HTTP/1.0" 202 Accepted 2026-04-15 00:37:34,256 - lava_callback - INFO - Starting async job submit for node 69dc3ac25dbfa74e32f96e93 2026-04-15 00:37:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,273 - lava_callback - DEBUG - Processing node 69dc3ac25dbfa74e32f96e93: baseline-arm-baylibre 2026-04-15 00:37:34,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3ac25dbfa74e32f96e93 2026-04-15 00:37:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:37:34,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,321 - lava_callback - ERROR - Error processing callback for node 69dc3ac25dbfa74e32f96e93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:13,876 - lava_callback - INFO - Received callback for node 69dedd84f490930782fb7004 INFO: 172.21.0.1:49814 - "POST /node/69dedd84f490930782fb7004 HTTP/1.0" 202 Accepted 2026-04-15 00:38:13,883 - lava_callback - INFO - Starting async job submit for node 69dedd84f490930782fb7004 2026-04-15 00:38:13,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:13,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:13,920 - lava_callback - DEBUG - Processing node 69dedd84f490930782fb7004: baseline-x86 2026-04-15 00:38:14,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,212 - lava_callback - INFO - Received callback for node 69dc3ae45dbfa74e32f96ebc 2026-04-15 00:38:14,218 - lava_callback - INFO - Starting async job submit for node 69dc3ae45dbfa74e32f96ebc INFO: 172.21.0.1:49826 - "POST /node/69dc3ae45dbfa74e32f96ebc HTTP/1.0" 202 Accepted 2026-04-15 00:38:14,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,237 - lava_callback - DEBUG - Processing node 69dc3ae45dbfa74e32f96ebc: baseline-arm-baylibre 2026-04-15 00:38:14,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3ae45dbfa74e32f96ebc 2026-04-15 00:38:14,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/log.txt.gz 2026-04-15 00:38:14,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:38:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,395 - lava_callback - ERROR - Error processing callback for node 69dc3ae45dbfa74e32f96ebc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:38:14,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/lava-logs.yaml 2026-04-15 00:38:14,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/lava_callback.json.gz 2026-04-15 00:38:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:14,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:38:14,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:14,891 - lava_callback - INFO - Completed processing callback for node 69dedd84f490930782fb7004 INFO: 172.21.0.1:49830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:34,204 - lava_callback - INFO - Received callback for node 69dc3b005dbfa74e32f96efc INFO: 172.21.0.1:49944 - "POST /node/69dc3b005dbfa74e32f96efc HTTP/1.0" 202 Accepted 2026-04-15 00:38:34,210 - lava_callback - INFO - Starting async job submit for node 69dc3b005dbfa74e32f96efc 2026-04-15 00:38:34,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,226 - lava_callback - DEBUG - Processing node 69dc3b005dbfa74e32f96efc: baseline-arm-baylibre 2026-04-15 00:38:34,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b005dbfa74e32f96efc 2026-04-15 00:38:34,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:38:34,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,284 - lava_callback - ERROR - Error processing callback for node 69dc3b005dbfa74e32f96efc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:38:35,957 - lava_callback - INFO - Received callback for node 69dedd86f490930782fb700d INFO: 172.21.0.1:49956 - "POST /node/69dedd86f490930782fb700d HTTP/1.0" 202 Accepted 2026-04-15 00:38:35,963 - lava_callback - INFO - Starting async job submit for node 69dedd86f490930782fb700d 2026-04-15 00:38:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:35,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:35,996 - lava_callback - DEBUG - Processing node 69dedd86f490930782fb700d: baseline-x86 2026-04-15 00:38:36,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 00:38:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/log.txt.gz 2026-04-15 00:38:36,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:36,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,620 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/lava-logs.yaml 2026-04-15 00:38:36,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:36,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/lava_callback.json.gz 2026-04-15 00:38:36,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:38:36,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:36,868 - lava_callback - INFO - Completed processing callback for node 69dedd86f490930782fb700d INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:06,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:06,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:14,288 - lava_callback - INFO - Received callback for node 69dc3b235dbfa74e32f96f14 INFO: 172.21.0.1:38820 - "POST /node/69dc3b235dbfa74e32f96f14 HTTP/1.0" 202 Accepted 2026-04-15 00:39:14,294 - lava_callback - INFO - Starting async job submit for node 69dc3b235dbfa74e32f96f14 2026-04-15 00:39:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,324 - lava_callback - DEBUG - Processing node 69dc3b235dbfa74e32f96f14: baseline-arm-baylibre 2026-04-15 00:39:14,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b235dbfa74e32f96f14 2026-04-15 00:39:14,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:39:14,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,370 - lava_callback - ERROR - Error processing callback for node 69dc3b235dbfa74e32f96f14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:54,319 - lava_callback - INFO - Received callback for node 69dc3b465dbfa74e32f96f29 INFO: 172.21.0.1:49010 - "POST /node/69dc3b465dbfa74e32f96f29 HTTP/1.0" 202 Accepted 2026-04-15 00:39:54,328 - lava_callback - INFO - Starting async job submit for node 69dc3b465dbfa74e32f96f29 2026-04-15 00:39:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,356 - lava_callback - DEBUG - Processing node 69dc3b465dbfa74e32f96f29: baseline-arm-baylibre 2026-04-15 00:39:54,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b465dbfa74e32f96f29 2026-04-15 00:39:54,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:39:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,447 - lava_callback - ERROR - Error processing callback for node 69dc3b465dbfa74e32f96f29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:39:54,496 - lava_callback - INFO - Received callback for node 69dedd84f490930782fb7007 INFO: 172.21.0.1:49016 - "POST /node/69dedd84f490930782fb7007 HTTP/1.0" 202 Accepted 2026-04-15 00:39:54,518 - lava_callback - INFO - Starting async job submit for node 69dedd84f490930782fb7007 2026-04-15 00:39:54,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:54,651 - lava_callback - DEBUG - Processing node 69dedd84f490930782fb7007: baseline-x86 2026-04-15 00:39:55,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:55,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:55,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/log.txt.gz 2026-04-15 00:39:55,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:56,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:56,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/lava-logs.yaml 2026-04-15 00:39:56,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:56,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:56,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/lava_callback.json.gz 2026-04-15 00:39:56,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:56,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:39:56,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:56,450 - lava_callback - INFO - Completed processing callback for node 69dedd84f490930782fb7007 INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:06,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:14,297 - lava_callback - INFO - Received callback for node 69dc3b655dbfa74e32f96f53 INFO: 172.21.0.1:54594 - "POST /node/69dc3b655dbfa74e32f96f53 HTTP/1.0" 202 Accepted 2026-04-15 00:40:14,306 - lava_callback - INFO - Starting async job submit for node 69dc3b655dbfa74e32f96f53 2026-04-15 00:40:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,338 - lava_callback - DEBUG - Processing node 69dc3b655dbfa74e32f96f53: baseline-arm-baylibre 2026-04-15 00:40:14,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b655dbfa74e32f96f53 2026-04-15 00:40:14,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:40:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,437 - lava_callback - ERROR - Error processing callback for node 69dc3b655dbfa74e32f96f53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:47,194 - lava_callback - INFO - Received callback for node 69dc3b895dbfa74e32f96f86 INFO: 172.21.0.1:53852 - "POST /node/69dc3b895dbfa74e32f96f86 HTTP/1.0" 202 Accepted 2026-04-15 00:40:47,200 - lava_callback - INFO - Starting async job submit for node 69dc3b895dbfa74e32f96f86 2026-04-15 00:40:47,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,218 - lava_callback - DEBUG - Processing node 69dc3b895dbfa74e32f96f86: baseline-arm-clabbe 2026-04-15 00:40:47,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b895dbfa74e32f96f86 2026-04-15 00:40:47,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:40:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,283 - lava_callback - ERROR - Error processing callback for node 69dc3b895dbfa74e32f96f86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:27,151 - lava_callback - INFO - Received callback for node 69dc3bae5dbfa74e32f96fea INFO: 172.21.0.1:40638 - "POST /node/69dc3bae5dbfa74e32f96fea HTTP/1.0" 202 Accepted 2026-04-15 00:41:27,162 - lava_callback - INFO - Starting async job submit for node 69dc3bae5dbfa74e32f96fea 2026-04-15 00:41:27,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,196 - lava_callback - DEBUG - Processing node 69dc3bae5dbfa74e32f96fea: baseline-arm-clabbe 2026-04-15 00:41:27,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bae5dbfa74e32f96fea 2026-04-15 00:41:27,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:41:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,281 - lava_callback - ERROR - Error processing callback for node 69dc3bae5dbfa74e32f96fea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:29,207 - lava_callback - INFO - Received callback for node 69dedeabf490930782fb719b INFO: 172.21.0.1:40646 - "POST /node/69dedeabf490930782fb719b HTTP/1.0" 202 Accepted 2026-04-15 00:41:29,214 - lava_callback - INFO - Starting async job submit for node 69dedeabf490930782fb719b 2026-04-15 00:41:29,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,232 - lava_callback - DEBUG - Processing node 69dedeabf490930782fb719b: baseline-arm 2026-04-15 00:41:29,238 - lava_callback - WARNING - Failed to upload log 2026-04-15 00:41:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:29,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:29,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719b/lava-logs.yaml 2026-04-15 00:41:29,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:29,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:29,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719b/lava_callback.json.gz 2026-04-15 00:41:29,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:41:29,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,687 - lava_callback - INFO - Completed processing callback for node 69dedeabf490930782fb719b 2026-04-15 00:41:34,434 - lava_callback - INFO - Received callback for node 69dc3bac5dbfa74e32f96fe4 INFO: 172.21.0.1:40620 - "POST /node/69dc3bac5dbfa74e32f96fe4 HTTP/1.0" 202 Accepted 2026-04-15 00:41:34,447 - lava_callback - INFO - Starting async job submit for node 69dc3bac5dbfa74e32f96fe4 2026-04-15 00:41:34,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,472 - lava_callback - DEBUG - Processing node 69dc3bac5dbfa74e32f96fe4: baseline-arm-baylibre 2026-04-15 00:41:34,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bac5dbfa74e32f96fe4 2026-04-15 00:41:34,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:34,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,577 - lava_callback - ERROR - Error processing callback for node 69dc3bac5dbfa74e32f96fe4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:35,085 - lava_callback - INFO - Received callback for node 69dc3bad5dbfa74e32f96fe7 INFO: 172.21.0.1:40622 - "POST /node/69dc3bad5dbfa74e32f96fe7 HTTP/1.0" 202 Accepted 2026-04-15 00:41:35,090 - lava_callback - INFO - Starting async job submit for node 69dc3bad5dbfa74e32f96fe7 2026-04-15 00:41:35,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,107 - lava_callback - DEBUG - Processing node 69dc3bad5dbfa74e32f96fe7: baseline-arm-baylibre 2026-04-15 00:41:35,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bad5dbfa74e32f96fe7 2026-04-15 00:41:35,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:35,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,159 - lava_callback - ERROR - Error processing callback for node 69dc3bad5dbfa74e32f96fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:35,759 - lava_callback - INFO - Received callback for node 69dc3bae5dbfa74e32f96fec INFO: 172.21.0.1:40630 - "POST /node/69dc3bae5dbfa74e32f96fec HTTP/1.0" 202 Accepted 2026-04-15 00:41:35,769 - lava_callback - INFO - Starting async job submit for node 69dc3bae5dbfa74e32f96fec 2026-04-15 00:41:35,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,801 - lava_callback - DEBUG - Processing node 69dc3bae5dbfa74e32f96fec: baseline-arm-baylibre 2026-04-15 00:41:35,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bae5dbfa74e32f96fec 2026-04-15 00:41:35,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:35,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,897 - lava_callback - ERROR - Error processing callback for node 69dc3bae5dbfa74e32f96fec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 00:41:36,423 - lava_callback - INFO - Received callback for node 69dc3bb15dbfa74e32f96ffa INFO: 172.21.0.1:40634 - "POST /node/69dc3bb15dbfa74e32f96ffa HTTP/1.0" 202 Accepted 2026-04-15 00:41:36,428 - lava_callback - INFO - Starting async job submit for node 69dc3bb15dbfa74e32f96ffa 2026-04-15 00:41:36,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,444 - lava_callback - DEBUG - Processing node 69dc3bb15dbfa74e32f96ffa: baseline-arm-baylibre 2026-04-15 00:41:36,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bb15dbfa74e32f96ffa 2026-04-15 00:41:36,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:36,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,507 - lava_callback - ERROR - Error processing callback for node 69dc3bb15dbfa74e32f96ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:37,116 - lava_callback - INFO - Received callback for node 69dc3bb35dbfa74e32f96ffd INFO: 172.21.0.1:40650 - "POST /node/69dc3bb35dbfa74e32f96ffd HTTP/1.0" 202 Accepted 2026-04-15 00:41:37,121 - lava_callback - INFO - Starting async job submit for node 69dc3bb35dbfa74e32f96ffd 2026-04-15 00:41:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,138 - lava_callback - DEBUG - Processing node 69dc3bb35dbfa74e32f96ffd: baseline-arm-baylibre 2026-04-15 00:41:37,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bb35dbfa74e32f96ffd 2026-04-15 00:41:37,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:37,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,194 - lava_callback - ERROR - Error processing callback for node 69dc3bb35dbfa74e32f96ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:37,788 - lava_callback - INFO - Received callback for node 69dc3bab5dbfa74e32f96fe1 INFO: 172.21.0.1:40656 - "POST /node/69dc3bab5dbfa74e32f96fe1 HTTP/1.0" 202 Accepted 2026-04-15 00:41:37,793 - lava_callback - INFO - Starting async job submit for node 69dc3bab5dbfa74e32f96fe1 2026-04-15 00:41:37,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,809 - lava_callback - DEBUG - Processing node 69dc3bab5dbfa74e32f96fe1: baseline-arm-baylibre 2026-04-15 00:41:37,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bab5dbfa74e32f96fe1 2026-04-15 00:41:37,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:37,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,858 - lava_callback - ERROR - Error processing callback for node 69dc3bab5dbfa74e32f96fe1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:47,136 - lava_callback - INFO - Received callback for node 69dc3bba5dbfa74e32f97012 INFO: 172.21.0.1:35252 - "POST /node/69dc3bba5dbfa74e32f97012 HTTP/1.0" 202 Accepted 2026-04-15 00:41:47,142 - lava_callback - INFO - Starting async job submit for node 69dc3bba5dbfa74e32f97012 2026-04-15 00:41:47,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,166 - lava_callback - DEBUG - Processing node 69dc3bba5dbfa74e32f97012: baseline-arm-clabbe 2026-04-15 00:41:47,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bba5dbfa74e32f97012 2026-04-15 00:41:47,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,232 - lava_callback - ERROR - Error processing callback for node 69dc3bba5dbfa74e32f97012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:47,862 - lava_callback - INFO - Received callback for node 69dc3bbb5dbfa74e32f97018 INFO: 172.21.0.1:35268 - "POST /node/69dc3bbb5dbfa74e32f97018 HTTP/1.0" 202 Accepted 2026-04-15 00:41:47,869 - lava_callback - INFO - Starting async job submit for node 69dc3bbb5dbfa74e32f97018 2026-04-15 00:41:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,891 - lava_callback - DEBUG - Processing node 69dc3bbb5dbfa74e32f97018: baseline-arm-clabbe 2026-04-15 00:41:47,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbb5dbfa74e32f97018 2026-04-15 00:41:47,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:47,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,940 - lava_callback - ERROR - Error processing callback for node 69dc3bbb5dbfa74e32f97018: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:48,582 - lava_callback - INFO - Received callback for node 69dc3bbc5dbfa74e32f9701c INFO: 172.21.0.1:35284 - "POST /node/69dc3bbc5dbfa74e32f9701c HTTP/1.0" 202 Accepted 2026-04-15 00:41:48,587 - lava_callback - INFO - Starting async job submit for node 69dc3bbc5dbfa74e32f9701c 2026-04-15 00:41:48,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,604 - lava_callback - DEBUG - Processing node 69dc3bbc5dbfa74e32f9701c: baseline-arm-clabbe 2026-04-15 00:41:48,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbc5dbfa74e32f9701c 2026-04-15 00:41:48,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:48,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,667 - lava_callback - ERROR - Error processing callback for node 69dc3bbc5dbfa74e32f9701c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:49,277 - lava_callback - INFO - Received callback for node 69dc3bbd5dbfa74e32f9701f INFO: 172.21.0.1:35286 - "POST /node/69dc3bbd5dbfa74e32f9701f HTTP/1.0" 202 Accepted 2026-04-15 00:41:49,283 - lava_callback - INFO - Starting async job submit for node 69dc3bbd5dbfa74e32f9701f 2026-04-15 00:41:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,299 - lava_callback - DEBUG - Processing node 69dc3bbd5dbfa74e32f9701f: baseline-arm-clabbe 2026-04-15 00:41:49,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbd5dbfa74e32f9701f 2026-04-15 00:41:49,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:49,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,350 - lava_callback - ERROR - Error processing callback for node 69dc3bbd5dbfa74e32f9701f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:50,063 - lava_callback - INFO - Received callback for node 69dc3bbd5dbfa74e32f97022 INFO: 172.21.0.1:48044 - "POST /node/69dc3bbd5dbfa74e32f97022 HTTP/1.0" 202 Accepted 2026-04-15 00:41:50,069 - lava_callback - INFO - Starting async job submit for node 69dc3bbd5dbfa74e32f97022 2026-04-15 00:41:50,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,089 - lava_callback - DEBUG - Processing node 69dc3bbd5dbfa74e32f97022: baseline-arm-clabbe 2026-04-15 00:41:50,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbd5dbfa74e32f97022 2026-04-15 00:41:50,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:50,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,205 - lava_callback - ERROR - Error processing callback for node 69dc3bbd5dbfa74e32f97022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:50,737 - lava_callback - INFO - Received callback for node 69dc3bbe5dbfa74e32f97025 INFO: 172.21.0.1:48048 - "POST /node/69dc3bbe5dbfa74e32f97025 HTTP/1.0" 202 Accepted 2026-04-15 00:41:50,743 - lava_callback - INFO - Starting async job submit for node 69dc3bbe5dbfa74e32f97025 2026-04-15 00:41:50,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,759 - lava_callback - DEBUG - Processing node 69dc3bbe5dbfa74e32f97025: baseline-arm-clabbe 2026-04-15 00:41:50,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbe5dbfa74e32f97025 2026-04-15 00:41:50,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:50,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,809 - lava_callback - ERROR - Error processing callback for node 69dc3bbe5dbfa74e32f97025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:51,432 - lava_callback - INFO - Received callback for node 69dc3bbf5dbfa74e32f9702c INFO: 172.21.0.1:48054 - "POST /node/69dc3bbf5dbfa74e32f9702c HTTP/1.0" 202 Accepted 2026-04-15 00:41:51,438 - lava_callback - INFO - Starting async job submit for node 69dc3bbf5dbfa74e32f9702c 2026-04-15 00:41:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,455 - lava_callback - DEBUG - Processing node 69dc3bbf5dbfa74e32f9702c: baseline-arm-clabbe 2026-04-15 00:41:51,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbf5dbfa74e32f9702c 2026-04-15 00:41:51,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,506 - lava_callback - ERROR - Error processing callback for node 69dc3bbf5dbfa74e32f9702c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:52,099 - lava_callback - INFO - Received callback for node 69dc3bc05dbfa74e32f9702f INFO: 172.21.0.1:48066 - "POST /node/69dc3bc05dbfa74e32f9702f HTTP/1.0" 202 Accepted 2026-04-15 00:41:52,105 - lava_callback - INFO - Starting async job submit for node 69dc3bc05dbfa74e32f9702f 2026-04-15 00:41:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,125 - lava_callback - DEBUG - Processing node 69dc3bc05dbfa74e32f9702f: baseline-arm-clabbe 2026-04-15 00:41:52,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bc05dbfa74e32f9702f 2026-04-15 00:41:52,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:52,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,186 - lava_callback - ERROR - Error processing callback for node 69dc3bc05dbfa74e32f9702f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:52,786 - lava_callback - INFO - Received callback for node 69dc3bc15dbfa74e32f97032 INFO: 172.21.0.1:48074 - "POST /node/69dc3bc15dbfa74e32f97032 HTTP/1.0" 202 Accepted 2026-04-15 00:41:52,792 - lava_callback - INFO - Starting async job submit for node 69dc3bc15dbfa74e32f97032 2026-04-15 00:41:52,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,817 - lava_callback - DEBUG - Processing node 69dc3bc15dbfa74e32f97032: baseline-arm-clabbe 2026-04-15 00:41:52,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bc15dbfa74e32f97032 2026-04-15 00:41:52,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,872 - lava_callback - ERROR - Error processing callback for node 69dc3bc15dbfa74e32f97032: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:54,911 - lava_callback - INFO - Received callback for node 69dedeaef490930782fb71a7 INFO: 172.21.0.1:48084 - "POST /node/69dedeaef490930782fb71a7 HTTP/1.0" 202 Accepted 2026-04-15 00:41:54,958 - lava_callback - INFO - Starting async job submit for node 69dedeaef490930782fb71a7 2026-04-15 00:41:54,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:54,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:54,990 - lava_callback - DEBUG - Processing node 69dedeaef490930782fb71a7: baseline-arm 2026-04-15 00:41:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/log.txt.gz 2026-04-15 00:41:55,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/lava-logs.yaml 2026-04-15 00:41:55,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/lava_callback.json.gz 2026-04-15 00:41:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:41:55,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:55,656 - lava_callback - INFO - Completed processing callback for node 69dedeaef490930782fb71a7 INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:00,107 - lava_callback - INFO - Received callback for node 69dedeabf490930782fb719e INFO: 172.21.0.1:48238 - "POST /node/69dedeabf490930782fb719e HTTP/1.0" 202 Accepted 2026-04-15 00:42:00,154 - lava_callback - INFO - Starting async job submit for node 69dedeabf490930782fb719e 2026-04-15 00:42:00,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,198 - lava_callback - DEBUG - Processing node 69dedeabf490930782fb719e: baseline-arm 2026-04-15 00:42:00,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/log.txt.gz 2026-04-15 00:42:00,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/lava-logs.yaml 2026-04-15 00:42:00,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/lava_callback.json.gz 2026-04-15 00:42:00,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:00,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,938 - lava_callback - INFO - Completed processing callback for node 69dedeabf490930782fb719e 2026-04-15 00:42:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:06,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:07,127 - lava_callback - INFO - Received callback for node 69dc3bd45dbfa74e32f97083 INFO: 172.21.0.1:48276 - "POST /node/69dc3bd45dbfa74e32f97083 HTTP/1.0" 202 Accepted 2026-04-15 00:42:07,132 - lava_callback - INFO - Starting async job submit for node 69dc3bd45dbfa74e32f97083 2026-04-15 00:42:07,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,152 - lava_callback - DEBUG - Processing node 69dc3bd45dbfa74e32f97083: baseline-arm-clabbe 2026-04-15 00:42:07,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bd45dbfa74e32f97083 2026-04-15 00:42:07,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:42:07,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,220 - lava_callback - ERROR - Error processing callback for node 69dc3bd45dbfa74e32f97083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:34,684 - lava_callback - INFO - Received callback for node 69dedeadf490930782fb71a4 INFO: 172.21.0.1:35188 - "POST /node/69dedeadf490930782fb71a4 HTTP/1.0" 202 Accepted 2026-04-15 00:42:34,690 - lava_callback - INFO - Starting async job submit for node 69dedeadf490930782fb71a4 2026-04-15 00:42:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:34,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:34,727 - lava_callback - DEBUG - Processing node 69dedeadf490930782fb71a4: baseline-arm 2026-04-15 00:42:35,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/log.txt.gz 2026-04-15 00:42:35,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/lava-logs.yaml 2026-04-15 00:42:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/lava_callback.json.gz 2026-04-15 00:42:35,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:35,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:35,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:35,753 - lava_callback - INFO - Completed processing callback for node 69dedeadf490930782fb71a4 2026-04-15 00:42:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:36,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:37,883 - lava_callback - INFO - Received callback for node 69dedeaaf490930782fb7198 INFO: 172.21.0.1:35216 - "POST /node/69dedeaaf490930782fb7198 HTTP/1.0" 202 Accepted 2026-04-15 00:42:37,889 - lava_callback - INFO - Starting async job submit for node 69dedeaaf490930782fb7198 2026-04-15 00:42:37,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:37,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:37,943 - lava_callback - DEBUG - Processing node 69dedeaaf490930782fb7198: baseline-arm 2026-04-15 00:42:38,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/log.txt.gz 2026-04-15 00:42:38,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/lava-logs.yaml 2026-04-15 00:42:38,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/lava_callback.json.gz 2026-04-15 00:42:38,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:38,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:38,845 - lava_callback - INFO - Completed processing callback for node 69dedeaaf490930782fb7198 2026-04-15 00:42:44,973 - lava_callback - INFO - Received callback for node 69dedecff490930782fb722d INFO: 172.21.0.1:44206 - "POST /node/69dedecff490930782fb722d HTTP/1.0" 202 Accepted 2026-04-15 00:42:44,979 - lava_callback - INFO - Starting async job submit for node 69dedecff490930782fb722d 2026-04-15 00:42:44,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,012 - lava_callback - DEBUG - Processing node 69dedecff490930782fb722d: baseline-arm-pengutronix 2026-04-15 00:42:45,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/log.txt.gz 2026-04-15 00:42:45,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/lava-logs.yaml 2026-04-15 00:42:45,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/lava_callback.json.gz 2026-04-15 00:42:45,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,760 - lava_callback - INFO - Completed processing callback for node 69dedecff490930782fb722d 2026-04-15 00:42:46,282 - lava_callback - INFO - Received callback for node 69dedebdf490930782fb71db INFO: 172.21.0.1:44222 - "POST /node/69dedebdf490930782fb71db HTTP/1.0" 202 Accepted 2026-04-15 00:42:46,290 - lava_callback - INFO - Starting async job submit for node 69dedebdf490930782fb71db 2026-04-15 00:42:46,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:46,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:46,328 - lava_callback - DEBUG - Processing node 69dedebdf490930782fb71db: baseline-arm-broonie INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:46,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:46,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/log.txt.gz 2026-04-15 00:42:46,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:46,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:46,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/lava-logs.yaml 2026-04-15 00:42:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:47,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:47,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/lava_callback.json.gz 2026-04-15 00:42:47,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:47,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:47,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:47,216 - lava_callback - INFO - Completed processing callback for node 69dedebdf490930782fb71db 2026-04-15 00:42:47,225 - lava_callback - INFO - Received callback for node 69dc3bfa5dbfa74e32f97109 INFO: 172.21.0.1:44228 - "POST /node/69dc3bfa5dbfa74e32f97109 HTTP/1.0" 202 Accepted 2026-04-15 00:42:47,246 - lava_callback - INFO - Starting async job submit for node 69dc3bfa5dbfa74e32f97109 2026-04-15 00:42:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,281 - lava_callback - DEBUG - Processing node 69dc3bfa5dbfa74e32f97109: baseline-arm-clabbe 2026-04-15 00:42:47,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bfa5dbfa74e32f97109 2026-04-15 00:42:47,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:42:47,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,363 - lava_callback - ERROR - Error processing callback for node 69dc3bfa5dbfa74e32f97109: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:42:54,943 - lava_callback - INFO - Received callback for node 69deded0f490930782fb7234 INFO: 172.21.0.1:59574 - "POST /node/69deded0f490930782fb7234 HTTP/1.0" 202 Accepted 2026-04-15 00:42:54,989 - lava_callback - INFO - Starting async job submit for node 69deded0f490930782fb7234 2026-04-15 00:42:55,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,053 - lava_callback - DEBUG - Processing node 69deded0f490930782fb7234: baseline-arm-pengutronix 2026-04-15 00:42:55,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/log.txt.gz 2026-04-15 00:42:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/lava-logs.yaml 2026-04-15 00:42:55,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/lava_callback.json.gz 2026-04-15 00:42:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,719 - lava_callback - INFO - Completed processing callback for node 69deded0f490930782fb7234 INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:05,580 - lava_callback - INFO - Received callback for node 69dedebef490930782fb71de INFO: 172.21.0.1:60344 - "POST /node/69dedebef490930782fb71de HTTP/1.0" 202 Accepted 2026-04-15 00:43:05,586 - lava_callback - INFO - Starting async job submit for node 69dedebef490930782fb71de 2026-04-15 00:43:05,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:05,631 - lava_callback - DEBUG - Processing node 69dedebef490930782fb71de: baseline-arm-broonie 2026-04-15 00:43:05,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:05,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:05,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/log.txt.gz 2026-04-15 00:43:06,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:06,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:06,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/lava-logs.yaml 2026-04-15 00:43:06,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 00:43:06,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:06,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/lava_callback.json.gz 2026-04-15 00:43:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:06,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:06,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:06,570 - lava_callback - INFO - Completed processing callback for node 69dedebef490930782fb71de INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:07,226 - lava_callback - INFO - Received callback for node 69dedebcf490930782fb71d8 INFO: 172.21.0.1:60378 - "POST /node/69dedebcf490930782fb71d8 HTTP/1.0" 202 Accepted 2026-04-15 00:43:07,232 - lava_callback - INFO - Starting async job submit for node 69dedebcf490930782fb71d8 2026-04-15 00:43:07,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:07,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:07,270 - lava_callback - DEBUG - Processing node 69dedebcf490930782fb71d8: baseline-arm-broonie 2026-04-15 00:43:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:07,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:07,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/log.txt.gz 2026-04-15 00:43:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:07,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:07,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/lava-logs.yaml 2026-04-15 00:43:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:08,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:08,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/lava_callback.json.gz 2026-04-15 00:43:08,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:08,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:08,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:08,151 - lava_callback - INFO - Completed processing callback for node 69dedebcf490930782fb71d8 INFO: 172.21.0.1:48724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:25,710 - lava_callback - INFO - Received callback for node 69dedebaf490930782fb71d5 INFO: 172.21.0.1:37334 - "POST /node/69dedebaf490930782fb71d5 HTTP/1.0" 202 Accepted 2026-04-15 00:43:25,716 - lava_callback - INFO - Starting async job submit for node 69dedebaf490930782fb71d5 2026-04-15 00:43:25,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:25,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:25,779 - lava_callback - DEBUG - Processing node 69dedebaf490930782fb71d5: baseline-arm-broonie 2026-04-15 00:43:25,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:26,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,288 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/log.txt.gz 2026-04-15 00:43:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:26,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/lava-logs.yaml 2026-04-15 00:43:26,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:26,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/lava_callback.json.gz 2026-04-15 00:43:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:26,827 - lava_callback - INFO - Completed processing callback for node 69dedebaf490930782fb71d5 2026-04-15 00:43:27,249 - lava_callback - INFO - Received callback for node 69dc3c1e5dbfa74e32f97163 INFO: 172.21.0.1:37348 - "POST /node/69dc3c1e5dbfa74e32f97163 HTTP/1.0" 202 Accepted 2026-04-15 00:43:27,255 - lava_callback - INFO - Starting async job submit for node 69dc3c1e5dbfa74e32f97163 2026-04-15 00:43:27,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,270 - lava_callback - DEBUG - Processing node 69dc3c1e5dbfa74e32f97163: baseline-arm-clabbe 2026-04-15 00:43:27,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c1e5dbfa74e32f97163 2026-04-15 00:43:27,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:43:27,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,318 - lava_callback - ERROR - Error processing callback for node 69dc3c1e5dbfa74e32f97163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:43:27,348 - lava_callback - INFO - Received callback for node 69dedec9f490930782fb7213 INFO: 172.21.0.1:37358 - "POST /node/69dedec9f490930782fb7213 HTTP/1.0" 202 Accepted 2026-04-15 00:43:27,364 - lava_callback - INFO - Starting async job submit for node 69dedec9f490930782fb7213 2026-04-15 00:43:27,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:27,427 - lava_callback - DEBUG - Processing node 69dedec9f490930782fb7213: baseline-arm-kontron 2026-04-15 00:43:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:27,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:27,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/log.txt.gz 2026-04-15 00:43:27,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/lava-logs.yaml 2026-04-15 00:43:28,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/lava_callback.json.gz 2026-04-15 00:43:28,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:28,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:28,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:28,327 - lava_callback - INFO - Completed processing callback for node 69dedec9f490930782fb7213 2026-04-15 00:43:28,554 - lava_callback - INFO - Received callback for node 69dedecbf490930782fb7216 INFO: 172.21.0.1:37362 - "POST /node/69dedecbf490930782fb7216 HTTP/1.0" 202 Accepted 2026-04-15 00:43:28,564 - lava_callback - INFO - Starting async job submit for node 69dedecbf490930782fb7216 2026-04-15 00:43:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:28,615 - lava_callback - DEBUG - Processing node 69dedecbf490930782fb7216: baseline-arm-kontron 2026-04-15 00:43:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/log.txt.gz 2026-04-15 00:43:29,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:29,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:29,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/lava-logs.yaml 2026-04-15 00:43:29,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:29,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:29,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/lava_callback.json.gz 2026-04-15 00:43:29,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:29,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:29,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:29,503 - lava_callback - INFO - Completed processing callback for node 69dedecbf490930782fb7216 2026-04-15 00:43:36,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:36,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:44:07,143 - lava_callback - INFO - Received callback for node 69dedee1f490930782fb7288 INFO: 172.21.0.1:33040 - "POST /node/69dedee1f490930782fb7288 HTTP/1.0" 202 Accepted 2026-04-15 00:44:07,150 - lava_callback - INFO - Starting async job submit for node 69dedee1f490930782fb7288 2026-04-15 00:44:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:07,188 - lava_callback - DEBUG - Processing node 69dedee1f490930782fb7288: ltp-dio 2026-04-15 00:44:07,262 - lava_callback - INFO - Received callback for node 69dc3c435dbfa74e32f97191 INFO: 172.21.0.1:33048 - "POST /node/69dc3c435dbfa74e32f97191 HTTP/1.0" 202 Accepted 2026-04-15 00:44:07,283 - lava_callback - INFO - Starting async job submit for node 69dc3c435dbfa74e32f97191 2026-04-15 00:44:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,383 - lava_callback - DEBUG - Processing node 69dc3c435dbfa74e32f97191: baseline-arm-clabbe 2026-04-15 00:44:07,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c435dbfa74e32f97191 2026-04-15 00:44:07,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:07,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:44:07,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,611 - lava_callback - ERROR - Error processing callback for node 69dc3c435dbfa74e32f97191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:44:07,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:07,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/log.txt.gz 2026-04-15 00:44:08,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:08,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:08,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/lava-logs.yaml 2026-04-15 00:44:08,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:08,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:08,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/lava_callback.json.gz 2026-04-15 00:44:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:44:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:08,550 - lava_callback - INFO - Completed processing callback for node 69dedee1f490930782fb7288 INFO: 172.21.0.1:46322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:44:27,220 - lava_callback - INFO - Received callback for node 69dc3c655dbfa74e32f971c4 INFO: 172.21.0.1:47734 - "POST /node/69dc3c655dbfa74e32f971c4 HTTP/1.0" 202 Accepted 2026-04-15 00:44:27,226 - lava_callback - INFO - Starting async job submit for node 69dc3c655dbfa74e32f971c4 2026-04-15 00:44:27,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,247 - lava_callback - DEBUG - Processing node 69dc3c655dbfa74e32f971c4: baseline-arm-clabbe 2026-04-15 00:44:27,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c655dbfa74e32f971c4 2026-04-15 00:44:27,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:44:27,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,295 - lava_callback - ERROR - Error processing callback for node 69dc3c655dbfa74e32f971c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:44:36,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:36,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:45:07,313 - lava_callback - INFO - Received callback for node 69dc3c885dbfa74e32f971eb INFO: 172.21.0.1:43518 - "POST /node/69dc3c885dbfa74e32f971eb HTTP/1.0" 202 Accepted 2026-04-15 00:45:07,319 - lava_callback - INFO - Starting async job submit for node 69dc3c885dbfa74e32f971eb 2026-04-15 00:45:07,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,336 - lava_callback - DEBUG - Processing node 69dc3c885dbfa74e32f971eb: baseline-arm-clabbe 2026-04-15 00:45:07,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c885dbfa74e32f971eb 2026-04-15 00:45:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:45:07,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,400 - lava_callback - ERROR - Error processing callback for node 69dc3c885dbfa74e32f971eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:45:47,313 - lava_callback - INFO - Received callback for node 69dc3caa5dbfa74e32f9720c INFO: 172.21.0.1:60248 - "POST /node/69dc3caa5dbfa74e32f9720c HTTP/1.0" 202 Accepted 2026-04-15 00:45:47,319 - lava_callback - INFO - Starting async job submit for node 69dc3caa5dbfa74e32f9720c 2026-04-15 00:45:47,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,334 - lava_callback - DEBUG - Processing node 69dc3caa5dbfa74e32f9720c: baseline-arm-clabbe 2026-04-15 00:45:47,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3caa5dbfa74e32f9720c 2026-04-15 00:45:47,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:45:47,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,394 - lava_callback - ERROR - Error processing callback for node 69dc3caa5dbfa74e32f9720c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:46:25,812 - lava_callback - INFO - Received callback for node 69dedeebf490930782fb72d5 INFO: 172.21.0.1:55816 - "POST /node/69dedeebf490930782fb72d5 HTTP/1.0" 202 Accepted 2026-04-15 00:46:25,820 - lava_callback - INFO - Starting async job submit for node 69dedeebf490930782fb72d5 2026-04-15 00:46:25,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:25,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:25,886 - lava_callback - DEBUG - Processing node 69dedeebf490930782fb72d5: ltp-syscalls INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:46:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:27,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:27,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/log.txt.gz 2026-04-15 00:46:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:28,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:28,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/lava-logs.yaml 2026-04-15 00:46:28,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:28,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:28,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/lava_callback.json.gz 2026-04-15 00:46:28,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:46:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:28,421 - lava_callback - INFO - Completed processing callback for node 69dedeebf490930782fb72d5 2026-04-15 00:46:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:36,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET /node/698ff16c76d4b6342e9db7c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:07,697 - lava_callback - INFO - Received callback for node 69dedfbef490930782fb73d2 INFO: 172.21.0.1:44104 - "POST /node/69dedfbef490930782fb73d2 HTTP/1.0" 202 Accepted 2026-04-15 00:48:07,705 - lava_callback - INFO - Starting async job submit for node 69dedfbef490930782fb73d2 2026-04-15 00:48:07,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:07,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:07,743 - lava_callback - DEBUG - Processing node 69dedfbef490930782fb73d2: baseline-x86 2026-04-15 00:48:08,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:08,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:08,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/log.txt.gz 2026-04-15 00:48:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:08,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:08,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/lava-logs.yaml 2026-04-15 00:48:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:09,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:09,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/lava_callback.json.gz 2026-04-15 00:48:09,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:48:09,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:09,124 - lava_callback - INFO - Completed processing callback for node 69dedfbef490930782fb73d2 INFO: 172.21.0.1:60888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:25,862 - lava_callback - INFO - Received callback for node 69dedee0f490930782fb7285 INFO: 172.21.0.1:58348 - "POST /node/69dedee0f490930782fb7285 HTTP/1.0" 202 Accepted 2026-04-15 00:48:25,872 - lava_callback - INFO - Starting async job submit for node 69dedee0f490930782fb7285 2026-04-15 00:48:25,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:25,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:25,936 - lava_callback - DEBUG - Processing node 69dedee0f490930782fb7285: ltp-cve 2026-04-15 00:48:26,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:26,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:26,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/log.txt.gz 2026-04-15 00:48:27,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:27,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:27,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/lava-logs.yaml 2026-04-15 00:48:27,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:27,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:27,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/lava_callback.json.gz 2026-04-15 00:48:27,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:27,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:48:27,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:27,704 - lava_callback - INFO - Completed processing callback for node 69dedee0f490930782fb7285 2026-04-15 00:48:36,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET /node/6940ed54460bc8e265114cd6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:56,857 - lava_callback - INFO - Received callback for node 69dee063f490930782fb74b6 INFO: 172.21.0.1:41842 - "POST /node/69dee063f490930782fb74b6 HTTP/1.0" 202 Accepted 2026-04-15 00:48:56,864 - lava_callback - INFO - Starting async job submit for node 69dee063f490930782fb74b6 2026-04-15 00:48:56,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:56,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:56,885 - lava_callback - DEBUG - Processing node 69dee063f490930782fb74b6: baseline-arm 2026-04-15 00:48:56,891 - lava_callback - WARNING - Failed to upload log 2026-04-15 00:48:56,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:57,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:57,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee063f490930782fb74b6/lava-logs.yaml 2026-04-15 00:48:57,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:57,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:57,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee063f490930782fb74b6/lava_callback.json.gz 2026-04-15 00:48:57,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:57,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:48:57,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:57,383 - lava_callback - INFO - Completed processing callback for node 69dee063f490930782fb74b6 2026-04-15 00:49:06,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:49:06,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET /node/69903b53985e4efca431ddd1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57168 - "GET /node/693b7a1c41fb4c9509762807%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 00:50:45,916 - lava_callback - INFO - Received callback for node 69dededef490930782fb7280 INFO: 172.21.0.1:57182 - "POST /node/69dededef490930782fb7280 HTTP/1.0" 202 Accepted 2026-04-15 00:50:45,924 - lava_callback - INFO - Starting async job submit for node 69dededef490930782fb7280 2026-04-15 00:50:45,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:45,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:45,982 - lava_callback - DEBUG - Processing node 69dededef490930782fb7280: ltp-controllers INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:50:46,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:46,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:46,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/log.txt.gz 2026-04-15 00:50:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:47,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:47,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/lava-logs.yaml 2026-04-15 00:50:47,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:47,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:47,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/lava_callback.json.gz 2026-04-15 00:50:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:47,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:50:47,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:47,808 - lava_callback - INFO - Completed processing callback for node 69dededef490930782fb7280 INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:06,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:06,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET /node/698ef62af0e3ffbba67d2ef6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:45,948 - lava_callback - INFO - Received callback for node 69dedee3f490930782fb728b INFO: 172.21.0.1:52050 - "POST /node/69dedee3f490930782fb728b HTTP/1.0" 202 Accepted 2026-04-15 00:51:45,955 - lava_callback - INFO - Starting async job submit for node 69dedee3f490930782fb728b 2026-04-15 00:51:45,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:46,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:46,008 - lava_callback - DEBUG - Processing node 69dedee3f490930782fb728b: ltp-fs_bind 2026-04-15 00:51:46,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:46,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:46,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/log.txt.gz 2026-04-15 00:51:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:51:47,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:47,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/lava-logs.yaml 2026-04-15 00:51:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:51:47,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:47,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/lava_callback.json.gz 2026-04-15 00:51:47,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:47,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:51:47,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:47,513 - lava_callback - INFO - Completed processing callback for node 69dedee3f490930782fb728b INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:06,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /node/69836944409235c29c0e0e5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:46,408 - lava_callback - INFO - Received callback for node 69dedee4f490930782fb72c0 INFO: 172.21.0.1:53598 - "POST /node/69dedee4f490930782fb72c0 HTTP/1.0" 202 Accepted 2026-04-15 00:52:46,415 - lava_callback - INFO - Starting async job submit for node 69dedee4f490930782fb72c0 2026-04-15 00:52:46,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:46,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:46,458 - lava_callback - DEBUG - Processing node 69dedee4f490930782fb72c0: ltp-fsx INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:46,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/log.txt.gz 2026-04-15 00:52:47,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/lava-logs.yaml 2026-04-15 00:52:47,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/lava_callback.json.gz 2026-04-15 00:52:47,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:47,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:52:47,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:47,963 - lava_callback - INFO - Completed processing callback for node 69dedee4f490930782fb72c0 INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:53:06,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:53:06,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET /node/6991865210b45da7d7d0fd3c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 00:54:46,145 - lava_callback - INFO - Received callback for node 69dedee6f490930782fb72c7 INFO: 172.21.0.1:36508 - "POST /node/69dedee6f490930782fb72c7 HTTP/1.0" 202 Accepted 2026-04-15 00:54:46,153 - lava_callback - INFO - Starting async job submit for node 69dedee6f490930782fb72c7 2026-04-15 00:54:46,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:46,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:46,196 - lava_callback - DEBUG - Processing node 69dedee6f490930782fb72c7: ltp-ipc INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:54:46,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:46,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:46,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/log.txt.gz 2026-04-15 00:54:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:47,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:47,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/lava-logs.yaml 2026-04-15 00:54:47,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:47,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:47,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/lava_callback.json.gz 2026-04-15 00:54:47,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:47,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:54:47,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:47,644 - lava_callback - INFO - Completed processing callback for node 69dedee6f490930782fb72c7 INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:06,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:46,112 - lava_callback - INFO - Received callback for node 69dedee8f490930782fb72ce INFO: 172.21.0.1:42006 - "POST /node/69dedee8f490930782fb72ce HTTP/1.0" 202 Accepted 2026-04-15 00:55:46,122 - lava_callback - INFO - Starting async job submit for node 69dedee8f490930782fb72ce 2026-04-15 00:55:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:46,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:46,180 - lava_callback - DEBUG - Processing node 69dedee8f490930782fb72ce: ltp-sched INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:46,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:47,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:47,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/log.txt.gz 2026-04-15 00:55:47,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:47,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:47,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/lava-logs.yaml 2026-04-15 00:55:47,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:48,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:48,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/lava_callback.json.gz 2026-04-15 00:55:48,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:48,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:55:48,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:48,808 - lava_callback - INFO - Completed processing callback for node 69dedee8f490930782fb72ce INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET /node/694bd8bac19e09af58d498fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:56:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:56:06,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:14,384 - lava_callback - INFO - Received callback for node 69dedd85f490930782fb700a INFO: 172.21.0.1:41788 - "POST /node/69dedd85f490930782fb700a HTTP/1.0" 202 Accepted 2026-04-15 00:57:14,391 - lava_callback - INFO - Starting async job submit for node 69dedd85f490930782fb700a 2026-04-15 00:57:14,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:14,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:14,446 - lava_callback - DEBUG - Processing node 69dedd85f490930782fb700a: baseline-x86 INFO: 172.21.0.1:41798 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 00:57:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:15,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:15,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/log.txt.gz 2026-04-15 00:57:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:16,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:16,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/lava-logs.yaml 2026-04-15 00:57:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:16,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:16,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/lava_callback.json.gz DEBUG: Setup failed for 69dedd85f490930782fb700a. Transitting job node result: incomplete -> fail 2026-04-15 00:57:16,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:16,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:57:16,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:17,039 - lava_callback - INFO - Completed processing callback for node 69dedd85f490930782fb700a 2026-04-15 00:57:26,221 - lava_callback - INFO - Received callback for node 69dedeedf490930782fb72d8 INFO: 172.21.0.1:48956 - "POST /node/69dedeedf490930782fb72d8 HTTP/1.0" 202 Accepted 2026-04-15 00:57:26,228 - lava_callback - INFO - Starting async job submit for node 69dedeedf490930782fb72d8 2026-04-15 00:57:26,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:26,282 - lava_callback - DEBUG - Processing node 69dedeedf490930782fb72d8: ltp-syscalls-ipc INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:26,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:26,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:26,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/log.txt.gz 2026-04-15 00:57:27,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:27,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:27,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/lava-logs.yaml 2026-04-15 00:57:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:27,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:27,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/lava_callback.json.gz 2026-04-15 00:57:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:27,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:57:27,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:27,694 - lava_callback - INFO - Completed processing callback for node 69dedeedf490930782fb72d8 INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:36,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:36,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55478 - "GET /node/69866314177ca0f097bd480e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:50,229 - lava_callback - INFO - Received callback for node 69dedeacf490930782fb71a1 INFO: 172.21.0.1:41902 - "POST /node/69dedeacf490930782fb71a1 HTTP/1.0" 202 Accepted 2026-04-15 00:57:50,236 - lava_callback - INFO - Starting async job submit for node 69dedeacf490930782fb71a1 2026-04-15 00:57:50,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:50,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:50,306 - lava_callback - DEBUG - Processing node 69dedeacf490930782fb71a1: baseline-arm 2026-04-15 00:57:50,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/log.txt.gz 2026-04-15 00:57:51,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/lava-logs.yaml 2026-04-15 00:57:51,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/lava_callback.json.gz DEBUG: Setup failed for 69dedeacf490930782fb71a1. Transitting job node result: incomplete -> fail 2026-04-15 00:57:51,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:51,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:57:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:52,076 - lava_callback - INFO - Completed processing callback for node 69dedeacf490930782fb71a1 INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:06,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET /node/6986fc196e077e4126a7d4e0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:46,244 - lava_callback - INFO - Received callback for node 69dedeeff490930782fb72df INFO: 172.21.0.1:48082 - "POST /node/69dedeeff490930782fb72df HTTP/1.0" 202 Accepted 2026-04-15 00:58:46,251 - lava_callback - INFO - Starting async job submit for node 69dedeeff490930782fb72df 2026-04-15 00:58:46,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:46,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:46,292 - lava_callback - DEBUG - Processing node 69dedeeff490930782fb72df: ltp-watchqueue INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:46,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:46,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:46,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/log.txt.gz 2026-04-15 00:58:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:47,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:47,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/lava-logs.yaml 2026-04-15 00:58:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:47,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:47,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/lava_callback.json.gz 2026-04-15 00:58:47,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:47,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:58:47,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:47,656 - lava_callback - INFO - Completed processing callback for node 69dedeeff490930782fb72df 2026-04-15 00:58:55,396 - lava_callback - INFO - Received callback for node 69dc3fc15dbfa74e32f975fe INFO: 172.21.0.1:43988 - "POST /node/69dc3fc15dbfa74e32f975fe HTTP/1.0" 202 Accepted 2026-04-15 00:58:55,403 - lava_callback - INFO - Starting async job submit for node 69dc3fc15dbfa74e32f975fe 2026-04-15 00:58:55,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,424 - lava_callback - DEBUG - Processing node 69dc3fc15dbfa74e32f975fe: baseline-arm64-baylibre 2026-04-15 00:58:55,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc15dbfa74e32f975fe 2026-04-15 00:58:55,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:55,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,516 - lava_callback - ERROR - Error processing callback for node 69dc3fc15dbfa74e32f975fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:56,074 - lava_callback - INFO - Received callback for node 69dc3fc25dbfa74e32f97601 INFO: 172.21.0.1:43996 - "POST /node/69dc3fc25dbfa74e32f97601 HTTP/1.0" 202 Accepted 2026-04-15 00:58:56,081 - lava_callback - INFO - Starting async job submit for node 69dc3fc25dbfa74e32f97601 2026-04-15 00:58:56,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,098 - lava_callback - DEBUG - Processing node 69dc3fc25dbfa74e32f97601: baseline-arm64-baylibre 2026-04-15 00:58:56,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc25dbfa74e32f97601 2026-04-15 00:58:56,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:56,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,148 - lava_callback - ERROR - Error processing callback for node 69dc3fc25dbfa74e32f97601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:56,724 - lava_callback - INFO - Received callback for node 69dc3fc85dbfa74e32f9762c INFO: 172.21.0.1:44002 - "POST /node/69dc3fc85dbfa74e32f9762c HTTP/1.0" 202 Accepted 2026-04-15 00:58:56,730 - lava_callback - INFO - Starting async job submit for node 69dc3fc85dbfa74e32f9762c 2026-04-15 00:58:56,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,747 - lava_callback - DEBUG - Processing node 69dc3fc85dbfa74e32f9762c: baseline-arm64-baylibre 2026-04-15 00:58:56,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc85dbfa74e32f9762c 2026-04-15 00:58:56,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:56,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,801 - lava_callback - ERROR - Error processing callback for node 69dc3fc85dbfa74e32f9762c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:57,399 - lava_callback - INFO - Received callback for node 69dc3fbf5dbfa74e32f975fb INFO: 172.21.0.1:44012 - "POST /node/69dc3fbf5dbfa74e32f975fb HTTP/1.0" 202 Accepted 2026-04-15 00:58:57,405 - lava_callback - INFO - Starting async job submit for node 69dc3fbf5dbfa74e32f975fb 2026-04-15 00:58:57,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,421 - lava_callback - DEBUG - Processing node 69dc3fbf5dbfa74e32f975fb: baseline-arm64-baylibre 2026-04-15 00:58:57,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fbf5dbfa74e32f975fb 2026-04-15 00:58:57,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,483 - lava_callback - ERROR - Error processing callback for node 69dc3fbf5dbfa74e32f975fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:58,047 - lava_callback - INFO - Received callback for node 69dc3fc55dbfa74e32f97608 INFO: 172.21.0.1:44020 - "POST /node/69dc3fc55dbfa74e32f97608 HTTP/1.0" 202 Accepted 2026-04-15 00:58:58,053 - lava_callback - INFO - Starting async job submit for node 69dc3fc55dbfa74e32f97608 2026-04-15 00:58:58,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,069 - lava_callback - DEBUG - Processing node 69dc3fc55dbfa74e32f97608: baseline-arm64-baylibre 2026-04-15 00:58:58,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc55dbfa74e32f97608 2026-04-15 00:58:58,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:58,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,117 - lava_callback - ERROR - Error processing callback for node 69dc3fc55dbfa74e32f97608: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:58,695 - lava_callback - INFO - Received callback for node 69dc3fc75dbfa74e32f97629 INFO: 172.21.0.1:44026 - "POST /node/69dc3fc75dbfa74e32f97629 HTTP/1.0" 202 Accepted 2026-04-15 00:58:58,700 - lava_callback - INFO - Starting async job submit for node 69dc3fc75dbfa74e32f97629 2026-04-15 00:58:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,716 - lava_callback - DEBUG - Processing node 69dc3fc75dbfa74e32f97629: baseline-arm64-baylibre 2026-04-15 00:58:58,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc75dbfa74e32f97629 2026-04-15 00:58:58,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:58,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,764 - lava_callback - ERROR - Error processing callback for node 69dc3fc75dbfa74e32f97629: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:59,361 - lava_callback - INFO - Received callback for node 69dc3fcc5dbfa74e32f97637 INFO: 172.21.0.1:44032 - "POST /node/69dc3fcc5dbfa74e32f97637 HTTP/1.0" 202 Accepted 2026-04-15 00:58:59,367 - lava_callback - INFO - Starting async job submit for node 69dc3fcc5dbfa74e32f97637 2026-04-15 00:58:59,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,383 - lava_callback - DEBUG - Processing node 69dc3fcc5dbfa74e32f97637: baseline-arm64-baylibre 2026-04-15 00:58:59,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fcc5dbfa74e32f97637 2026-04-15 00:58:59,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 00:58:59,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,430 - lava_callback - ERROR - Error processing callback for node 69dc3fcc5dbfa74e32f97637: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:06,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:06,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:07,909 - lava_callback - INFO - Received callback for node 69dc3fd85dbfa74e32f97658 INFO: 172.21.0.1:42570 - "POST /node/69dc3fd85dbfa74e32f97658 HTTP/1.0" 202 Accepted 2026-04-15 00:59:07,915 - lava_callback - INFO - Starting async job submit for node 69dc3fd85dbfa74e32f97658 2026-04-15 00:59:07,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,933 - lava_callback - DEBUG - Processing node 69dc3fd85dbfa74e32f97658: baseline-arm64-clabbe 2026-04-15 00:59:07,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fd85dbfa74e32f97658 2026-04-15 00:59:07,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,983 - lava_callback - ERROR - Error processing callback for node 69dc3fd85dbfa74e32f97658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:27,881 - lava_callback - INFO - Received callback for node 69dc3fda5dbfa74e32f9765f INFO: 172.21.0.1:35842 - "POST /node/69dc3fda5dbfa74e32f9765f HTTP/1.0" 202 Accepted 2026-04-15 00:59:27,887 - lava_callback - INFO - Starting async job submit for node 69dc3fda5dbfa74e32f9765f 2026-04-15 00:59:27,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,903 - lava_callback - DEBUG - Processing node 69dc3fda5dbfa74e32f9765f: baseline-arm64-clabbe 2026-04-15 00:59:27,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fda5dbfa74e32f9765f 2026-04-15 00:59:27,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:27,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,951 - lava_callback - ERROR - Error processing callback for node 69dc3fda5dbfa74e32f9765f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:28,570 - lava_callback - INFO - Received callback for node 69dc3fdb5dbfa74e32f97662 INFO: 172.21.0.1:35854 - "POST /node/69dc3fdb5dbfa74e32f97662 HTTP/1.0" 202 Accepted 2026-04-15 00:59:28,576 - lava_callback - INFO - Starting async job submit for node 69dc3fdb5dbfa74e32f97662 2026-04-15 00:59:28,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,592 - lava_callback - DEBUG - Processing node 69dc3fdb5dbfa74e32f97662: baseline-arm64-clabbe 2026-04-15 00:59:28,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdb5dbfa74e32f97662 2026-04-15 00:59:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,642 - lava_callback - ERROR - Error processing callback for node 69dc3fdb5dbfa74e32f97662: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:29,230 - lava_callback - INFO - Received callback for node 69dc3fdc5dbfa74e32f97665 INFO: 172.21.0.1:35870 - "POST /node/69dc3fdc5dbfa74e32f97665 HTTP/1.0" 202 Accepted 2026-04-15 00:59:29,237 - lava_callback - INFO - Starting async job submit for node 69dc3fdc5dbfa74e32f97665 2026-04-15 00:59:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,252 - lava_callback - DEBUG - Processing node 69dc3fdc5dbfa74e32f97665: baseline-arm64-clabbe 2026-04-15 00:59:29,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdc5dbfa74e32f97665 2026-04-15 00:59:29,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:29,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,308 - lava_callback - ERROR - Error processing callback for node 69dc3fdc5dbfa74e32f97665: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:29,918 - lava_callback - INFO - Received callback for node 69dc3fdd5dbfa74e32f97668 INFO: 172.21.0.1:42224 - "POST /node/69dc3fdd5dbfa74e32f97668 HTTP/1.0" 202 Accepted 2026-04-15 00:59:29,924 - lava_callback - INFO - Starting async job submit for node 69dc3fdd5dbfa74e32f97668 2026-04-15 00:59:29,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,940 - lava_callback - DEBUG - Processing node 69dc3fdd5dbfa74e32f97668: baseline-arm64-clabbe 2026-04-15 00:59:29,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdd5dbfa74e32f97668 2026-04-15 00:59:29,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,989 - lava_callback - ERROR - Error processing callback for node 69dc3fdd5dbfa74e32f97668: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:30,599 - lava_callback - INFO - Received callback for node 69dc3fdf5dbfa74e32f9766e INFO: 172.21.0.1:42234 - "POST /node/69dc3fdf5dbfa74e32f9766e HTTP/1.0" 202 Accepted 2026-04-15 00:59:30,605 - lava_callback - INFO - Starting async job submit for node 69dc3fdf5dbfa74e32f9766e 2026-04-15 00:59:30,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,621 - lava_callback - DEBUG - Processing node 69dc3fdf5dbfa74e32f9766e: baseline-arm64-clabbe 2026-04-15 00:59:30,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdf5dbfa74e32f9766e 2026-04-15 00:59:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:30,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,671 - lava_callback - ERROR - Error processing callback for node 69dc3fdf5dbfa74e32f9766e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:31,261 - lava_callback - INFO - Received callback for node 69dc3fde5dbfa74e32f9766b INFO: 172.21.0.1:42236 - "POST /node/69dc3fde5dbfa74e32f9766b HTTP/1.0" 202 Accepted 2026-04-15 00:59:31,270 - lava_callback - INFO - Starting async job submit for node 69dc3fde5dbfa74e32f9766b 2026-04-15 00:59:31,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,294 - lava_callback - DEBUG - Processing node 69dc3fde5dbfa74e32f9766b: baseline-arm64-clabbe 2026-04-15 00:59:31,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fde5dbfa74e32f9766b 2026-04-15 00:59:31,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:31,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,350 - lava_callback - ERROR - Error processing callback for node 69dc3fde5dbfa74e32f9766b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:46,841 - lava_callback - INFO - Received callback for node 69dedc0af490930782fb6e65 INFO: 172.21.0.1:33576 - "POST /node/69dedc0af490930782fb6e65 HTTP/1.0" 202 Accepted 2026-04-15 00:59:46,848 - lava_callback - INFO - Starting async job submit for node 69dedc0af490930782fb6e65 2026-04-15 00:59:46,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:46,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:46,927 - lava_callback - DEBUG - Processing node 69dedc0af490930782fb6e65: ltp-smoke 2026-04-15 00:59:47,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:47,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:47,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/log.txt.gz 2026-04-15 00:59:47,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:48,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:48,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/lava-logs.yaml 2026-04-15 00:59:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:48,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:48,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/lava_callback.json.gz 2026-04-15 00:59:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:48,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 00:59:48,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:48,538 - lava_callback - INFO - Completed processing callback for node 69dedc0af490930782fb6e65 INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:00:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:06,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:00:15,397 - lava_callback - INFO - Received callback for node 69dc400f5dbfa74e32f97780 INFO: 172.21.0.1:47286 - "POST /node/69dc400f5dbfa74e32f97780 HTTP/1.0" 202 Accepted 2026-04-15 01:00:15,402 - lava_callback - INFO - Starting async job submit for node 69dc400f5dbfa74e32f97780 2026-04-15 01:00:15,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,421 - lava_callback - DEBUG - Processing node 69dc400f5dbfa74e32f97780: baseline-arm64-baylibre 2026-04-15 01:00:15,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc400f5dbfa74e32f97780 2026-04-15 01:00:15,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:00:15,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,476 - lava_callback - ERROR - Error processing callback for node 69dc400f5dbfa74e32f97780: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /node/693b870441fb4c9509766844%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:01:35,434 - lava_callback - INFO - Received callback for node 69dc40615dbfa74e32f9783c INFO: 172.21.0.1:46550 - "POST /node/69dc40615dbfa74e32f9783c HTTP/1.0" 202 Accepted 2026-04-15 01:01:35,440 - lava_callback - INFO - Starting async job submit for node 69dc40615dbfa74e32f9783c 2026-04-15 01:01:35,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,457 - lava_callback - DEBUG - Processing node 69dc40615dbfa74e32f9783c: baseline-arm64-baylibre 2026-04-15 01:01:35,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40615dbfa74e32f9783c 2026-04-15 01:01:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:01:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,505 - lava_callback - ERROR - Error processing callback for node 69dc40615dbfa74e32f9783c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /node/6988c58d9fc35f969e1eead6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:02:55,548 - lava_callback - INFO - Received callback for node 69dc40ae5dbfa74e32f97871 INFO: 172.21.0.1:44592 - "POST /node/69dc40ae5dbfa74e32f97871 HTTP/1.0" 202 Accepted 2026-04-15 01:02:55,554 - lava_callback - INFO - Starting async job submit for node 69dc40ae5dbfa74e32f97871 2026-04-15 01:02:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,570 - lava_callback - DEBUG - Processing node 69dc40ae5dbfa74e32f97871: baseline-arm64-baylibre 2026-04-15 01:02:55,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40ae5dbfa74e32f97871 2026-04-15 01:02:55,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:02:55,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,620 - lava_callback - ERROR - Error processing callback for node 69dc40ae5dbfa74e32f97871: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET /node/695405a99c6929bd9fb6f540%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:04:08,117 - lava_callback - INFO - Received callback for node 69dc40fc5dbfa74e32f978bd INFO: 172.21.0.1:60612 - "POST /node/69dc40fc5dbfa74e32f978bd HTTP/1.0" 202 Accepted 2026-04-15 01:04:08,123 - lava_callback - INFO - Starting async job submit for node 69dc40fc5dbfa74e32f978bd 2026-04-15 01:04:08,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,139 - lava_callback - DEBUG - Processing node 69dc40fc5dbfa74e32f978bd: baseline-arm64-clabbe 2026-04-15 01:04:08,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40fc5dbfa74e32f978bd 2026-04-15 01:04:08,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:04:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,188 - lava_callback - ERROR - Error processing callback for node 69dc40fc5dbfa74e32f978bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:04:47,184 - lava_callback - INFO - Received callback for node 69dee344f490930782fb9e37 INFO: 172.21.0.1:48954 - "POST /node/69dee344f490930782fb9e37 HTTP/1.0" 202 Accepted 2026-04-15 01:04:47,190 - lava_callback - INFO - Starting async job submit for node 69dee344f490930782fb9e37 2026-04-15 01:04:47,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:47,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:47,231 - lava_callback - DEBUG - Processing node 69dee344f490930782fb9e37: ltp-cap_bounds 2026-04-15 01:04:47,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:47,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:47,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/log.txt.gz 2026-04-15 01:04:47,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:48,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:48,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/lava-logs.yaml 2026-04-15 01:04:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:48,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:48,324 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/lava_callback.json.gz 2026-04-15 01:04:48,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:48,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:04:48,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:48,415 - lava_callback - INFO - Completed processing callback for node 69dee344f490930782fb9e37 INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:06,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:06,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:08,126 - lava_callback - INFO - Received callback for node 69dc41415dbfa74e32f9790c INFO: 172.21.0.1:60640 - "POST /node/69dc41415dbfa74e32f9790c HTTP/1.0" 202 Accepted 2026-04-15 01:05:08,132 - lava_callback - INFO - Starting async job submit for node 69dc41415dbfa74e32f9790c 2026-04-15 01:05:08,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,148 - lava_callback - DEBUG - Processing node 69dc41415dbfa74e32f9790c: baseline-arm64-clabbe 2026-04-15 01:05:08,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41415dbfa74e32f9790c 2026-04-15 01:05:08,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:05:08,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,197 - lava_callback - ERROR - Error processing callback for node 69dc41415dbfa74e32f9790c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET /node/698638c2177ca0f097bd2c2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:26,510 - lava_callback - INFO - Received callback for node 69dee361f490930782fb9e49 INFO: 172.21.0.1:53012 - "POST /node/69dee361f490930782fb9e49 HTTP/1.0" 202 Accepted 2026-04-15 01:05:26,516 - lava_callback - INFO - Starting async job submit for node 69dee361f490930782fb9e49 2026-04-15 01:05:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:26,557 - lava_callback - DEBUG - Processing node 69dee361f490930782fb9e49: ltp-containers INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:26,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/log.txt.gz 2026-04-15 01:05:27,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/lava-logs.yaml 2026-04-15 01:05:27,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/lava_callback.json.gz 2026-04-15 01:05:27,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:27,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:27,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:27,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:05:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:28,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:28,017 - lava_callback - INFO - Completed processing callback for node 69dee361f490930782fb9e49 INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:36,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:36,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32906 - "GET /node/698bd97c1e517752bab8b685%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:26,543 - lava_callback - INFO - Received callback for node 69dee3aaf490930782fb9eaa INFO: 172.21.0.1:52346 - "POST /node/69dee3aaf490930782fb9eaa HTTP/1.0" 202 Accepted 2026-04-15 01:06:26,550 - lava_callback - INFO - Starting async job submit for node 69dee3aaf490930782fb9eaa INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:26,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:26,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:26,596 - lava_callback - DEBUG - Processing node 69dee3aaf490930782fb9eaa: ltp-input 2026-04-15 01:06:26,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/log.txt.gz 2026-04-15 01:06:27,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/lava-logs.yaml 2026-04-15 01:06:27,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/lava_callback.json.gz 2026-04-15 01:06:27,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:06:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:27,797 - lava_callback - INFO - Completed processing callback for node 69dee3aaf490930782fb9eaa 2026-04-15 01:06:28,398 - lava_callback - INFO - Received callback for node 69dc41885dbfa74e32f97963 INFO: 172.21.0.1:52370 - "POST /node/69dc41885dbfa74e32f97963 HTTP/1.0" 202 Accepted 2026-04-15 01:06:28,404 - lava_callback - INFO - Starting async job submit for node 69dc41885dbfa74e32f97963 2026-04-15 01:06:28,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,420 - lava_callback - DEBUG - Processing node 69dc41885dbfa74e32f97963: baseline-arm64-clabbe 2026-04-15 01:06:28,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41885dbfa74e32f97963 2026-04-15 01:06:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:06:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,477 - lava_callback - ERROR - Error processing callback for node 69dc41885dbfa74e32f97963: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:36,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:36,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:07:28,233 - lava_callback - INFO - Received callback for node 69dc41c65dbfa74e32f979c6 INFO: 172.21.0.1:37242 - "POST /node/69dc41c65dbfa74e32f979c6 HTTP/1.0" 202 Accepted 2026-04-15 01:07:28,239 - lava_callback - INFO - Starting async job submit for node 69dc41c65dbfa74e32f979c6 2026-04-15 01:07:28,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,255 - lava_callback - DEBUG - Processing node 69dc41c65dbfa74e32f979c6: baseline-arm64-clabbe 2026-04-15 01:07:28,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41c65dbfa74e32f979c6 2026-04-15 01:07:28,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:07:28,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,329 - lava_callback - ERROR - Error processing callback for node 69dc41c65dbfa74e32f979c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:07:46,629 - lava_callback - INFO - Received callback for node 69dee3cff490930782fb9ec0 INFO: 172.21.0.1:59680 - "POST /node/69dee3cff490930782fb9ec0 HTTP/1.0" 202 Accepted 2026-04-15 01:07:46,635 - lava_callback - INFO - Starting async job submit for node 69dee3cff490930782fb9ec0 2026-04-15 01:07:46,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:46,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:46,676 - lava_callback - DEBUG - Processing node 69dee3cff490930782fb9ec0: ltp-pty 2026-04-15 01:07:47,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/log.txt.gz 2026-04-15 01:07:47,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/lava-logs.yaml 2026-04-15 01:07:47,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/lava_callback.json.gz 2026-04-15 01:07:47,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:47,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:07:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:47,922 - lava_callback - INFO - Completed processing callback for node 69dee3cff490930782fb9ec0 INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:08:06,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET /node/698fe75876d4b6342e9d9eb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:08:48,366 - lava_callback - INFO - Received callback for node 69dc420b5dbfa74e32f97a0f INFO: 172.21.0.1:39062 - "POST /node/69dc420b5dbfa74e32f97a0f HTTP/1.0" 202 Accepted 2026-04-15 01:08:48,372 - lava_callback - INFO - Starting async job submit for node 69dc420b5dbfa74e32f97a0f 2026-04-15 01:08:48,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,388 - lava_callback - DEBUG - Processing node 69dc420b5dbfa74e32f97a0f: baseline-arm64-clabbe 2026-04-15 01:08:48,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc420b5dbfa74e32f97a0f 2026-04-15 01:08:48,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:08:48,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,437 - lava_callback - ERROR - Error processing callback for node 69dc420b5dbfa74e32f97a0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 01:08:50,225 - lava_callback - INFO - Received callback for node 69dee51af490930782fba040 INFO: 172.21.0.1:53710 - "POST /node/69dee51af490930782fba040 HTTP/1.0" 202 Accepted 2026-04-15 01:08:50,231 - lava_callback - INFO - Starting async job submit for node 69dee51af490930782fba040 2026-04-15 01:08:50,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,249 - lava_callback - DEBUG - Processing node 69dee51af490930782fba040: baseline-arm 2026-04-15 01:08:50,254 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:08:50,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:08:50,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:08:50,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee51af490930782fba040/lava-logs.yaml 2026-04-15 01:08:50,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:08:50,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:08:50,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee51af490930782fba040/lava_callback.json.gz 2026-04-15 01:08:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:08:50,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,645 - lava_callback - INFO - Completed processing callback for node 69dee51af490930782fba040 INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:09:06,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:06,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:09:48,323 - lava_callback - INFO - Received callback for node 69dc42565dbfa74e32f97a3d INFO: 172.21.0.1:37956 - "POST /node/69dc42565dbfa74e32f97a3d HTTP/1.0" 202 Accepted 2026-04-15 01:09:48,329 - lava_callback - INFO - Starting async job submit for node 69dc42565dbfa74e32f97a3d 2026-04-15 01:09:48,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,345 - lava_callback - DEBUG - Processing node 69dc42565dbfa74e32f97a3d: baseline-arm64-clabbe 2026-04-15 01:09:48,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc42565dbfa74e32f97a3d 2026-04-15 01:09:48,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:09:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,401 - lava_callback - ERROR - Error processing callback for node 69dc42565dbfa74e32f97a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /node/6986171c177ca0f097bd099e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:11:08,383 - lava_callback - INFO - Received callback for node 69dc42a05dbfa74e32f97a73 INFO: 172.21.0.1:32958 - "POST /node/69dc42a05dbfa74e32f97a73 HTTP/1.0" 202 Accepted 2026-04-15 01:11:08,389 - lava_callback - INFO - Starting async job submit for node 69dc42a05dbfa74e32f97a73 2026-04-15 01:11:08,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,405 - lava_callback - DEBUG - Processing node 69dc42a05dbfa74e32f97a73: baseline-arm64-clabbe 2026-04-15 01:11:08,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc42a05dbfa74e32f97a73 2026-04-15 01:11:08,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:11:08,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,454 - lava_callback - ERROR - Error processing callback for node 69dc42a05dbfa74e32f97a73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET /node/698b677b0a16aea5a0dc75a2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET /node/6987d593e31b58f834f1d3eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET /node/68535c9ad1c4bfd0940eefcf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:22:51,848 - lava_callback - INFO - Received callback for node 69dee83df490930782fba363 INFO: 172.21.0.1:43080 - "POST /node/69dee83df490930782fba363 HTTP/1.0" 202 Accepted 2026-04-15 01:22:51,855 - lava_callback - INFO - Starting async job submit for node 69dee83df490930782fba363 2026-04-15 01:22:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:51,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:51,891 - lava_callback - DEBUG - Processing node 69dee83df490930782fba363: baseline-arm64 2026-04-15 01:22:52,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/log.txt.gz 2026-04-15 01:22:52,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/lava-logs.yaml 2026-04-15 01:22:52,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/lava_callback.json.gz 2026-04-15 01:22:52,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:52,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:52,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:52,854 - lava_callback - INFO - Completed processing callback for node 69dee83df490930782fba363 2026-04-15 01:22:54,198 - lava_callback - INFO - Received callback for node 69dee84bf490930782fba384 INFO: 172.21.0.1:43096 - "POST /node/69dee84bf490930782fba384 HTTP/1.0" 202 Accepted 2026-04-15 01:22:54,210 - lava_callback - INFO - Starting async job submit for node 69dee84bf490930782fba384 2026-04-15 01:22:54,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:54,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:54,268 - lava_callback - DEBUG - Processing node 69dee84bf490930782fba384: baseline-arm64 2026-04-15 01:22:54,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:54,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:54,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/log.txt.gz 2026-04-15 01:22:54,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:54,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:54,818 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/lava-logs.yaml 2026-04-15 01:22:54,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:55,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:55,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/lava_callback.json.gz 2026-04-15 01:22:55,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:55,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:55,106 - lava_callback - INFO - Completed processing callback for node 69dee84bf490930782fba384 INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:22:58,027 - lava_callback - INFO - Received callback for node 69dee85bf490930782fba3c1 INFO: 172.21.0.1:43108 - "POST /node/69dee85bf490930782fba3c1 HTTP/1.0" 202 Accepted 2026-04-15 01:22:58,033 - lava_callback - INFO - Starting async job submit for node 69dee85bf490930782fba3c1 2026-04-15 01:22:58,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,052 - lava_callback - DEBUG - Processing node 69dee85bf490930782fba3c1: baseline-nfs-arm64 2026-04-15 01:22:58,054 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:22:58,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:58,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:58,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85bf490930782fba3c1/lava-logs.yaml 2026-04-15 01:22:58,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:58,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:58,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85bf490930782fba3c1/lava_callback.json.gz 2026-04-15 01:22:58,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,424 - lava_callback - INFO - Completed processing callback for node 69dee85bf490930782fba3c1 INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:06,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:06,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:23:15,519 - lava_callback - INFO - Received callback for node 69dee840f490930782fba369 INFO: 172.21.0.1:53454 - "POST /node/69dee840f490930782fba369 HTTP/1.0" 202 Accepted 2026-04-15 01:23:15,525 - lava_callback - INFO - Starting async job submit for node 69dee840f490930782fba369 2026-04-15 01:23:15,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:15,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:15,568 - lava_callback - DEBUG - Processing node 69dee840f490930782fba369: baseline-arm64 2026-04-15 01:23:15,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/log.txt.gz 2026-04-15 01:23:16,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/lava-logs.yaml 2026-04-15 01:23:16,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/lava_callback.json.gz INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:16,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:16,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:16,616 - lava_callback - INFO - Completed processing callback for node 69dee840f490930782fba369 INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:28,348 - lava_callback - INFO - Received callback for node 69dee84ff490930782fba38d INFO: 172.21.0.1:57344 - "POST /node/69dee84ff490930782fba38d HTTP/1.0" 202 Accepted 2026-04-15 01:23:28,354 - lava_callback - INFO - Starting async job submit for node 69dee84ff490930782fba38d 2026-04-15 01:23:28,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:28,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:28,392 - lava_callback - DEBUG - Processing node 69dee84ff490930782fba38d: baseline-arm64 2026-04-15 01:23:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:28,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:28,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/log.txt.gz 2026-04-15 01:23:29,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:29,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:29,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/lava-logs.yaml 2026-04-15 01:23:29,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:29,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:29,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/lava_callback.json.gz 2026-04-15 01:23:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:29,523 - lava_callback - INFO - Completed processing callback for node 69dee84ff490930782fba38d 2026-04-15 01:23:31,050 - lava_callback - INFO - Received callback for node 69dee842f490930782fba36f INFO: 172.21.0.1:56302 - "POST /node/69dee842f490930782fba36f HTTP/1.0" 202 Accepted 2026-04-15 01:23:31,061 - lava_callback - INFO - Starting async job submit for node 69dee842f490930782fba36f 2026-04-15 01:23:31,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,137 - lava_callback - DEBUG - Processing node 69dee842f490930782fba36f: baseline-arm64 2026-04-15 01:23:31,301 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:23:31,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:31,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:31,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee842f490930782fba36f/lava-logs.yaml 2026-04-15 01:23:31,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:31,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:31,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee842f490930782fba36f/lava_callback.json.gz 2026-04-15 01:23:31,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:31,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,879 - lava_callback - INFO - Completed processing callback for node 69dee842f490930782fba36f 2026-04-15 01:23:35,047 - lava_callback - INFO - Received callback for node 69dee849f490930782fba37e INFO: 172.21.0.1:56304 - "POST /node/69dee849f490930782fba37e HTTP/1.0" 202 Accepted 2026-04-15 01:23:35,055 - lava_callback - INFO - Starting async job submit for node 69dee849f490930782fba37e 2026-04-15 01:23:35,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:35,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:35,108 - lava_callback - DEBUG - Processing node 69dee849f490930782fba37e: baseline-arm64 2026-04-15 01:23:35,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:35,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:35,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/log.txt.gz 2026-04-15 01:23:35,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:36,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:36,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/lava-logs.yaml 2026-04-15 01:23:36,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:36,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:36,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/lava_callback.json.gz 2026-04-15 01:23:36,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:36,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:36,279 - lava_callback - INFO - Completed processing callback for node 69dee849f490930782fba37e INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:36,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:23:38,989 - lava_callback - INFO - Received callback for node 69dee851f490930782fba390 INFO: 172.21.0.1:56328 - "POST /node/69dee851f490930782fba390 HTTP/1.0" 202 Accepted 2026-04-15 01:23:38,996 - lava_callback - INFO - Starting async job submit for node 69dee851f490930782fba390 2026-04-15 01:23:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:39,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:39,049 - lava_callback - DEBUG - Processing node 69dee851f490930782fba390: baseline-arm64 2026-04-15 01:23:39,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:39,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:39,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/log.txt.gz 2026-04-15 01:23:39,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:39,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:39,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/lava-logs.yaml 2026-04-15 01:23:39,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:40,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:40,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/lava_callback.json.gz 2026-04-15 01:23:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:40,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:40,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:40,133 - lava_callback - INFO - Completed processing callback for node 69dee851f490930782fba390 2026-04-15 01:23:41,416 - lava_callback - INFO - Received callback for node 69dee83ff490930782fba366 INFO: 172.21.0.1:47518 - "POST /node/69dee83ff490930782fba366 HTTP/1.0" 202 Accepted 2026-04-15 01:23:41,422 - lava_callback - INFO - Starting async job submit for node 69dee83ff490930782fba366 2026-04-15 01:23:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:41,459 - lava_callback - DEBUG - Processing node 69dee83ff490930782fba366: baseline-arm64 2026-04-15 01:23:41,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:41,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:41,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/log.txt.gz 2026-04-15 01:23:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:42,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:42,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/lava-logs.yaml 2026-04-15 01:23:42,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:42,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:42,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/lava_callback.json.gz 2026-04-15 01:23:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:42,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:42,319 - lava_callback - INFO - Completed processing callback for node 69dee83ff490930782fba366 INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:47,758 - lava_callback - INFO - Received callback for node 69dee84cf490930782fba387 INFO: 172.21.0.1:47526 - "POST /node/69dee84cf490930782fba387 HTTP/1.0" 202 Accepted 2026-04-15 01:23:47,764 - lava_callback - INFO - Starting async job submit for node 69dee84cf490930782fba387 2026-04-15 01:23:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:47,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:47,823 - lava_callback - DEBUG - Processing node 69dee84cf490930782fba387: baseline-arm64 2026-04-15 01:23:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/log.txt.gz 2026-04-15 01:23:48,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/lava-logs.yaml 2026-04-15 01:23:48,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/lava_callback.json.gz 2026-04-15 01:23:48,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:48,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:48,939 - lava_callback - INFO - Completed processing callback for node 69dee84cf490930782fba387 2026-04-15 01:23:55,885 - lava_callback - INFO - Received callback for node 69dee848f490930782fba37b INFO: 172.21.0.1:51806 - "POST /node/69dee848f490930782fba37b HTTP/1.0" 202 Accepted 2026-04-15 01:23:55,891 - lava_callback - INFO - Starting async job submit for node 69dee848f490930782fba37b 2026-04-15 01:23:55,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:55,928 - lava_callback - DEBUG - Processing node 69dee848f490930782fba37b: baseline-arm64 2026-04-15 01:23:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:56,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:56,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/log.txt.gz INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:56,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:56,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:56,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/lava-logs.yaml 2026-04-15 01:23:56,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:57,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:57,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/lava_callback.json.gz 2026-04-15 01:23:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:57,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:57,097 - lava_callback - INFO - Completed processing callback for node 69dee848f490930782fba37b 2026-04-15 01:24:05,586 - lava_callback - INFO - Received callback for node 69dee85af490930782fba3be INFO: 172.21.0.1:58732 - "POST /node/69dee85af490930782fba3be HTTP/1.0" 202 Accepted 2026-04-15 01:24:05,598 - lava_callback - INFO - Starting async job submit for node 69dee85af490930782fba3be 2026-04-15 01:24:05,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:05,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:05,667 - lava_callback - DEBUG - Processing node 69dee85af490930782fba3be: baseline-nfs-arm64 2026-04-15 01:24:06,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:06,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:06,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/log.txt.gz INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:06,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:06,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:06,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:24:06,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:06,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/lava-logs.yaml 2026-04-15 01:24:06,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:07,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:07,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/lava_callback.json.gz 2026-04-15 01:24:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:07,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:07,086 - lava_callback - INFO - Completed processing callback for node 69dee85af490930782fba3be INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:08,657 - lava_callback - INFO - Received callback for node 69dee858f490930782fba3bb INFO: 172.21.0.1:58764 - "POST /node/69dee858f490930782fba3bb HTTP/1.0" 202 Accepted 2026-04-15 01:24:08,664 - lava_callback - INFO - Starting async job submit for node 69dee858f490930782fba3bb 2026-04-15 01:24:08,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:08,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:08,704 - lava_callback - DEBUG - Processing node 69dee858f490930782fba3bb: baseline-nfs-arm64 2026-04-15 01:24:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:09,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:09,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/log.txt.gz 2026-04-15 01:24:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:09,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:09,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/lava-logs.yaml 2026-04-15 01:24:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:10,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:10,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/lava_callback.json.gz 2026-04-15 01:24:10,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:10,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:10,165 - lava_callback - INFO - Completed processing callback for node 69dee858f490930782fba3bb 2026-04-15 01:24:10,713 - lava_callback - INFO - Received callback for node 69dee846f490930782fba378 INFO: 172.21.0.1:33088 - "POST /node/69dee846f490930782fba378 HTTP/1.0" 202 Accepted 2026-04-15 01:24:10,722 - lava_callback - INFO - Starting async job submit for node 69dee846f490930782fba378 2026-04-15 01:24:10,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:10,759 - lava_callback - DEBUG - Processing node 69dee846f490930782fba378: baseline-arm64 2026-04-15 01:24:11,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/log.txt.gz 2026-04-15 01:24:11,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/lava-logs.yaml 2026-04-15 01:24:11,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/lava_callback.json.gz 2026-04-15 01:24:11,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:11,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:11,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:11,744 - lava_callback - INFO - Completed processing callback for node 69dee846f490930782fba378 INFO: 172.21.0.1:33090 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:24:15,589 - lava_callback - INFO - Received callback for node 69dee84af490930782fba381 INFO: 172.21.0.1:33094 - "POST /node/69dee84af490930782fba381 HTTP/1.0" 202 Accepted 2026-04-15 01:24:15,601 - lava_callback - INFO - Starting async job submit for node 69dee84af490930782fba381 2026-04-15 01:24:15,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:15,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:15,654 - lava_callback - DEBUG - Processing node 69dee84af490930782fba381: baseline-arm64 2026-04-15 01:24:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:16,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:16,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/log.txt.gz 2026-04-15 01:24:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:17,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:17,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/lava-logs.yaml 2026-04-15 01:24:17,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:17,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:17,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/lava_callback.json.gz 2026-04-15 01:24:17,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:17,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:17,637 - lava_callback - INFO - Completed processing callback for node 69dee84af490930782fba381 INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:27,634 - lava_callback - INFO - Received callback for node 69dee85ff490930782fba3ca INFO: 172.21.0.1:58792 - "POST /node/69dee85ff490930782fba3ca HTTP/1.0" 202 Accepted 2026-04-15 01:24:27,645 - lava_callback - INFO - Starting async job submit for node 69dee85ff490930782fba3ca 2026-04-15 01:24:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:27,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:27,717 - lava_callback - DEBUG - Processing node 69dee85ff490930782fba3ca: baseline-nfs-arm64 2026-04-15 01:24:28,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:28,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:28,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/log.txt.gz 2026-04-15 01:24:29,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:29,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:29,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/lava-logs.yaml 2026-04-15 01:24:29,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:29,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:29,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/lava_callback.json.gz 2026-04-15 01:24:29,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:29,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:29,830 - lava_callback - INFO - Completed processing callback for node 69dee85ff490930782fba3ca INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:36,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:24:45,085 - lava_callback - INFO - Received callback for node 69dee860f490930782fba3cd INFO: 172.21.0.1:51796 - "POST /node/69dee860f490930782fba3cd HTTP/1.0" 202 Accepted 2026-04-15 01:24:45,096 - lava_callback - INFO - Starting async job submit for node 69dee860f490930782fba3cd 2026-04-15 01:24:45,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:45,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:45,146 - lava_callback - DEBUG - Processing node 69dee860f490930782fba3cd: baseline-nfs-arm64 2026-04-15 01:24:45,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:46,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:46,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/log.txt.gz 2026-04-15 01:24:46,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:46,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:46,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/lava-logs.yaml 2026-04-15 01:24:46,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:47,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:47,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/lava_callback.json.gz 2026-04-15 01:24:47,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:47,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,122 - lava_callback - INFO - Received callback for node 69dee870f490930782fba423 INFO: 172.21.0.1:51806 - "POST /node/69dee870f490930782fba423 HTTP/1.0" 202 Accepted 2026-04-15 01:24:47,131 - lava_callback - INFO - Starting async job submit for node 69dee870f490930782fba423 2026-04-15 01:24:47,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:47,177 - lava_callback - INFO - Completed processing callback for node 69dee860f490930782fba3cd 2026-04-15 01:24:47,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:47,255 - lava_callback - DEBUG - Processing node 69dee870f490930782fba423: baseline-arm64-broonie 2026-04-15 01:24:47,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:47,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:47,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/log.txt.gz 2026-04-15 01:24:48,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,198 - lava_callback - INFO - Received callback for node 69dee874f490930782fba42e INFO: 172.21.0.1:51820 - "POST /node/69dee874f490930782fba42e HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,213 - lava_callback - INFO - Starting async job submit for node 69dee874f490930782fba42e 2026-04-15 01:24:48,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:48,314 - lava_callback - DEBUG - Processing node 69dee874f490930782fba42e: baseline-arm64-broonie 2026-04-15 01:24:48,548 - lava_callback - INFO - Received callback for node 69dee8abf490930782fba49a 2026-04-15 01:24:48,570 - lava_callback - INFO - Starting async job submit for node 69dee8abf490930782fba49a INFO: 172.21.0.1:51828 - "POST /node/69dee8abf490930782fba49a HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,608 - lava_callback - INFO - Received callback for node 69dee872f490930782fba426 2026-04-15 01:24:48,630 - lava_callback - INFO - Starting async job submit for node 69dee872f490930782fba426 INFO: 172.21.0.1:51830 - "POST /node/69dee872f490930782fba426 HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:48,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/lava-logs.yaml 2026-04-15 01:24:48,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:48,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:48,812 - lava_callback - DEBUG - Processing node 69dee872f490930782fba426: baseline-arm64-broonie 2026-04-15 01:24:48,818 - lava_callback - DEBUG - Processing node 69dee8abf490930782fba49a: baseline-arm64-kontron 2026-04-15 01:24:49,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:49,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/log.txt.gz 2026-04-15 01:24:49,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:49,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/lava_callback.json.gz 2026-04-15 01:24:49,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:49,803 - lava_callback - INFO - Received callback for node 69dee8acf490930782fba4c0 2026-04-15 01:24:49,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,851 - lava_callback - INFO - Starting async job submit for node 69dee8acf490930782fba4c0 INFO: 172.21.0.1:44600 - "POST /node/69dee8acf490930782fba4c0 HTTP/1.0" 202 Accepted 2026-04-15 01:24:49,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:49,962 - lava_callback - INFO - Completed processing callback for node 69dee870f490930782fba423 2026-04-15 01:24:49,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:49,970 - lava_callback - DEBUG - Processing node 69dee8acf490930782fba4c0: baseline-arm64-kontron 2026-04-15 01:24:50,103 - lava_callback - INFO - Received callback for node 69dee878f490930782fba434 INFO: 172.21.0.1:44608 - "POST /node/69dee878f490930782fba434 HTTP/1.0" 202 Accepted 2026-04-15 01:24:50,145 - lava_callback - INFO - Starting async job submit for node 69dee878f490930782fba434 2026-04-15 01:24:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:50,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:50,269 - lava_callback - DEBUG - Processing node 69dee878f490930782fba434: baseline-arm64-broonie 2026-04-15 01:24:50,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/log.txt.gz 2026-04-15 01:24:50,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/log.txt.gz 2026-04-15 01:24:50,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/lava-logs.yaml 2026-04-15 01:24:51,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:51,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/lava_callback.json.gz 2026-04-15 01:24:51,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:51,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/log.txt.gz 2026-04-15 01:24:51,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:51,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:51,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:52,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:52,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:52,095 - lava_callback - INFO - Completed processing callback for node 69dee874f490930782fba42e 2026-04-15 01:24:52,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/lava-logs.yaml 2026-04-15 01:24:52,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/log.txt.gz 2026-04-15 01:24:52,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/lava-logs.yaml 2026-04-15 01:24:52,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/lava-logs.yaml 2026-04-15 01:24:53,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/lava_callback.json.gz 2026-04-15 01:24:53,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:53,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:53,212 - lava_callback - INFO - Completed processing callback for node 69dee872f490930782fba426 2026-04-15 01:24:53,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/lava_callback.json.gz 2026-04-15 01:24:53,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:53,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/lava_callback.json.gz 2026-04-15 01:24:53,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:53,796 - lava_callback - INFO - Received callback for node 69dee844f490930782fba372 2026-04-15 01:24:53,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44612 - "POST /node/69dee844f490930782fba372 HTTP/1.0" 202 Accepted 2026-04-15 01:24:53,833 - lava_callback - INFO - Starting async job submit for node 69dee844f490930782fba372 2026-04-15 01:24:53,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/lava-logs.yaml 2026-04-15 01:24:53,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:53,920 - lava_callback - INFO - Completed processing callback for node 69dee8abf490930782fba49a 2026-04-15 01:24:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:53,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:53,971 - lava_callback - DEBUG - Processing node 69dee844f490930782fba372: baseline-arm64 2026-04-15 01:24:54,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:54,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:54,143 - lava_callback - INFO - Completed processing callback for node 69dee8acf490930782fba4c0 2026-04-15 01:24:54,536 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:24:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:54,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:54,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/lava_callback.json.gz 2026-04-15 01:24:54,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:54,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:54,888 - lava_callback - INFO - Completed processing callback for node 69dee878f490930782fba434 2026-04-15 01:24:55,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:55,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee844f490930782fba372/lava-logs.yaml 2026-04-15 01:24:55,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:55,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:55,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee844f490930782fba372/lava_callback.json.gz 2026-04-15 01:24:55,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:55,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:55,429 - lava_callback - INFO - Completed processing callback for node 69dee844f490930782fba372 INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:01,001 - lava_callback - INFO - Received callback for node 69dee8adf490930782fba4c7 INFO: 172.21.0.1:49866 - "POST /node/69dee8adf490930782fba4c7 HTTP/1.0" 202 Accepted 2026-04-15 01:25:01,007 - lava_callback - INFO - Starting async job submit for node 69dee8adf490930782fba4c7 2026-04-15 01:25:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:01,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:01,044 - lava_callback - DEBUG - Processing node 69dee8adf490930782fba4c7: baseline-arm64-pengutronix 2026-04-15 01:25:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:01,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:01,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/log.txt.gz 2026-04-15 01:25:01,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:02,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:02,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/lava-logs.yaml 2026-04-15 01:25:02,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:02,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:02,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/lava_callback.json.gz 2026-04-15 01:25:02,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:02,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:02,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:02,414 - lava_callback - INFO - Completed processing callback for node 69dee8adf490930782fba4c7 INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:06,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:25:07,117 - lava_callback - INFO - Received callback for node 69dee876f490930782fba431 INFO: 172.21.0.1:49894 - "POST /node/69dee876f490930782fba431 HTTP/1.0" 202 Accepted 2026-04-15 01:25:07,124 - lava_callback - INFO - Starting async job submit for node 69dee876f490930782fba431 2026-04-15 01:25:07,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:07,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:07,169 - lava_callback - DEBUG - Processing node 69dee876f490930782fba431: baseline-arm64-broonie 2026-04-15 01:25:07,321 - lava_callback - INFO - Received callback for node 69dee879f490930782fba437 INFO: 172.21.0.1:49898 - "POST /node/69dee879f490930782fba437 HTTP/1.0" 202 Accepted 2026-04-15 01:25:07,336 - lava_callback - INFO - Starting async job submit for node 69dee879f490930782fba437 2026-04-15 01:25:07,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:07,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:07,491 - lava_callback - DEBUG - Processing node 69dee879f490930782fba437: baseline-arm64-broonie 2026-04-15 01:25:07,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:08,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/log.txt.gz 2026-04-15 01:25:08,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:08,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/log.txt.gz 2026-04-15 01:25:08,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/lava-logs.yaml 2026-04-15 01:25:09,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/lava-logs.yaml 2026-04-15 01:25:09,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/lava_callback.json.gz 2026-04-15 01:25:09,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/lava_callback.json.gz 2026-04-15 01:25:09,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:09,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:09,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:09,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:09,513 - lava_callback - INFO - Completed processing callback for node 69dee876f490930782fba431 2026-04-15 01:25:09,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:09,557 - lava_callback - INFO - Completed processing callback for node 69dee879f490930782fba437 2026-04-15 01:25:09,859 - lava_callback - INFO - Received callback for node 69dee8b1f490930782fba4d0 INFO: 172.21.0.1:47550 - "POST /node/69dee8b1f490930782fba4d0 HTTP/1.0" 202 Accepted 2026-04-15 01:25:09,872 - lava_callback - INFO - Starting async job submit for node 69dee8b1f490930782fba4d0 2026-04-15 01:25:09,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:09,958 - lava_callback - DEBUG - Processing node 69dee8b1f490930782fba4d0: baseline-arm64-foundriesio 2026-04-15 01:25:10,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:10,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:10,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/log.txt.gz 2026-04-15 01:25:10,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:10,653 - lava_callback - INFO - Received callback for node 69dee8aef490930782fba4ca INFO: 172.21.0.1:47558 - "POST /node/69dee8aef490930782fba4ca HTTP/1.0" 202 Accepted 2026-04-15 01:25:10,670 - lava_callback - INFO - Starting async job submit for node 69dee8aef490930782fba4ca 2026-04-15 01:25:10,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:10,739 - lava_callback - DEBUG - Processing node 69dee8aef490930782fba4ca: baseline-arm64-pengutronix 2026-04-15 01:25:11,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/lava-logs.yaml 2026-04-15 01:25:11,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/log.txt.gz 2026-04-15 01:25:11,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/lava_callback.json.gz 2026-04-15 01:25:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:11,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:11,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:11,953 - lava_callback - INFO - Completed processing callback for node 69dee8b1f490930782fba4d0 2026-04-15 01:25:12,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:12,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/lava-logs.yaml 2026-04-15 01:25:12,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:12,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:12,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/lava_callback.json.gz 2026-04-15 01:25:12,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:12,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:12,585 - lava_callback - INFO - Completed processing callback for node 69dee8aef490930782fba4ca INFO: 172.21.0.1:47570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:18,492 - lava_callback - INFO - Received callback for node 69dee84ef490930782fba38a INFO: 172.21.0.1:47580 - "POST /node/69dee84ef490930782fba38a HTTP/1.0" 202 Accepted 2026-04-15 01:25:18,504 - lava_callback - INFO - Starting async job submit for node 69dee84ef490930782fba38a 2026-04-15 01:25:18,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:18,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:18,577 - lava_callback - DEBUG - Processing node 69dee84ef490930782fba38a: baseline-arm64 2026-04-15 01:25:18,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:18,998 - lava_callback - INFO - Received callback for node 69dee8b0f490930782fba4cd INFO: 172.21.0.1:47594 - "POST /node/69dee8b0f490930782fba4cd HTTP/1.0" 202 Accepted 2026-04-15 01:25:19,008 - lava_callback - INFO - Starting async job submit for node 69dee8b0f490930782fba4cd 2026-04-15 01:25:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:19,046 - lava_callback - DEBUG - Processing node 69dee8b0f490930782fba4cd: baseline-arm64-pengutronix 2026-04-15 01:25:19,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/log.txt.gz 2026-04-15 01:25:19,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/log.txt.gz 2026-04-15 01:25:19,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/lava-logs.yaml 2026-04-15 01:25:19,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:20,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/lava_callback.json.gz 2026-04-15 01:25:20,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/lava-logs.yaml 2026-04-15 01:25:20,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:20,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:20,495 - lava_callback - INFO - Completed processing callback for node 69dee84ef490930782fba38a 2026-04-15 01:25:20,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/lava_callback.json.gz 2026-04-15 01:25:20,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:20,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:20,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:20,749 - lava_callback - INFO - Completed processing callback for node 69dee8b0f490930782fba4cd INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:29,038 - lava_callback - INFO - Received callback for node 69dee86ef490930782fba3ed INFO: 172.21.0.1:42606 - "POST /node/69dee86ef490930782fba3ed HTTP/1.0" 202 Accepted 2026-04-15 01:25:29,048 - lava_callback - INFO - Starting async job submit for node 69dee86ef490930782fba3ed 2026-04-15 01:25:29,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:29,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:29,146 - lava_callback - DEBUG - Processing node 69dee86ef490930782fba3ed: baseline-arm64-broonie 2026-04-15 01:25:29,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:29,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:29,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/log.txt.gz 2026-04-15 01:25:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:30,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:30,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/lava-logs.yaml 2026-04-15 01:25:30,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:30,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:30,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/lava_callback.json.gz 2026-04-15 01:25:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:30,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:30,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:30,480 - lava_callback - INFO - Completed processing callback for node 69dee86ef490930782fba3ed INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:36,652 - lava_callback - INFO - Received callback for node 69dee85cf490930782fba3c4 INFO: 172.21.0.1:49682 - "POST /node/69dee85cf490930782fba3c4 HTTP/1.0" 202 Accepted 2026-04-15 01:25:36,659 - lava_callback - INFO - Starting async job submit for node 69dee85cf490930782fba3c4 2026-04-15 01:25:36,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:36,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:36,703 - lava_callback - DEBUG - Processing node 69dee85cf490930782fba3c4: baseline-nfs-arm64 2026-04-15 01:25:36,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:25:37,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:37,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:37,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/log.txt.gz 2026-04-15 01:25:37,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:38,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:38,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/lava-logs.yaml 2026-04-15 01:25:38,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:38,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:38,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/lava_callback.json.gz 2026-04-15 01:25:38,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:38,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:38,251 - lava_callback - INFO - Completed processing callback for node 69dee85cf490930782fba3c4 INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:07,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:30,101 - lava_callback - INFO - Received callback for node 69dee856f490930782fba3b5 INFO: 172.21.0.1:35574 - "POST /node/69dee856f490930782fba3b5 HTTP/1.0" 202 Accepted 2026-04-15 01:26:30,107 - lava_callback - INFO - Starting async job submit for node 69dee856f490930782fba3b5 2026-04-15 01:26:30,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:30,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:30,150 - lava_callback - DEBUG - Processing node 69dee856f490930782fba3b5: baseline-nfs-arm64 2026-04-15 01:26:30,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:30,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:30,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/log.txt.gz 2026-04-15 01:26:30,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:31,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:31,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/lava-logs.yaml 2026-04-15 01:26:31,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:31,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:31,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/lava_callback.json.gz 2026-04-15 01:26:31,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:26:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:31,521 - lava_callback - INFO - Completed processing callback for node 69dee856f490930782fba3b5 INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:37,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:37,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:49,601 - lava_callback - INFO - Received callback for node 69dee873f490930782fba42b INFO: 172.21.0.1:58270 - "POST /node/69dee873f490930782fba42b HTTP/1.0" 202 Accepted 2026-04-15 01:26:49,607 - lava_callback - INFO - Starting async job submit for node 69dee873f490930782fba42b 2026-04-15 01:26:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:49,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:49,656 - lava_callback - DEBUG - Processing node 69dee873f490930782fba42b: baseline-arm64-broonie 2026-04-15 01:26:49,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/log.txt.gz 2026-04-15 01:26:50,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/lava-logs.yaml 2026-04-15 01:26:50,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/lava_callback.json.gz 2026-04-15 01:26:50,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:50,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:26:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:50,654 - lava_callback - INFO - Completed processing callback for node 69dee873f490930782fba42b INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:07,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:09,593 - lava_callback - INFO - Received callback for node 69dee8b1f490930782fba4d3 INFO: 172.21.0.1:50492 - "POST /node/69dee8b1f490930782fba4d3 HTTP/1.0" 202 Accepted 2026-04-15 01:27:09,603 - lava_callback - INFO - Starting async job submit for node 69dee8b1f490930782fba4d3 2026-04-15 01:27:09,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:09,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:09,678 - lava_callback - DEBUG - Processing node 69dee8b1f490930782fba4d3: baseline-arm64-foundriesio 2026-04-15 01:27:10,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:10,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:10,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/log.txt.gz 2026-04-15 01:27:11,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:11,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:11,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/lava-logs.yaml 2026-04-15 01:27:11,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:11,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:11,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/lava_callback.json.gz DEBUG: 69dee8b1f490930782fba4d3 Transitting job node result: pass -> incomplete 2026-04-15 01:27:11,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:11,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:27:11,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:11,570 - lava_callback - INFO - Completed processing callback for node 69dee8b1f490930782fba4d3 INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:37,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:37,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:25,499 - lava_callback - INFO - Received callback for node 69dee5dcf490930782fba0f1 INFO: 172.21.0.1:52624 - "POST /node/69dee5dcf490930782fba0f1 HTTP/1.0" 202 Accepted 2026-04-15 01:29:25,506 - lava_callback - INFO - Starting async job submit for node 69dee5dcf490930782fba0f1 2026-04-15 01:29:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:25,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:25,576 - lava_callback - DEBUG - Processing node 69dee5dcf490930782fba0f1: baseline-arm 2026-04-15 01:29:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:26,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:26,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/log.txt.gz INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:26,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:26,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:26,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/lava-logs.yaml 2026-04-15 01:29:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:27,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:27,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/lava_callback.json.gz DEBUG: Setup failed for 69dee5dcf490930782fba0f1. Transitting job node result: incomplete -> fail 2026-04-15 01:29:27,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:27,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:29:27,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:27,468 - lava_callback - INFO - Completed processing callback for node 69dee5dcf490930782fba0f1 INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:37,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:37,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:30:02,332 - lava_callback - INFO - Received callback for node 69dee852f490930782fba3ac INFO: 172.21.0.1:53566 - "POST /node/69dee852f490930782fba3ac HTTP/1.0" 202 Accepted 2026-04-15 01:30:02,340 - lava_callback - INFO - Starting async job submit for node 69dee852f490930782fba3ac 2026-04-15 01:30:02,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:02,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:02,394 - lava_callback - DEBUG - Processing node 69dee852f490930782fba3ac: baseline-arm64 2026-04-15 01:30:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/log.txt.gz 2026-04-15 01:30:03,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/lava-logs.yaml 2026-04-15 01:30:03,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/lava_callback.json.gz DEBUG: Setup failed for 69dee852f490930782fba3ac. Transitting job node result: incomplete -> fail 2026-04-15 01:30:03,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:03,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:30:03,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:03,906 - lava_callback - INFO - Completed processing callback for node 69dee852f490930782fba3ac INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:30:07,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:32:12,222 - lava_callback - INFO - Received callback for node 69dee5d8f490930782fba0e8 INFO: 172.21.0.1:51644 - "POST /node/69dee5d8f490930782fba0e8 HTTP/1.0" 202 Accepted 2026-04-15 01:32:12,228 - lava_callback - INFO - Starting async job submit for node 69dee5d8f490930782fba0e8 2026-04-15 01:32:12,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:12,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:12,282 - lava_callback - DEBUG - Processing node 69dee5d8f490930782fba0e8: baseline-x86 2026-04-15 01:32:12,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/log.txt.gz 2026-04-15 01:32:13,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,560 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/lava-logs.yaml 2026-04-15 01:32:13,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/lava_callback.json.gz DEBUG: Setup failed for 69dee5d8f490930782fba0e8. Transitting job node result: incomplete -> fail 2026-04-15 01:32:13,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 01:32:13,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:13,930 - lava_callback - INFO - Completed processing callback for node 69dee5d8f490930782fba0e8 INFO: 172.21.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:32:37,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:37,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:33:28,567 - lava_callback - INFO - Received callback for node 69dee845f490930782fba375 INFO: 172.21.0.1:58756 - "POST /node/69dee845f490930782fba375 HTTP/1.0" 202 Accepted 2026-04-15 01:33:28,573 - lava_callback - INFO - Starting async job submit for node 69dee845f490930782fba375 2026-04-15 01:33:28,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:28,607 - lava_callback - DEBUG - Processing node 69dee845f490930782fba375: baseline-arm64 2026-04-15 01:33:28,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/log.txt.gz 2026-04-15 01:33:29,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/lava-logs.yaml 2026-04-15 01:33:29,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/lava_callback.json.gz 2026-04-15 01:33:29,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:29,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:33:29,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:29,836 - lava_callback - INFO - Completed processing callback for node 69dee845f490930782fba375 INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:33:37,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 01:33:37,237 - lava_callback - INFO - Received callback for node 69dc47e25dbfa74e32f97ffc INFO: 172.21.0.1:36160 - "POST /node/69dc47e25dbfa74e32f97ffc HTTP/1.0" 202 Accepted 2026-04-15 01:33:37,242 - lava_callback - INFO - Starting async job submit for node 69dc47e25dbfa74e32f97ffc 2026-04-15 01:33:37,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,258 - lava_callback - DEBUG - Processing node 69dc47e25dbfa74e32f97ffc: baseline-arm-baylibre 2026-04-15 01:33:37,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc47e25dbfa74e32f97ffc 2026-04-15 01:33:37,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:33:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,309 - lava_callback - ERROR - Error processing callback for node 69dc47e25dbfa74e32f97ffc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:34:17,047 - lava_callback - INFO - Received callback for node 69dc48045dbfa74e32f98010 INFO: 172.21.0.1:43224 - "POST /node/69dc48045dbfa74e32f98010 HTTP/1.0" 202 Accepted 2026-04-15 01:34:17,052 - lava_callback - INFO - Starting async job submit for node 69dc48045dbfa74e32f98010 2026-04-15 01:34:17,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,068 - lava_callback - DEBUG - Processing node 69dc48045dbfa74e32f98010: baseline-arm-baylibre 2026-04-15 01:34:17,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48045dbfa74e32f98010 2026-04-15 01:34:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:34:17,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,136 - lava_callback - ERROR - Error processing callback for node 69dc48045dbfa74e32f98010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:34:37,021 - lava_callback - INFO - Received callback for node 69dc48275dbfa74e32f9802b INFO: 172.21.0.1:55940 - "POST /node/69dc48275dbfa74e32f9802b HTTP/1.0" 202 Accepted 2026-04-15 01:34:37,027 - lava_callback - INFO - Starting async job submit for node 69dc48275dbfa74e32f9802b 2026-04-15 01:34:37,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,043 - lava_callback - DEBUG - Processing node 69dc48275dbfa74e32f9802b: baseline-arm-baylibre 2026-04-15 01:34:37,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48275dbfa74e32f9802b 2026-04-15 01:34:37,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:34:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,092 - lava_callback - ERROR - Error processing callback for node 69dc48275dbfa74e32f9802b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:35:17,340 - lava_callback - INFO - Received callback for node 69dc484c5dbfa74e32f98041 INFO: 172.21.0.1:56332 - "POST /node/69dc484c5dbfa74e32f98041 HTTP/1.0" 202 Accepted 2026-04-15 01:35:17,346 - lava_callback - INFO - Starting async job submit for node 69dc484c5dbfa74e32f98041 2026-04-15 01:35:17,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,362 - lava_callback - DEBUG - Processing node 69dc484c5dbfa74e32f98041: baseline-arm-baylibre 2026-04-15 01:35:17,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc484c5dbfa74e32f98041 2026-04-15 01:35:17,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:35:17,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,413 - lava_callback - ERROR - Error processing callback for node 69dc484c5dbfa74e32f98041: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:36:17,141 - lava_callback - INFO - Received callback for node 69dc48875dbfa74e32f98081 INFO: 172.21.0.1:39868 - "POST /node/69dc48875dbfa74e32f98081 HTTP/1.0" 202 Accepted 2026-04-15 01:36:17,147 - lava_callback - INFO - Starting async job submit for node 69dc48875dbfa74e32f98081 2026-04-15 01:36:17,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,163 - lava_callback - DEBUG - Processing node 69dc48875dbfa74e32f98081: baseline-arm-baylibre 2026-04-15 01:36:17,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48875dbfa74e32f98081 2026-04-15 01:36:17,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:36:17,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,247 - lava_callback - ERROR - Error processing callback for node 69dc48875dbfa74e32f98081: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:36:57,228 - lava_callback - INFO - Received callback for node 69dc48a75dbfa74e32f980b4 INFO: 172.21.0.1:40192 - "POST /node/69dc48a75dbfa74e32f980b4 HTTP/1.0" 202 Accepted 2026-04-15 01:36:57,234 - lava_callback - INFO - Starting async job submit for node 69dc48a75dbfa74e32f980b4 2026-04-15 01:36:57,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,253 - lava_callback - DEBUG - Processing node 69dc48a75dbfa74e32f980b4: baseline-arm-baylibre 2026-04-15 01:36:57,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48a75dbfa74e32f980b4 2026-04-15 01:36:57,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:36:57,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,305 - lava_callback - ERROR - Error processing callback for node 69dc48a75dbfa74e32f980b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:37:29,514 - lava_callback - INFO - Received callback for node 69dc48cc5dbfa74e32f980da INFO: 172.21.0.1:47280 - "POST /node/69dc48cc5dbfa74e32f980da HTTP/1.0" 202 Accepted 2026-04-15 01:37:29,520 - lava_callback - INFO - Starting async job submit for node 69dc48cc5dbfa74e32f980da 2026-04-15 01:37:29,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,535 - lava_callback - DEBUG - Processing node 69dc48cc5dbfa74e32f980da: baseline-arm-clabbe 2026-04-15 01:37:29,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48cc5dbfa74e32f980da 2026-04-15 01:37:29,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:37:29,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,602 - lava_callback - ERROR - Error processing callback for node 69dc48cc5dbfa74e32f980da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 01:37:30,747 - lava_callback - INFO - Received callback for node 69dee855f490930782fba3b2 INFO: 172.21.0.1:59816 - "POST /node/69dee855f490930782fba3b2 HTTP/1.0" 202 Accepted 2026-04-15 01:37:30,754 - lava_callback - INFO - Starting async job submit for node 69dee855f490930782fba3b2 2026-04-15 01:37:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:30,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:30,797 - lava_callback - DEBUG - Processing node 69dee855f490930782fba3b2: baseline-nfs-arm64 2026-04-15 01:37:31,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/log.txt.gz 2026-04-15 01:37:31,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/lava-logs.yaml 2026-04-15 01:37:31,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/lava_callback.json.gz 2026-04-15 01:37:32,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:32,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:37:32,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:32,078 - lava_callback - INFO - Completed processing callback for node 69dee855f490930782fba3b2 INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:37:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:37,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:38:09,469 - lava_callback - INFO - Received callback for node 69dc48ec5dbfa74e32f98117 INFO: 172.21.0.1:35132 - "POST /node/69dc48ec5dbfa74e32f98117 HTTP/1.0" 202 Accepted 2026-04-15 01:38:09,478 - lava_callback - INFO - Starting async job submit for node 69dc48ec5dbfa74e32f98117 2026-04-15 01:38:09,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,504 - lava_callback - DEBUG - Processing node 69dc48ec5dbfa74e32f98117: baseline-arm-clabbe 2026-04-15 01:38:09,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48ec5dbfa74e32f98117 2026-04-15 01:38:09,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:38:09,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,568 - lava_callback - ERROR - Error processing callback for node 69dc48ec5dbfa74e32f98117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:38:29,489 - lava_callback - INFO - Received callback for node 69dc490f5dbfa74e32f98130 INFO: 172.21.0.1:60350 - "POST /node/69dc490f5dbfa74e32f98130 HTTP/1.0" 202 Accepted 2026-04-15 01:38:29,494 - lava_callback - INFO - Starting async job submit for node 69dc490f5dbfa74e32f98130 2026-04-15 01:38:29,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,519 - lava_callback - DEBUG - Processing node 69dc490f5dbfa74e32f98130: baseline-arm-clabbe 2026-04-15 01:38:29,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc490f5dbfa74e32f98130 2026-04-15 01:38:29,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:38:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,574 - lava_callback - ERROR - Error processing callback for node 69dc490f5dbfa74e32f98130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:39:09,504 - lava_callback - INFO - Received callback for node 69dc49345dbfa74e32f9813d INFO: 172.21.0.1:35680 - "POST /node/69dc49345dbfa74e32f9813d HTTP/1.0" 202 Accepted 2026-04-15 01:39:09,510 - lava_callback - INFO - Starting async job submit for node 69dc49345dbfa74e32f9813d 2026-04-15 01:39:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,528 - lava_callback - DEBUG - Processing node 69dc49345dbfa74e32f9813d: baseline-arm-clabbe 2026-04-15 01:39:09,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc49345dbfa74e32f9813d 2026-04-15 01:39:09,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:39:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,578 - lava_callback - ERROR - Error processing callback for node 69dc49345dbfa74e32f9813d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:40:49,651 - lava_callback - INFO - Received callback for node 69dc499a5dbfa74e32f981a0 INFO: 172.21.0.1:37930 - "POST /node/69dc499a5dbfa74e32f981a0 HTTP/1.0" 202 Accepted 2026-04-15 01:40:49,661 - lava_callback - INFO - Starting async job submit for node 69dc499a5dbfa74e32f981a0 2026-04-15 01:40:49,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,685 - lava_callback - DEBUG - Processing node 69dc499a5dbfa74e32f981a0: baseline-arm-clabbe 2026-04-15 01:40:49,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc499a5dbfa74e32f981a0 2026-04-15 01:40:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:40:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,789 - lava_callback - ERROR - Error processing callback for node 69dc499a5dbfa74e32f981a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:41:29,594 - lava_callback - INFO - Received callback for node 69dc49bd5dbfa74e32f981cd INFO: 172.21.0.1:47542 - "POST /node/69dc49bd5dbfa74e32f981cd HTTP/1.0" 202 Accepted 2026-04-15 01:41:29,601 - lava_callback - INFO - Starting async job submit for node 69dc49bd5dbfa74e32f981cd 2026-04-15 01:41:29,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,618 - lava_callback - DEBUG - Processing node 69dc49bd5dbfa74e32f981cd: baseline-arm-clabbe 2026-04-15 01:41:29,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc49bd5dbfa74e32f981cd 2026-04-15 01:41:29,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:41:29,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,677 - lava_callback - ERROR - Error processing callback for node 69dc49bd5dbfa74e32f981cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:42:52,779 - lava_callback - INFO - Received callback for node 69dee857f490930782fba3b8 INFO: 172.21.0.1:38146 - "POST /node/69dee857f490930782fba3b8 HTTP/1.0" 202 Accepted 2026-04-15 01:42:52,788 - lava_callback - INFO - Starting async job submit for node 69dee857f490930782fba3b8 2026-04-15 01:42:52,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:52,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:52,864 - lava_callback - DEBUG - Processing node 69dee857f490930782fba3b8: baseline-nfs-arm64 2026-04-15 01:42:54,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:54,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:54,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/log.txt.gz 2026-04-15 01:42:54,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:55,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:55,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/lava-logs.yaml 2026-04-15 01:42:55,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:55,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:55,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/lava_callback.json.gz DEBUG: Setup failed for 69dee857f490930782fba3b8. Transitting job node result: incomplete -> fail 2026-04-15 01:42:55,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:55,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:42:55,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:55,641 - lava_callback - INFO - Completed processing callback for node 69dee857f490930782fba3b8 INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:43:07,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:43:07,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:44:29,839 - lava_callback - INFO - Received callback for node 69dc4a6e5dbfa74e32f9825a INFO: 172.21.0.1:38048 - "POST /node/69dc4a6e5dbfa74e32f9825a HTTP/1.0" 202 Accepted 2026-04-15 01:44:29,845 - lava_callback - INFO - Starting async job submit for node 69dc4a6e5dbfa74e32f9825a 2026-04-15 01:44:29,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,871 - lava_callback - DEBUG - Processing node 69dc4a6e5dbfa74e32f9825a: baseline-arm-clabbe 2026-04-15 01:44:29,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4a6e5dbfa74e32f9825a 2026-04-15 01:44:29,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:44:29,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,953 - lava_callback - ERROR - Error processing callback for node 69dc4a6e5dbfa74e32f9825a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:45:09,780 - lava_callback - INFO - Received callback for node 69dc4a915dbfa74e32f98295 INFO: 172.21.0.1:34996 - "POST /node/69dc4a915dbfa74e32f98295 HTTP/1.0" 202 Accepted 2026-04-15 01:45:09,786 - lava_callback - INFO - Starting async job submit for node 69dc4a915dbfa74e32f98295 2026-04-15 01:45:09,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,802 - lava_callback - DEBUG - Processing node 69dc4a915dbfa74e32f98295: baseline-arm-clabbe 2026-04-15 01:45:09,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4a915dbfa74e32f98295 2026-04-15 01:45:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:45:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,850 - lava_callback - ERROR - Error processing callback for node 69dc4a915dbfa74e32f98295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:45:58,308 - lava_callback - INFO - Received callback for node 69dee85df490930782fba3c7 INFO: 172.21.0.1:49632 - "POST /node/69dee85df490930782fba3c7 HTTP/1.0" 202 Accepted 2026-04-15 01:45:58,315 - lava_callback - INFO - Starting async job submit for node 69dee85df490930782fba3c7 2026-04-15 01:45:58,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:58,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:45:58,376 - lava_callback - DEBUG - Processing node 69dee85df490930782fba3c7: baseline-nfs-arm64 2026-04-15 01:45:59,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:45:59,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:45:59,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/log.txt.gz 2026-04-15 01:45:59,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:45:59,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:45:59,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/lava-logs.yaml 2026-04-15 01:46:00,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:46:00,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:46:00,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/lava_callback.json.gz DEBUG: Setup failed for 69dee85df490930782fba3c7. Transitting job node result: incomplete -> fail 2026-04-15 01:46:00,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:46:00,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:46:00,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:46:00,508 - lava_callback - INFO - Completed processing callback for node 69dee85df490930782fba3c7 INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:46:07,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:46:49,879 - lava_callback - INFO - Received callback for node 69dc4afa5dbfa74e32f982e6 INFO: 172.21.0.1:34802 - "POST /node/69dc4afa5dbfa74e32f982e6 HTTP/1.0" 202 Accepted 2026-04-15 01:46:49,885 - lava_callback - INFO - Starting async job submit for node 69dc4afa5dbfa74e32f982e6 2026-04-15 01:46:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,900 - lava_callback - DEBUG - Processing node 69dc4afa5dbfa74e32f982e6: baseline-arm-clabbe 2026-04-15 01:46:49,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4afa5dbfa74e32f982e6 2026-04-15 01:46:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:46:49,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,961 - lava_callback - ERROR - Error processing callback for node 69dc4afa5dbfa74e32f982e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:48:34,053 - lava_callback - INFO - Received callback for node 69deea3ff490930782fba7ab INFO: 172.21.0.1:58354 - "POST /node/69deea3ff490930782fba7ab HTTP/1.0" 202 Accepted 2026-04-15 01:48:34,061 - lava_callback - INFO - Starting async job submit for node 69deea3ff490930782fba7ab 2026-04-15 01:48:34,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:34,148 - lava_callback - DEBUG - Processing node 69deea3ff490930782fba7ab: ltp-smoke 2026-04-15 01:48:34,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:34,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:34,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/log.txt.gz 2026-04-15 01:48:35,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:35,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:35,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/lava-logs.yaml 2026-04-15 01:48:35,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:35,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:35,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/lava_callback.json.gz 2026-04-15 01:48:35,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:35,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 01:48:35,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:35,978 - lava_callback - INFO - Completed processing callback for node 69deea3ff490930782fba7ab INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:48:37,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:37,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:53:18,383 - lava_callback - INFO - Received callback for node 69dc4c865dbfa74e32f98447 INFO: 172.21.0.1:53110 - "POST /node/69dc4c865dbfa74e32f98447 HTTP/1.0" 202 Accepted 2026-04-15 01:53:18,389 - lava_callback - INFO - Starting async job submit for node 69dc4c865dbfa74e32f98447 2026-04-15 01:53:18,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,405 - lava_callback - DEBUG - Processing node 69dc4c865dbfa74e32f98447: baseline-arm64-baylibre 2026-04-15 01:53:18,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4c865dbfa74e32f98447 2026-04-15 01:53:18,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:53:18,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,484 - lava_callback - ERROR - Error processing callback for node 69dc4c865dbfa74e32f98447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:54:38,121 - lava_callback - INFO - Received callback for node 69dc4ccb5dbfa74e32f9849f INFO: 172.21.0.1:50024 - "POST /node/69dc4ccb5dbfa74e32f9849f HTTP/1.0" 202 Accepted 2026-04-15 01:54:38,127 - lava_callback - INFO - Starting async job submit for node 69dc4ccb5dbfa74e32f9849f 2026-04-15 01:54:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,143 - lava_callback - DEBUG - Processing node 69dc4ccb5dbfa74e32f9849f: baseline-arm64-baylibre 2026-04-15 01:54:38,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ccb5dbfa74e32f9849f 2026-04-15 01:54:38,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:54:38,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,198 - lava_callback - ERROR - Error processing callback for node 69dc4ccb5dbfa74e32f9849f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:56:38,238 - lava_callback - INFO - Received callback for node 69dc4d505dbfa74e32f98548 INFO: 172.21.0.1:55222 - "POST /node/69dc4d505dbfa74e32f98548 HTTP/1.0" 202 Accepted 2026-04-15 01:56:38,244 - lava_callback - INFO - Starting async job submit for node 69dc4d505dbfa74e32f98548 2026-04-15 01:56:38,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,260 - lava_callback - DEBUG - Processing node 69dc4d505dbfa74e32f98548: baseline-arm64-baylibre 2026-04-15 01:56:38,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4d505dbfa74e32f98548 2026-04-15 01:56:38,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:56:38,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,310 - lava_callback - ERROR - Error processing callback for node 69dc4d505dbfa74e32f98548: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:58:18,408 - lava_callback - INFO - Received callback for node 69dc4db25dbfa74e32f985d4 INFO: 172.21.0.1:33324 - "POST /node/69dc4db25dbfa74e32f985d4 HTTP/1.0" 202 Accepted 2026-04-15 01:58:18,414 - lava_callback - INFO - Starting async job submit for node 69dc4db25dbfa74e32f985d4 2026-04-15 01:58:18,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,431 - lava_callback - DEBUG - Processing node 69dc4db25dbfa74e32f985d4: baseline-arm64-baylibre 2026-04-15 01:58:18,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4db25dbfa74e32f985d4 2026-04-15 01:58:18,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:58:18,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,486 - lava_callback - ERROR - Error processing callback for node 69dc4db25dbfa74e32f985d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:59:38,433 - lava_callback - INFO - Received callback for node 69dc4df85dbfa74e32f98623 INFO: 172.21.0.1:56560 - "POST /node/69dc4df85dbfa74e32f98623 HTTP/1.0" 202 Accepted 2026-04-15 01:59:38,438 - lava_callback - INFO - Starting async job submit for node 69dc4df85dbfa74e32f98623 2026-04-15 01:59:38,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,463 - lava_callback - DEBUG - Processing node 69dc4df85dbfa74e32f98623: baseline-arm64-baylibre 2026-04-15 01:59:38,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4df85dbfa74e32f98623 2026-04-15 01:59:38,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:59:38,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,522 - lava_callback - ERROR - Error processing callback for node 69dc4df85dbfa74e32f98623: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:01:18,458 - lava_callback - INFO - Received callback for node 69dc4e5a5dbfa74e32f986b0 INFO: 172.21.0.1:51138 - "POST /node/69dc4e5a5dbfa74e32f986b0 HTTP/1.0" 202 Accepted 2026-04-15 02:01:18,464 - lava_callback - INFO - Starting async job submit for node 69dc4e5a5dbfa74e32f986b0 2026-04-15 02:01:18,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,480 - lava_callback - DEBUG - Processing node 69dc4e5a5dbfa74e32f986b0: baseline-arm64-baylibre 2026-04-15 02:01:18,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4e5a5dbfa74e32f986b0 2026-04-15 02:01:18,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:01:18,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,544 - lava_callback - ERROR - Error processing callback for node 69dc4e5a5dbfa74e32f986b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:02:30,534 - lava_callback - INFO - Received callback for node 69dc4ea75dbfa74e32f986e1 INFO: 172.21.0.1:39332 - "POST /node/69dc4ea75dbfa74e32f986e1 HTTP/1.0" 202 Accepted 2026-04-15 02:02:30,540 - lava_callback - INFO - Starting async job submit for node 69dc4ea75dbfa74e32f986e1 2026-04-15 02:02:30,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,556 - lava_callback - DEBUG - Processing node 69dc4ea75dbfa74e32f986e1: baseline-arm64-clabbe 2026-04-15 02:02:30,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ea75dbfa74e32f986e1 2026-04-15 02:02:30,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:02:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,660 - lava_callback - ERROR - Error processing callback for node 69dc4ea75dbfa74e32f986e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:04:50,672 - lava_callback - INFO - Received callback for node 69dc4f335dbfa74e32f98780 INFO: 172.21.0.1:37602 - "POST /node/69dc4f335dbfa74e32f98780 HTTP/1.0" 202 Accepted 2026-04-15 02:04:50,678 - lava_callback - INFO - Starting async job submit for node 69dc4f335dbfa74e32f98780 2026-04-15 02:04:50,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,693 - lava_callback - DEBUG - Processing node 69dc4f335dbfa74e32f98780: baseline-arm64-clabbe 2026-04-15 02:04:50,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4f335dbfa74e32f98780 2026-04-15 02:04:50,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:04:50,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,745 - lava_callback - ERROR - Error processing callback for node 69dc4f335dbfa74e32f98780: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:05:30,043 - lava_callback - INFO - Received callback for node 69def106f490930782fbae15 INFO: 172.21.0.1:56046 - "POST /node/69def106f490930782fbae15 HTTP/1.0" 202 Accepted 2026-04-15 02:05:30,050 - lava_callback - INFO - Starting async job submit for node 69def106f490930782fbae15 2026-04-15 02:05:30,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:30,091 - lava_callback - DEBUG - Processing node 69def106f490930782fbae15: ltp-timers 2026-04-15 02:05:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:30,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:30,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/log.txt.gz 2026-04-15 02:05:30,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:30,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:30,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/lava-logs.yaml 2026-04-15 02:05:30,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:31,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:31,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/lava_callback.json.gz 2026-04-15 02:05:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:31,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:05:31,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:31,237 - lava_callback - INFO - Completed processing callback for node 69def106f490930782fbae15 INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:05:37,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:37,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:06:50,712 - lava_callback - INFO - Received callback for node 69dc4fb35dbfa74e32f9882d INFO: 172.21.0.1:48664 - "POST /node/69dc4fb35dbfa74e32f9882d HTTP/1.0" 202 Accepted 2026-04-15 02:06:50,718 - lava_callback - INFO - Starting async job submit for node 69dc4fb35dbfa74e32f9882d 2026-04-15 02:06:50,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,735 - lava_callback - DEBUG - Processing node 69dc4fb35dbfa74e32f9882d: baseline-arm64-clabbe 2026-04-15 02:06:50,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4fb35dbfa74e32f9882d 2026-04-15 02:06:50,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:06:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,808 - lava_callback - ERROR - Error processing callback for node 69dc4fb35dbfa74e32f9882d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:12,775 - lava_callback - INFO - Received callback for node 69def2bff490930782fbafbb INFO: 172.21.0.1:37912 - "POST /node/69def2bff490930782fbafbb HTTP/1.0" 202 Accepted 2026-04-15 02:07:12,781 - lava_callback - INFO - Starting async job submit for node 69def2bff490930782fbafbb 2026-04-15 02:07:12,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:12,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:12,805 - lava_callback - DEBUG - Processing node 69def2bff490930782fbafbb: baseline-arm 2026-04-15 02:07:12,810 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:07:12,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:07:12,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:07:12,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69def2bff490930782fbafbb/lava-logs.yaml 2026-04-15 02:07:12,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:07:13,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:07:13,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69def2bff490930782fbafbb/lava_callback.json.gz 2026-04-15 02:07:13,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:07:13,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:13,182 - lava_callback - INFO - Completed processing callback for node 69def2bff490930782fbafbb INFO: 172.21.0.1:37916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:37,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:37,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:50,761 - lava_callback - INFO - Received callback for node 69dc4ff25dbfa74e32f98899 INFO: 172.21.0.1:41088 - "POST /node/69dc4ff25dbfa74e32f98899 HTTP/1.0" 202 Accepted 2026-04-15 02:07:50,766 - lava_callback - INFO - Starting async job submit for node 69dc4ff25dbfa74e32f98899 2026-04-15 02:07:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,788 - lava_callback - DEBUG - Processing node 69dc4ff25dbfa74e32f98899: baseline-arm64-clabbe 2026-04-15 02:07:50,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ff25dbfa74e32f98899 2026-04-15 02:07:50,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:07:50,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,849 - lava_callback - ERROR - Error processing callback for node 69dc4ff25dbfa74e32f98899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:09:10,796 - lava_callback - INFO - Received callback for node 69dc50365dbfa74e32f988f5 INFO: 172.21.0.1:51944 - "POST /node/69dc50365dbfa74e32f988f5 HTTP/1.0" 202 Accepted 2026-04-15 02:09:10,802 - lava_callback - INFO - Starting async job submit for node 69dc50365dbfa74e32f988f5 2026-04-15 02:09:10,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,818 - lava_callback - DEBUG - Processing node 69dc50365dbfa74e32f988f5: baseline-arm64-clabbe 2026-04-15 02:09:10,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc50365dbfa74e32f988f5 2026-04-15 02:09:10,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:09:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,867 - lava_callback - ERROR - Error processing callback for node 69dc50365dbfa74e32f988f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:10:30,847 - lava_callback - INFO - Received callback for node 69dc50825dbfa74e32f98932 INFO: 172.21.0.1:46690 - "POST /node/69dc50825dbfa74e32f98932 HTTP/1.0" 202 Accepted 2026-04-15 02:10:30,853 - lava_callback - INFO - Starting async job submit for node 69dc50825dbfa74e32f98932 2026-04-15 02:10:30,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,870 - lava_callback - DEBUG - Processing node 69dc50825dbfa74e32f98932: baseline-arm64-clabbe 2026-04-15 02:10:30,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc50825dbfa74e32f98932 2026-04-15 02:10:30,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:10:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,918 - lava_callback - ERROR - Error processing callback for node 69dc50825dbfa74e32f98932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:12:30,945 - lava_callback - INFO - Received callback for node 69dc51055dbfa74e32f989e2 INFO: 172.21.0.1:33920 - "POST /node/69dc51055dbfa74e32f989e2 HTTP/1.0" 202 Accepted 2026-04-15 02:12:30,951 - lava_callback - INFO - Starting async job submit for node 69dc51055dbfa74e32f989e2 2026-04-15 02:12:30,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:30,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:30,979 - lava_callback - DEBUG - Processing node 69dc51055dbfa74e32f989e2: baseline-arm64-clabbe 2026-04-15 02:12:30,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc51055dbfa74e32f989e2 2026-04-15 02:12:30,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:30,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:30,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:31,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:12:31,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:31,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:31,027 - lava_callback - ERROR - Error processing callback for node 69dc51055dbfa74e32f989e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:14:34,957 - lava_callback - INFO - Received callback for node 69def483f490930782fbb1c2 INFO: 172.21.0.1:50544 - "POST /node/69def483f490930782fbb1c2 HTTP/1.0" 202 Accepted 2026-04-15 02:14:34,963 - lava_callback - INFO - Starting async job submit for node 69def483f490930782fbb1c2 2026-04-15 02:14:34,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:34,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:34,980 - lava_callback - DEBUG - Processing node 69def483f490930782fbb1c2: baseline-nfs-arm64 2026-04-15 02:14:34,982 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:14:34,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:14:35,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:14:35,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def483f490930782fbb1c2/lava-logs.yaml 2026-04-15 02:14:35,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:14:35,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:14:35,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def483f490930782fbb1c2/lava_callback.json.gz 2026-04-15 02:14:35,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:35,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:14:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:35,507 - lava_callback - INFO - Completed processing callback for node 69def483f490930782fbb1c2 INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:14:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:37,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:10,806 - lava_callback - INFO - Received callback for node 69def4bff490930782fbb200 INFO: 172.21.0.1:33856 - "POST /node/69def4bff490930782fbb200 HTTP/1.0" 202 Accepted 2026-04-15 02:16:10,812 - lava_callback - INFO - Starting async job submit for node 69def4bff490930782fbb200 2026-04-15 02:16:10,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:10,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:10,857 - lava_callback - DEBUG - Processing node 69def4bff490930782fbb200: baseline-arm64 2026-04-15 02:16:10,992 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:16:11,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:16:11,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:16:11,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def4bff490930782fbb200/lava-logs.yaml 2026-04-15 02:16:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:16:11,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:16:11,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def4bff490930782fbb200/lava_callback.json.gz 2026-04-15 02:16:11,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:11,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:16:11,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:11,568 - lava_callback - INFO - Completed processing callback for node 69def4bff490930782fbb200 INFO: 172.21.0.1:33864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:37,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:59,490 - lava_callback - INFO - Received callback for node 69dc52085dbfa74e32f98af0 INFO: 172.21.0.1:53230 - "POST /node/69dc52085dbfa74e32f98af0 HTTP/1.0" 202 Accepted 2026-04-15 02:16:59,496 - lava_callback - INFO - Starting async job submit for node 69dc52085dbfa74e32f98af0 2026-04-15 02:16:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,512 - lava_callback - DEBUG - Processing node 69dc52085dbfa74e32f98af0: baseline-arm-baylibre 2026-04-15 02:16:59,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52085dbfa74e32f98af0 2026-04-15 02:16:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:16:59,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,566 - lava_callback - ERROR - Error processing callback for node 69dc52085dbfa74e32f98af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:17:19,283 - lava_callback - INFO - Received callback for node 69dc52245dbfa74e32f98b05 INFO: 172.21.0.1:58288 - "POST /node/69dc52245dbfa74e32f98b05 HTTP/1.0" 202 Accepted 2026-04-15 02:17:19,288 - lava_callback - INFO - Starting async job submit for node 69dc52245dbfa74e32f98b05 2026-04-15 02:17:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,329 - lava_callback - DEBUG - Processing node 69dc52245dbfa74e32f98b05: baseline-arm-baylibre 2026-04-15 02:17:19,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52245dbfa74e32f98b05 2026-04-15 02:17:19,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:17:19,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,377 - lava_callback - ERROR - Error processing callback for node 69dc52245dbfa74e32f98b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:18:59,490 - lava_callback - INFO - Received callback for node 69dc528b5dbfa74e32f98b9b INFO: 172.21.0.1:43710 - "POST /node/69dc528b5dbfa74e32f98b9b HTTP/1.0" 202 Accepted 2026-04-15 02:18:59,496 - lava_callback - INFO - Starting async job submit for node 69dc528b5dbfa74e32f98b9b 2026-04-15 02:18:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,511 - lava_callback - DEBUG - Processing node 69dc528b5dbfa74e32f98b9b: baseline-arm-baylibre 2026-04-15 02:18:59,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc528b5dbfa74e32f98b9b 2026-04-15 02:18:59,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:18:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,559 - lava_callback - ERROR - Error processing callback for node 69dc528b5dbfa74e32f98b9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:19:39,404 - lava_callback - INFO - Received callback for node 69dc52ac5dbfa74e32f98bbd INFO: 172.21.0.1:41866 - "POST /node/69dc52ac5dbfa74e32f98bbd HTTP/1.0" 202 Accepted 2026-04-15 02:19:39,410 - lava_callback - INFO - Starting async job submit for node 69dc52ac5dbfa74e32f98bbd 2026-04-15 02:19:39,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,425 - lava_callback - DEBUG - Processing node 69dc52ac5dbfa74e32f98bbd: baseline-arm-baylibre 2026-04-15 02:19:39,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52ac5dbfa74e32f98bbd 2026-04-15 02:19:39,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:19:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,507 - lava_callback - ERROR - Error processing callback for node 69dc52ac5dbfa74e32f98bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:19:44,065 - lava_callback - INFO - Received callback for node 69def54cf490930782fbb2c1 INFO: 172.21.0.1:47494 - "POST /node/69def54cf490930782fbb2c1 HTTP/1.0" 202 Accepted 2026-04-15 02:19:44,072 - lava_callback - INFO - Starting async job submit for node 69def54cf490930782fbb2c1 2026-04-15 02:19:44,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:44,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:44,112 - lava_callback - DEBUG - Processing node 69def54cf490930782fbb2c1: baseline-arm64 2026-04-15 02:19:44,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:44,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:44,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/log.txt.gz 2026-04-15 02:19:45,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:45,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:45,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/lava-logs.yaml 2026-04-15 02:19:45,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:45,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:45,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/lava_callback.json.gz 2026-04-15 02:19:45,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:45,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:19:45,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:45,616 - lava_callback - INFO - Completed processing callback for node 69def54cf490930782fbb2c1 INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:19:59,469 - lava_callback - INFO - Received callback for node 69dc52cd5dbfa74e32f98bd3 INFO: 172.21.0.1:35492 - "POST /node/69dc52cd5dbfa74e32f98bd3 HTTP/1.0" 202 Accepted 2026-04-15 02:19:59,475 - lava_callback - INFO - Starting async job submit for node 69dc52cd5dbfa74e32f98bd3 2026-04-15 02:19:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,508 - lava_callback - DEBUG - Processing node 69dc52cd5dbfa74e32f98bd3: baseline-arm-baylibre 2026-04-15 02:19:59,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52cd5dbfa74e32f98bd3 2026-04-15 02:19:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:19:59,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,557 - lava_callback - ERROR - Error processing callback for node 69dc52cd5dbfa74e32f98bd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:20:03,982 - lava_callback - INFO - Received callback for node 69def597f490930782fbb348 INFO: 172.21.0.1:36952 - "POST /node/69def597f490930782fbb348 HTTP/1.0" 202 Accepted 2026-04-15 02:20:03,989 - lava_callback - INFO - Starting async job submit for node 69def597f490930782fbb348 2026-04-15 02:20:04,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,038 - lava_callback - DEBUG - Processing node 69def597f490930782fbb348: baseline-arm64 2026-04-15 02:20:04,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/log.txt.gz 2026-04-15 02:20:04,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/lava-logs.yaml 2026-04-15 02:20:04,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/lava_callback.json.gz 2026-04-15 02:20:04,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:04,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,834 - lava_callback - INFO - Completed processing callback for node 69def597f490930782fbb348 INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:07,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:07,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:11,995 - lava_callback - INFO - Received callback for node 69dee841f490930782fba36c INFO: 172.21.0.1:50772 - "POST /node/69dee841f490930782fba36c HTTP/1.0" 202 Accepted 2026-04-15 02:20:12,001 - lava_callback - INFO - Starting async job submit for node 69dee841f490930782fba36c 2026-04-15 02:20:12,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,041 - lava_callback - DEBUG - Processing node 69dee841f490930782fba36c: baseline-arm64 2026-04-15 02:20:12,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/log.txt.gz 2026-04-15 02:20:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/lava-logs.yaml 2026-04-15 02:20:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/lava_callback.json.gz 2026-04-15 02:20:12,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:12,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,990 - lava_callback - INFO - Completed processing callback for node 69dee841f490930782fba36c INFO: 172.21.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:37,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:37,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:55,040 - lava_callback - INFO - Received callback for node 69dee853f490930782fba3af INFO: 172.21.0.1:45288 - "POST /node/69dee853f490930782fba3af HTTP/1.0" 202 Accepted 2026-04-15 02:20:55,047 - lava_callback - INFO - Starting async job submit for node 69dee853f490930782fba3af 2026-04-15 02:20:55,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:55,087 - lava_callback - DEBUG - Processing node 69dee853f490930782fba3af: baseline-nfs-arm64 2026-04-15 02:20:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:55,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:55,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/log.txt.gz 2026-04-15 02:20:55,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:55,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:55,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/lava-logs.yaml 2026-04-15 02:20:55,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:56,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:56,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/lava_callback.json.gz 2026-04-15 02:20:56,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:56,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:56,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:56,184 - lava_callback - INFO - Completed processing callback for node 69dee853f490930782fba3af INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:07,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:07,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:25,061 - lava_callback - INFO - Received callback for node 69def5f4f490930782fbb3c3 INFO: 172.21.0.1:32976 - "POST /node/69def5f4f490930782fbb3c3 HTTP/1.0" 202 Accepted 2026-04-15 02:21:25,067 - lava_callback - INFO - Starting async job submit for node 69def5f4f490930782fbb3c3 2026-04-15 02:21:25,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:25,105 - lava_callback - DEBUG - Processing node 69def5f4f490930782fbb3c3: baseline-arm64-foundriesio 2026-04-15 02:21:25,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/log.txt.gz 2026-04-15 02:21:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/lava-logs.yaml 2026-04-15 02:21:25,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/lava_callback.json.gz 2026-04-15 02:21:25,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:25,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:21:25,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:26,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:26,008 - lava_callback - INFO - Completed processing callback for node 69def5f4f490930782fbb3c3 INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:37,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:37,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 02:21:39,815 - lava_callback - INFO - Received callback for node 69dc532f5dbfa74e32f98c4c INFO: 172.21.0.1:43290 - "POST /node/69dc532f5dbfa74e32f98c4c HTTP/1.0" 202 Accepted 2026-04-15 02:21:39,821 - lava_callback - INFO - Starting async job submit for node 69dc532f5dbfa74e32f98c4c 2026-04-15 02:21:39,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,836 - lava_callback - DEBUG - Processing node 69dc532f5dbfa74e32f98c4c: baseline-arm-baylibre 2026-04-15 02:21:39,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc532f5dbfa74e32f98c4c 2026-04-15 02:21:39,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:21:39,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,885 - lava_callback - ERROR - Error processing callback for node 69dc532f5dbfa74e32f98c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:22:11,316 - lava_callback - INFO - Received callback for node 69dc534d5dbfa74e32f98c83 INFO: 172.21.0.1:44678 - "POST /node/69dc534d5dbfa74e32f98c83 HTTP/1.0" 202 Accepted 2026-04-15 02:22:11,326 - lava_callback - INFO - Starting async job submit for node 69dc534d5dbfa74e32f98c83 2026-04-15 02:22:11,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,342 - lava_callback - DEBUG - Processing node 69dc534d5dbfa74e32f98c83: baseline-arm-clabbe 2026-04-15 02:22:11,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc534d5dbfa74e32f98c83 2026-04-15 02:22:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:22:11,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,394 - lava_callback - ERROR - Error processing callback for node 69dc534d5dbfa74e32f98c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:22:51,257 - lava_callback - INFO - Received callback for node 69dc536c5dbfa74e32f98cbe INFO: 172.21.0.1:48590 - "POST /node/69dc536c5dbfa74e32f98cbe HTTP/1.0" 202 Accepted 2026-04-15 02:22:51,265 - lava_callback - INFO - Starting async job submit for node 69dc536c5dbfa74e32f98cbe 2026-04-15 02:22:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,282 - lava_callback - DEBUG - Processing node 69dc536c5dbfa74e32f98cbe: baseline-arm-clabbe 2026-04-15 02:22:51,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc536c5dbfa74e32f98cbe 2026-04-15 02:22:51,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:22:51,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,358 - lava_callback - ERROR - Error processing callback for node 69dc536c5dbfa74e32f98cbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:23:11,301 - lava_callback - INFO - Received callback for node 69dc538c5dbfa74e32f98ce8 INFO: 172.21.0.1:47232 - "POST /node/69dc538c5dbfa74e32f98ce8 HTTP/1.0" 202 Accepted 2026-04-15 02:23:11,306 - lava_callback - INFO - Starting async job submit for node 69dc538c5dbfa74e32f98ce8 2026-04-15 02:23:11,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,323 - lava_callback - DEBUG - Processing node 69dc538c5dbfa74e32f98ce8: baseline-arm-clabbe 2026-04-15 02:23:11,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc538c5dbfa74e32f98ce8 2026-04-15 02:23:11,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:23:11,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,371 - lava_callback - ERROR - Error processing callback for node 69dc538c5dbfa74e32f98ce8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:23:51,306 - lava_callback - INFO - Received callback for node 69dc53a95dbfa74e32f98d15 INFO: 172.21.0.1:53354 - "POST /node/69dc53a95dbfa74e32f98d15 HTTP/1.0" 202 Accepted 2026-04-15 02:23:51,313 - lava_callback - INFO - Starting async job submit for node 69dc53a95dbfa74e32f98d15 2026-04-15 02:23:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,346 - lava_callback - DEBUG - Processing node 69dc53a95dbfa74e32f98d15: baseline-arm-clabbe 2026-04-15 02:23:51,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53a95dbfa74e32f98d15 2026-04-15 02:23:51,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:23:51,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,402 - lava_callback - ERROR - Error processing callback for node 69dc53a95dbfa74e32f98d15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:24:31,328 - lava_callback - INFO - Received callback for node 69dc53cc5dbfa74e32f98d44 INFO: 172.21.0.1:44852 - "POST /node/69dc53cc5dbfa74e32f98d44 HTTP/1.0" 202 Accepted 2026-04-15 02:24:31,334 - lava_callback - INFO - Starting async job submit for node 69dc53cc5dbfa74e32f98d44 2026-04-15 02:24:31,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,350 - lava_callback - DEBUG - Processing node 69dc53cc5dbfa74e32f98d44: baseline-arm-clabbe 2026-04-15 02:24:31,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53cc5dbfa74e32f98d44 2026-04-15 02:24:31,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:24:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,401 - lava_callback - ERROR - Error processing callback for node 69dc53cc5dbfa74e32f98d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:24:51,353 - lava_callback - INFO - Received callback for node 69dc53f05dbfa74e32f98d52 INFO: 172.21.0.1:35848 - "POST /node/69dc53f05dbfa74e32f98d52 HTTP/1.0" 202 Accepted 2026-04-15 02:24:51,359 - lava_callback - INFO - Starting async job submit for node 69dc53f05dbfa74e32f98d52 2026-04-15 02:24:51,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,376 - lava_callback - DEBUG - Processing node 69dc53f05dbfa74e32f98d52: baseline-arm-clabbe 2026-04-15 02:24:51,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53f05dbfa74e32f98d52 2026-04-15 02:24:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:24:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,440 - lava_callback - ERROR - Error processing callback for node 69dc53f05dbfa74e32f98d52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:25:31,490 - lava_callback - INFO - Received callback for node 69dc540f5dbfa74e32f98d84 INFO: 172.21.0.1:35030 - "POST /node/69dc540f5dbfa74e32f98d84 HTTP/1.0" 202 Accepted 2026-04-15 02:25:31,495 - lava_callback - INFO - Starting async job submit for node 69dc540f5dbfa74e32f98d84 2026-04-15 02:25:31,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,511 - lava_callback - DEBUG - Processing node 69dc540f5dbfa74e32f98d84: baseline-arm-clabbe 2026-04-15 02:25:31,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc540f5dbfa74e32f98d84 2026-04-15 02:25:31,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:25:31,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,578 - lava_callback - ERROR - Error processing callback for node 69dc540f5dbfa74e32f98d84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:26:11,403 - lava_callback - INFO - Received callback for node 69dc542f5dbfa74e32f98dad INFO: 172.21.0.1:51312 - "POST /node/69dc542f5dbfa74e32f98dad HTTP/1.0" 202 Accepted 2026-04-15 02:26:11,408 - lava_callback - INFO - Starting async job submit for node 69dc542f5dbfa74e32f98dad 2026-04-15 02:26:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,424 - lava_callback - DEBUG - Processing node 69dc542f5dbfa74e32f98dad: baseline-arm-clabbe 2026-04-15 02:26:11,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc542f5dbfa74e32f98dad 2026-04-15 02:26:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:26:11,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,475 - lava_callback - ERROR - Error processing callback for node 69dc542f5dbfa74e32f98dad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:26:31,419 - lava_callback - INFO - Received callback for node 69dc54515dbfa74e32f98dcb INFO: 172.21.0.1:43416 - "POST /node/69dc54515dbfa74e32f98dcb HTTP/1.0" 202 Accepted 2026-04-15 02:26:31,425 - lava_callback - INFO - Starting async job submit for node 69dc54515dbfa74e32f98dcb 2026-04-15 02:26:31,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,443 - lava_callback - DEBUG - Processing node 69dc54515dbfa74e32f98dcb: baseline-arm-clabbe 2026-04-15 02:26:31,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54515dbfa74e32f98dcb 2026-04-15 02:26:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:26:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,518 - lava_callback - ERROR - Error processing callback for node 69dc54515dbfa74e32f98dcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:19,956 - lava_callback - INFO - Received callback for node 69dc54755dbfa74e32f98df0 INFO: 172.21.0.1:52250 - "POST /node/69dc54755dbfa74e32f98df0 HTTP/1.0" 202 Accepted 2026-04-15 02:27:19,961 - lava_callback - INFO - Starting async job submit for node 69dc54755dbfa74e32f98df0 2026-04-15 02:27:19,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:19,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:19,983 - lava_callback - DEBUG - Processing node 69dc54755dbfa74e32f98df0: baseline-arm64-baylibre 2026-04-15 02:27:19,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54755dbfa74e32f98df0 2026-04-15 02:27:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:20,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:27:20,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:20,035 - lava_callback - ERROR - Error processing callback for node 69dc54755dbfa74e32f98df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:28,190 - lava_callback - INFO - Received callback for node 69def63cf490930782fbb417 INFO: 172.21.0.1:52258 - "POST /node/69def63cf490930782fbb417 HTTP/1.0" 202 Accepted 2026-04-15 02:27:28,203 - lava_callback - INFO - Starting async job submit for node 69def63cf490930782fbb417 2026-04-15 02:27:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:28,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:28,281 - lava_callback - DEBUG - Processing node 69def63cf490930782fbb417: baseline-arm64-foundriesio 2026-04-15 02:27:29,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:29,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:29,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/log.txt.gz 2026-04-15 02:27:30,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:30,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:30,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/lava-logs.yaml 2026-04-15 02:27:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:30,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:30,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/lava_callback.json.gz DEBUG: Setup failed for 69def63cf490930782fbb417. Transitting job node result: incomplete -> fail 2026-04-15 02:27:30,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:30,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:27:30,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:31,044 - lava_callback - INFO - Completed processing callback for node 69def63cf490930782fbb417 INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:37,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:37,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:28:19,922 - lava_callback - INFO - Received callback for node 69dc54bb5dbfa74e32f98e32 INFO: 172.21.0.1:36686 - "POST /node/69dc54bb5dbfa74e32f98e32 HTTP/1.0" 202 Accepted 2026-04-15 02:28:19,927 - lava_callback - INFO - Starting async job submit for node 69dc54bb5dbfa74e32f98e32 2026-04-15 02:28:19,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,943 - lava_callback - DEBUG - Processing node 69dc54bb5dbfa74e32f98e32: baseline-arm64-baylibre 2026-04-15 02:28:19,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54bb5dbfa74e32f98e32 2026-04-15 02:28:19,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:28:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,996 - lava_callback - ERROR - Error processing callback for node 69dc54bb5dbfa74e32f98e32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:28,919 - lava_callback - INFO - Received callback for node 69def763f490930782fbb53c INFO: 172.21.0.1:57930 - "POST /node/69def763f490930782fbb53c HTTP/1.0" 202 Accepted 2026-04-15 02:30:28,925 - lava_callback - INFO - Starting async job submit for node 69def763f490930782fbb53c 2026-04-15 02:30:28,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:28,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:28,957 - lava_callback - DEBUG - Processing node 69def763f490930782fbb53c: baseline-arm64 2026-04-15 02:30:29,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:29,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:29,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/log.txt.gz 2026-04-15 02:30:29,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:29,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:29,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/lava-logs.yaml 2026-04-15 02:30:29,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:30,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:30,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/lava_callback.json.gz 2026-04-15 02:30:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:30:30,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:30,207 - lava_callback - INFO - Completed processing callback for node 69def763f490930782fbb53c INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:37,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:37,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 02:30:40,084 - lava_callback - INFO - Received callback for node 69dc554a5dbfa74e32f98eb4 INFO: 172.21.0.1:37156 - "POST /node/69dc554a5dbfa74e32f98eb4 HTTP/1.0" 202 Accepted 2026-04-15 02:30:40,090 - lava_callback - INFO - Starting async job submit for node 69dc554a5dbfa74e32f98eb4 2026-04-15 02:30:40,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,113 - lava_callback - DEBUG - Processing node 69dc554a5dbfa74e32f98eb4: baseline-arm64-baylibre 2026-04-15 02:30:40,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc554a5dbfa74e32f98eb4 2026-04-15 02:30:40,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:30:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,167 - lava_callback - ERROR - Error processing callback for node 69dc554a5dbfa74e32f98eb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:52,863 - lava_callback - INFO - Received callback for node 69def698f490930782fbb484 INFO: 172.21.0.1:50010 - "POST /node/69def698f490930782fbb484 HTTP/1.0" 202 Accepted 2026-04-15 02:30:52,870 - lava_callback - INFO - Starting async job submit for node 69def698f490930782fbb484 2026-04-15 02:30:52,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:52,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:52,924 - lava_callback - DEBUG - Processing node 69def698f490930782fbb484: baseline-arm64 2026-04-15 02:30:53,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/log.txt.gz 2026-04-15 02:30:53,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/lava-logs.yaml 2026-04-15 02:30:53,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/lava_callback.json.gz DEBUG: Setup failed for 69def698f490930782fbb484. Transitting job node result: incomplete -> fail 2026-04-15 02:30:54,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:30:54,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:54,239 - lava_callback - INFO - Completed processing callback for node 69def698f490930782fbb484 INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:31:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:31:07,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:32:00,175 - lava_callback - INFO - Received callback for node 69dc55905dbfa74e32f98ef3 INFO: 172.21.0.1:50340 - "POST /node/69dc55905dbfa74e32f98ef3 HTTP/1.0" 202 Accepted 2026-04-15 02:32:00,181 - lava_callback - INFO - Starting async job submit for node 69dc55905dbfa74e32f98ef3 2026-04-15 02:32:00,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,206 - lava_callback - DEBUG - Processing node 69dc55905dbfa74e32f98ef3: baseline-arm64-baylibre 2026-04-15 02:32:00,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc55905dbfa74e32f98ef3 2026-04-15 02:32:00,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:32:00,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,264 - lava_callback - ERROR - Error processing callback for node 69dc55905dbfa74e32f98ef3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:33:00,367 - lava_callback - INFO - Received callback for node 69dc55d95dbfa74e32f98f46 INFO: 172.21.0.1:52162 - "POST /node/69dc55d95dbfa74e32f98f46 HTTP/1.0" 202 Accepted 2026-04-15 02:33:00,373 - lava_callback - INFO - Starting async job submit for node 69dc55d95dbfa74e32f98f46 2026-04-15 02:33:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,388 - lava_callback - DEBUG - Processing node 69dc55d95dbfa74e32f98f46: baseline-arm64-baylibre 2026-04-15 02:33:00,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc55d95dbfa74e32f98f46 2026-04-15 02:33:00,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:33:00,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,448 - lava_callback - ERROR - Error processing callback for node 69dc55d95dbfa74e32f98f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:34:20,294 - lava_callback - INFO - Received callback for node 69dc561e5dbfa74e32f98f87 INFO: 172.21.0.1:38838 - "POST /node/69dc561e5dbfa74e32f98f87 HTTP/1.0" 202 Accepted 2026-04-15 02:34:20,299 - lava_callback - INFO - Starting async job submit for node 69dc561e5dbfa74e32f98f87 2026-04-15 02:34:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,315 - lava_callback - DEBUG - Processing node 69dc561e5dbfa74e32f98f87: baseline-arm64-baylibre 2026-04-15 02:34:20,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc561e5dbfa74e32f98f87 2026-04-15 02:34:20,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:34:20,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,363 - lava_callback - ERROR - Error processing callback for node 69dc561e5dbfa74e32f98f87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:35:31,922 - lava_callback - INFO - Received callback for node 69dc565f5dbfa74e32f98ff5 INFO: 172.21.0.1:39024 - "POST /node/69dc565f5dbfa74e32f98ff5 HTTP/1.0" 202 Accepted 2026-04-15 02:35:31,928 - lava_callback - INFO - Starting async job submit for node 69dc565f5dbfa74e32f98ff5 2026-04-15 02:35:31,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,947 - lava_callback - DEBUG - Processing node 69dc565f5dbfa74e32f98ff5: baseline-arm64-clabbe 2026-04-15 02:35:31,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc565f5dbfa74e32f98ff5 2026-04-15 02:35:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:35:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,997 - lava_callback - ERROR - Error processing callback for node 69dc565f5dbfa74e32f98ff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:36:31,935 - lava_callback - INFO - Received callback for node 69dc56a85dbfa74e32f9903a INFO: 172.21.0.1:39706 - "POST /node/69dc56a85dbfa74e32f9903a HTTP/1.0" 202 Accepted 2026-04-15 02:36:31,940 - lava_callback - INFO - Starting async job submit for node 69dc56a85dbfa74e32f9903a 2026-04-15 02:36:31,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:31,957 - lava_callback - DEBUG - Processing node 69dc56a85dbfa74e32f9903a: baseline-arm64-clabbe 2026-04-15 02:36:31,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc56a85dbfa74e32f9903a 2026-04-15 02:36:31,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:31,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:36:31,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:32,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:32,006 - lava_callback - ERROR - Error processing callback for node 69dc56a85dbfa74e32f9903a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:37:31,967 - lava_callback - INFO - Received callback for node 69dc56e75dbfa74e32f9909e INFO: 172.21.0.1:35782 - "POST /node/69dc56e75dbfa74e32f9909e HTTP/1.0" 202 Accepted 2026-04-15 02:37:31,973 - lava_callback - INFO - Starting async job submit for node 69dc56e75dbfa74e32f9909e 2026-04-15 02:37:31,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:31,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:31,988 - lava_callback - DEBUG - Processing node 69dc56e75dbfa74e32f9909e: baseline-arm64-clabbe 2026-04-15 02:37:31,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc56e75dbfa74e32f9909e 2026-04-15 02:37:31,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:37:32,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:32,041 - lava_callback - ERROR - Error processing callback for node 69dc56e75dbfa74e32f9909e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:40:10,695 - lava_callback - INFO - Received callback for node 69def670f490930782fbb45e INFO: 172.21.0.1:38854 - "POST /node/69def670f490930782fbb45e HTTP/1.0" 202 Accepted 2026-04-15 02:40:10,703 - lava_callback - INFO - Starting async job submit for node 69def670f490930782fbb45e 2026-04-15 02:40:10,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:10,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:10,778 - lava_callback - DEBUG - Processing node 69def670f490930782fbb45e: baseline-arm 2026-04-15 02:40:11,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:11,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:11,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/log.txt.gz 2026-04-15 02:40:11,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:12,096 - lava_callback - INFO - Received callback for node 69dc57765dbfa74e32f99114 INFO: 172.21.0.1:38862 - "POST /node/69dc57765dbfa74e32f99114 HTTP/1.0" 202 Accepted 2026-04-15 02:40:12,102 - lava_callback - INFO - Starting async job submit for node 69dc57765dbfa74e32f99114 2026-04-15 02:40:12,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,124 - lava_callback - DEBUG - Processing node 69dc57765dbfa74e32f99114: baseline-arm64-clabbe 2026-04-15 02:40:12,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57765dbfa74e32f99114 2026-04-15 02:40:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:12,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/lava-logs.yaml 2026-04-15 02:40:12,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:40:12,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,196 - lava_callback - ERROR - Error processing callback for node 69dc57765dbfa74e32f99114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:40:12,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:12,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/lava_callback.json.gz DEBUG: Setup failed for 69def670f490930782fbb45e. Transitting job node result: incomplete -> fail 2026-04-15 02:40:12,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:40:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:12,789 - lava_callback - INFO - Completed processing callback for node 69def670f490930782fbb45e INFO: 172.21.0.1:38870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:40:37,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:41:12,130 - lava_callback - INFO - Received callback for node 69dc57b95dbfa74e32f9915e INFO: 172.21.0.1:37664 - "POST /node/69dc57b95dbfa74e32f9915e HTTP/1.0" 202 Accepted 2026-04-15 02:41:12,136 - lava_callback - INFO - Starting async job submit for node 69dc57b95dbfa74e32f9915e 2026-04-15 02:41:12,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,153 - lava_callback - DEBUG - Processing node 69dc57b95dbfa74e32f9915e: baseline-arm64-clabbe 2026-04-15 02:41:12,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57b95dbfa74e32f9915e 2026-04-15 02:41:12,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:41:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,208 - lava_callback - ERROR - Error processing callback for node 69dc57b95dbfa74e32f9915e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:42:12,188 - lava_callback - INFO - Received callback for node 69dc57f95dbfa74e32f991c2 INFO: 172.21.0.1:34388 - "POST /node/69dc57f95dbfa74e32f991c2 HTTP/1.0" 202 Accepted 2026-04-15 02:42:12,194 - lava_callback - INFO - Starting async job submit for node 69dc57f95dbfa74e32f991c2 2026-04-15 02:42:12,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,210 - lava_callback - DEBUG - Processing node 69dc57f95dbfa74e32f991c2: baseline-arm64-clabbe 2026-04-15 02:42:12,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57f95dbfa74e32f991c2 2026-04-15 02:42:12,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:42:12,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,260 - lava_callback - ERROR - Error processing callback for node 69dc57f95dbfa74e32f991c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:43:32,220 - lava_callback - INFO - Received callback for node 69dc58415dbfa74e32f991f3 INFO: 172.21.0.1:59022 - "POST /node/69dc58415dbfa74e32f991f3 HTTP/1.0" 202 Accepted 2026-04-15 02:43:32,226 - lava_callback - INFO - Starting async job submit for node 69dc58415dbfa74e32f991f3 2026-04-15 02:43:32,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,244 - lava_callback - DEBUG - Processing node 69dc58415dbfa74e32f991f3: baseline-arm64-clabbe 2026-04-15 02:43:32,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58415dbfa74e32f991f3 2026-04-15 02:43:32,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:43:32,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,293 - lava_callback - ERROR - Error processing callback for node 69dc58415dbfa74e32f991f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:44:40,929 - lava_callback - INFO - Received callback for node 69dc58945dbfa74e32f99246 INFO: 172.21.0.1:39016 - "POST /node/69dc58945dbfa74e32f99246 HTTP/1.0" 202 Accepted 2026-04-15 02:44:40,935 - lava_callback - INFO - Starting async job submit for node 69dc58945dbfa74e32f99246 2026-04-15 02:44:40,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:40,953 - lava_callback - DEBUG - Processing node 69dc58945dbfa74e32f99246: baseline-arm-baylibre 2026-04-15 02:44:40,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58945dbfa74e32f99246 2026-04-15 02:44:40,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:40,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:44:40,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:41,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:41,017 - lava_callback - ERROR - Error processing callback for node 69dc58945dbfa74e32f99246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:45:20,800 - lava_callback - INFO - Received callback for node 69dc58b05dbfa74e32f9927a INFO: 172.21.0.1:59290 - "POST /node/69dc58b05dbfa74e32f9927a HTTP/1.0" 202 Accepted 2026-04-15 02:45:20,806 - lava_callback - INFO - Starting async job submit for node 69dc58b05dbfa74e32f9927a 2026-04-15 02:45:20,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,827 - lava_callback - DEBUG - Processing node 69dc58b05dbfa74e32f9927a: baseline-arm-baylibre 2026-04-15 02:45:20,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58b05dbfa74e32f9927a 2026-04-15 02:45:20,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:45:20,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,880 - lava_callback - ERROR - Error processing callback for node 69dc58b05dbfa74e32f9927a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:45:40,782 - lava_callback - INFO - Received callback for node 69dc58d35dbfa74e32f992af INFO: 172.21.0.1:60708 - "POST /node/69dc58d35dbfa74e32f992af HTTP/1.0" 202 Accepted 2026-04-15 02:45:40,788 - lava_callback - INFO - Starting async job submit for node 69dc58d35dbfa74e32f992af 2026-04-15 02:45:40,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,804 - lava_callback - DEBUG - Processing node 69dc58d35dbfa74e32f992af: baseline-arm-baylibre 2026-04-15 02:45:40,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58d35dbfa74e32f992af 2026-04-15 02:45:40,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:45:40,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,869 - lava_callback - ERROR - Error processing callback for node 69dc58d35dbfa74e32f992af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:20,866 - lava_callback - INFO - Received callback for node 69dc58f05dbfa74e32f992d4 INFO: 172.21.0.1:49374 - "POST /node/69dc58f05dbfa74e32f992d4 HTTP/1.0" 202 Accepted 2026-04-15 02:46:20,871 - lava_callback - INFO - Starting async job submit for node 69dc58f05dbfa74e32f992d4 2026-04-15 02:46:20,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,887 - lava_callback - DEBUG - Processing node 69dc58f05dbfa74e32f992d4: baseline-arm-baylibre 2026-04-15 02:46:20,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58f05dbfa74e32f992d4 2026-04-15 02:46:20,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:46:20,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,949 - lava_callback - ERROR - Error processing callback for node 69dc58f05dbfa74e32f992d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:52,392 - lava_callback - INFO - Received callback for node 69dc59105dbfa74e32f99305 INFO: 172.21.0.1:44968 - "POST /node/69dc59105dbfa74e32f99305 HTTP/1.0" 202 Accepted 2026-04-15 02:46:52,398 - lava_callback - INFO - Starting async job submit for node 69dc59105dbfa74e32f99305 2026-04-15 02:46:52,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,418 - lava_callback - DEBUG - Processing node 69dc59105dbfa74e32f99305: baseline-arm-clabbe 2026-04-15 02:46:52,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59105dbfa74e32f99305 2026-04-15 02:46:52,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:46:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,468 - lava_callback - ERROR - Error processing callback for node 69dc59105dbfa74e32f99305: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:57,730 - lava_callback - INFO - Received callback for node 69def75ef490930782fbb539 INFO: 172.21.0.1:44978 - "POST /node/69def75ef490930782fbb539 HTTP/1.0" 202 Accepted 2026-04-15 02:46:57,736 - lava_callback - INFO - Starting async job submit for node 69def75ef490930782fbb539 2026-04-15 02:46:57,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:57,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:57,796 - lava_callback - DEBUG - Processing node 69def75ef490930782fbb539: baseline-x86 2026-04-15 02:46:58,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:58,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:58,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/log.txt.gz 2026-04-15 02:46:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:59,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:59,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/lava-logs.yaml 2026-04-15 02:46:59,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:59,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/lava_callback.json.gz DEBUG: Setup failed for 69def75ef490930782fbb539. Transitting job node result: incomplete -> fail 2026-04-15 02:46:59,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:59,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 02:46:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:59,517 - lava_callback - INFO - Completed processing callback for node 69def75ef490930782fbb539 INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:32,357 - lava_callback - INFO - Received callback for node 69dc59315dbfa74e32f9932d INFO: 172.21.0.1:51496 - "POST /node/69dc59315dbfa74e32f9932d HTTP/1.0" 202 Accepted 2026-04-15 02:47:32,363 - lava_callback - INFO - Starting async job submit for node 69dc59315dbfa74e32f9932d 2026-04-15 02:47:32,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,379 - lava_callback - DEBUG - Processing node 69dc59315dbfa74e32f9932d: baseline-arm-clabbe 2026-04-15 02:47:32,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59315dbfa74e32f9932d 2026-04-15 02:47:32,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:47:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,436 - lava_callback - ERROR - Error processing callback for node 69dc59315dbfa74e32f9932d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:52,391 - lava_callback - INFO - Received callback for node 69dc59515dbfa74e32f99344 INFO: 172.21.0.1:48758 - "POST /node/69dc59515dbfa74e32f99344 HTTP/1.0" 202 Accepted 2026-04-15 02:47:52,396 - lava_callback - INFO - Starting async job submit for node 69dc59515dbfa74e32f99344 2026-04-15 02:47:52,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,412 - lava_callback - DEBUG - Processing node 69dc59515dbfa74e32f99344: baseline-arm-clabbe 2026-04-15 02:47:52,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59515dbfa74e32f99344 2026-04-15 02:47:52,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:47:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,476 - lava_callback - ERROR - Error processing callback for node 69dc59515dbfa74e32f99344: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:48:30,379 - lava_callback - INFO - Received callback for node 69defb98f490930782fbb9b9 INFO: 172.21.0.1:60562 - "POST /node/69defb98f490930782fbb9b9 HTTP/1.0" 202 Accepted 2026-04-15 02:48:30,386 - lava_callback - INFO - Starting async job submit for node 69defb98f490930782fbb9b9 2026-04-15 02:48:30,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:30,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:30,441 - lava_callback - DEBUG - Processing node 69defb98f490930782fbb9b9: ltp-smoke 2026-04-15 02:48:30,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:30,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:30,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/log.txt.gz 2026-04-15 02:48:31,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:31,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:31,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/lava-logs.yaml 2026-04-15 02:48:31,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:31,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:31,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/lava_callback.json.gz 2026-04-15 02:48:31,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:31,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:48:31,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:31,650 - lava_callback - INFO - Completed processing callback for node 69defb98f490930782fbb9b9 2026-04-15 02:48:32,403 - lava_callback - INFO - Received callback for node 69dc59755dbfa74e32f9937a INFO: 172.21.0.1:60572 - "POST /node/69dc59755dbfa74e32f9937a HTTP/1.0" 202 Accepted 2026-04-15 02:48:32,409 - lava_callback - INFO - Starting async job submit for node 69dc59755dbfa74e32f9937a 2026-04-15 02:48:32,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,428 - lava_callback - DEBUG - Processing node 69dc59755dbfa74e32f9937a: baseline-arm-clabbe 2026-04-15 02:48:32,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59755dbfa74e32f9937a 2026-04-15 02:48:32,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:48:32,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,485 - lava_callback - ERROR - Error processing callback for node 69dc59755dbfa74e32f9937a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:48:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:37,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:49:12,485 - lava_callback - INFO - Received callback for node 69dc59945dbfa74e32f993a3 INFO: 172.21.0.1:57488 - "POST /node/69dc59945dbfa74e32f993a3 HTTP/1.0" 202 Accepted 2026-04-15 02:49:12,491 - lava_callback - INFO - Starting async job submit for node 69dc59945dbfa74e32f993a3 2026-04-15 02:49:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,507 - lava_callback - DEBUG - Processing node 69dc59945dbfa74e32f993a3: baseline-arm-clabbe 2026-04-15 02:49:12,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59945dbfa74e32f993a3 2026-04-15 02:49:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:49:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,559 - lava_callback - ERROR - Error processing callback for node 69dc59945dbfa74e32f993a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET /node/698a40c922b4cc0f227b05bc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:49:32,457 - lava_callback - INFO - Received callback for node 69dc59b45dbfa74e32f993cd INFO: 172.21.0.1:37474 - "POST /node/69dc59b45dbfa74e32f993cd HTTP/1.0" 202 Accepted 2026-04-15 02:49:32,463 - lava_callback - INFO - Starting async job submit for node 69dc59b45dbfa74e32f993cd 2026-04-15 02:49:32,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,479 - lava_callback - DEBUG - Processing node 69dc59b45dbfa74e32f993cd: baseline-arm-clabbe 2026-04-15 02:49:32,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59b45dbfa74e32f993cd 2026-04-15 02:49:32,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:49:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,535 - lava_callback - ERROR - Error processing callback for node 69dc59b45dbfa74e32f993cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:50:12,603 - lava_callback - INFO - Received callback for node 69dc59d45dbfa74e32f993ee INFO: 172.21.0.1:56972 - "POST /node/69dc59d45dbfa74e32f993ee HTTP/1.0" 202 Accepted 2026-04-15 02:50:12,609 - lava_callback - INFO - Starting async job submit for node 69dc59d45dbfa74e32f993ee 2026-04-15 02:50:12,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,625 - lava_callback - DEBUG - Processing node 69dc59d45dbfa74e32f993ee: baseline-arm-clabbe 2026-04-15 02:50:12,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59d45dbfa74e32f993ee 2026-04-15 02:50:12,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:50:12,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,683 - lava_callback - ERROR - Error processing callback for node 69dc59d45dbfa74e32f993ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:50:32,508 - lava_callback - INFO - Received callback for node 69dc59f25dbfa74e32f99423 INFO: 172.21.0.1:45666 - "POST /node/69dc59f25dbfa74e32f99423 HTTP/1.0" 202 Accepted 2026-04-15 02:50:32,513 - lava_callback - INFO - Starting async job submit for node 69dc59f25dbfa74e32f99423 2026-04-15 02:50:32,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,535 - lava_callback - DEBUG - Processing node 69dc59f25dbfa74e32f99423: baseline-arm-clabbe 2026-04-15 02:50:32,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59f25dbfa74e32f99423 2026-04-15 02:50:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:50:32,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,586 - lava_callback - ERROR - Error processing callback for node 69dc59f25dbfa74e32f99423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:51:12,638 - lava_callback - INFO - Received callback for node 69dc5a105dbfa74e32f99454 INFO: 172.21.0.1:49928 - "POST /node/69dc5a105dbfa74e32f99454 HTTP/1.0" 202 Accepted 2026-04-15 02:51:12,644 - lava_callback - INFO - Starting async job submit for node 69dc5a105dbfa74e32f99454 2026-04-15 02:51:12,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,661 - lava_callback - DEBUG - Processing node 69dc5a105dbfa74e32f99454: baseline-arm-clabbe 2026-04-15 02:51:12,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a105dbfa74e32f99454 2026-04-15 02:51:12,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:51:12,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,713 - lava_callback - ERROR - Error processing callback for node 69dc5a105dbfa74e32f99454: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:51:41,213 - lava_callback - INFO - Received callback for node 69dc5a365dbfa74e32f9946d INFO: 172.21.0.1:60128 - "POST /node/69dc5a365dbfa74e32f9946d HTTP/1.0" 202 Accepted 2026-04-15 02:51:41,219 - lava_callback - INFO - Starting async job submit for node 69dc5a365dbfa74e32f9946d 2026-04-15 02:51:41,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,237 - lava_callback - DEBUG - Processing node 69dc5a365dbfa74e32f9946d: baseline-arm64-baylibre 2026-04-15 02:51:41,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a365dbfa74e32f9946d 2026-04-15 02:51:41,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:51:41,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,296 - lava_callback - ERROR - Error processing callback for node 69dc5a365dbfa74e32f9946d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:53:01,197 - lava_callback - INFO - Received callback for node 69dc5a7f5dbfa74e32f99495 INFO: 172.21.0.1:46764 - "POST /node/69dc5a7f5dbfa74e32f99495 HTTP/1.0" 202 Accepted 2026-04-15 02:53:01,204 - lava_callback - INFO - Starting async job submit for node 69dc5a7f5dbfa74e32f99495 2026-04-15 02:53:01,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,220 - lava_callback - DEBUG - Processing node 69dc5a7f5dbfa74e32f99495: baseline-arm64-baylibre 2026-04-15 02:53:01,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a7f5dbfa74e32f99495 2026-04-15 02:53:01,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:53:01,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,271 - lava_callback - ERROR - Error processing callback for node 69dc5a7f5dbfa74e32f99495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:01,249 - lava_callback - INFO - Received callback for node 69dc5abf5dbfa74e32f99506 INFO: 172.21.0.1:46274 - "POST /node/69dc5abf5dbfa74e32f99506 HTTP/1.0" 202 Accepted 2026-04-15 02:54:01,255 - lava_callback - INFO - Starting async job submit for node 69dc5abf5dbfa74e32f99506 2026-04-15 02:54:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,271 - lava_callback - DEBUG - Processing node 69dc5abf5dbfa74e32f99506: baseline-arm64-baylibre 2026-04-15 02:54:01,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5abf5dbfa74e32f99506 2026-04-15 02:54:01,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:54:01,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,321 - lava_callback - ERROR - Error processing callback for node 69dc5abf5dbfa74e32f99506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:25,527 - lava_callback - INFO - Received callback for node 69def93df490930782fbb761 INFO: 172.21.0.1:51136 - "POST /node/69def93df490930782fbb761 HTTP/1.0" 202 Accepted 2026-04-15 02:54:25,536 - lava_callback - INFO - Starting async job submit for node 69def93df490930782fbb761 2026-04-15 02:54:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:25,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:25,630 - lava_callback - DEBUG - Processing node 69def93df490930782fbb761: baseline-nfs-arm64 INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:26,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:27,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:27,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/log.txt.gz 2026-04-15 02:54:27,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:28,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:28,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/lava-logs.yaml 2026-04-15 02:54:28,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:28,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:28,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/lava_callback.json.gz DEBUG: Setup failed for 69def93df490930782fbb761. Transitting job node result: incomplete -> fail 2026-04-15 02:54:28,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:54:28,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:28,498 - lava_callback - INFO - Completed processing callback for node 69def93df490930782fbb761 INFO: 172.21.0.1:46538 - "GET /node/693f77160d8ce4018da945c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:37,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET /node/69894d8a85773790cd34e331%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:55:21,488 - lava_callback - INFO - Received callback for node 69dc5b095dbfa74e32f99531 INFO: 172.21.0.1:52446 - "POST /node/69dc5b095dbfa74e32f99531 HTTP/1.0" 202 Accepted 2026-04-15 02:55:21,493 - lava_callback - INFO - Starting async job submit for node 69dc5b095dbfa74e32f99531 2026-04-15 02:55:21,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,510 - lava_callback - DEBUG - Processing node 69dc5b095dbfa74e32f99531: baseline-arm64-baylibre 2026-04-15 02:55:21,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b095dbfa74e32f99531 2026-04-15 02:55:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:55:21,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,581 - lava_callback - ERROR - Error processing callback for node 69dc5b095dbfa74e32f99531: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /node/699363a4cebe99dd8e063f4c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57362 - "GET /node/698a80bcd9a1cfa777a23317%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 02:56:21,414 - lava_callback - INFO - Received callback for node 69dc5b4c5dbfa74e32f9956a INFO: 172.21.0.1:57368 - "POST /node/69dc5b4c5dbfa74e32f9956a HTTP/1.0" 202 Accepted 2026-04-15 02:56:21,420 - lava_callback - INFO - Starting async job submit for node 69dc5b4c5dbfa74e32f9956a 2026-04-15 02:56:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,436 - lava_callback - DEBUG - Processing node 69dc5b4c5dbfa74e32f9956a: baseline-arm64-baylibre 2026-04-15 02:56:21,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b4c5dbfa74e32f9956a 2026-04-15 02:56:21,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:56:21,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,511 - lava_callback - ERROR - Error processing callback for node 69dc5b4c5dbfa74e32f9956a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:11,601 - lava_callback - INFO - Received callback for node 69defa6af490930782fbb88c INFO: 172.21.0.1:47514 - "POST /node/69defa6af490930782fbb88c HTTP/1.0" 202 Accepted 2026-04-15 02:57:11,608 - lava_callback - INFO - Starting async job submit for node 69defa6af490930782fbb88c 2026-04-15 02:57:11,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:11,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:11,682 - lava_callback - DEBUG - Processing node 69defa6af490930782fbb88c: ltp-smoke 2026-04-15 02:57:12,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/log.txt.gz 2026-04-15 02:57:12,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/lava-logs.yaml 2026-04-15 02:57:12,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/lava_callback.json.gz 2026-04-15 02:57:13,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:13,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 02:57:13,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:13,313 - lava_callback - INFO - Completed processing callback for node 69defa6af490930782fbb88c INFO: 172.21.0.1:47516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:21,565 - lava_callback - INFO - Received callback for node 69dc5b8b5dbfa74e32f995cf INFO: 172.21.0.1:57956 - "POST /node/69dc5b8b5dbfa74e32f995cf HTTP/1.0" 202 Accepted 2026-04-15 02:57:21,571 - lava_callback - INFO - Starting async job submit for node 69dc5b8b5dbfa74e32f995cf 2026-04-15 02:57:21,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,587 - lava_callback - DEBUG - Processing node 69dc5b8b5dbfa74e32f995cf: baseline-arm64-baylibre 2026-04-15 02:57:21,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b8b5dbfa74e32f995cf 2026-04-15 02:57:21,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:57:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,634 - lava_callback - ERROR - Error processing callback for node 69dc5b8b5dbfa74e32f995cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:57:24,494 - lava_callback - INFO - Received callback for node 69def9caf490930782fbb806 INFO: 172.21.0.1:57962 - "POST /node/69def9caf490930782fbb806 HTTP/1.0" 202 Accepted 2026-04-15 02:57:24,502 - lava_callback - INFO - Starting async job submit for node 69def9caf490930782fbb806 2026-04-15 02:57:24,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:24,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:24,558 - lava_callback - DEBUG - Processing node 69def9caf490930782fbb806: baseline-nfs-arm64 2026-04-15 02:57:25,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:25,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:25,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/log.txt.gz 2026-04-15 02:57:25,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:25,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:25,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/lava-logs.yaml 2026-04-15 02:57:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:26,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:26,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/lava_callback.json.gz DEBUG: Setup failed for 69def9caf490930782fbb806. Transitting job node result: incomplete -> fail 2026-04-15 02:57:26,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:57:26,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:26,265 - lava_callback - INFO - Completed processing callback for node 69def9caf490930782fbb806 INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:37,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:37,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52598 - "GET /node/69b913100ec88e58bad0d8a9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:58:32,985 - lava_callback - INFO - Received callback for node 69dc5bd65dbfa74e32f99620 INFO: 172.21.0.1:57058 - "POST /node/69dc5bd65dbfa74e32f99620 HTTP/1.0" 202 Accepted 2026-04-15 02:58:32,991 - lava_callback - INFO - Starting async job submit for node 69dc5bd65dbfa74e32f99620 2026-04-15 02:58:32,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,011 - lava_callback - DEBUG - Processing node 69dc5bd65dbfa74e32f99620: baseline-arm64-clabbe 2026-04-15 02:58:33,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5bd65dbfa74e32f99620 2026-04-15 02:58:33,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:58:33,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,065 - lava_callback - ERROR - Error processing callback for node 69dc5bd65dbfa74e32f99620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET /node/695c09605dac150a0e838c26%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43126 - "GET /node/6919e16040db568ee36c906c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:59:53,018 - lava_callback - INFO - Received callback for node 69dc5c155dbfa74e32f9967d INFO: 172.21.0.1:38456 - "POST /node/69dc5c155dbfa74e32f9967d HTTP/1.0" 202 Accepted 2026-04-15 02:59:53,024 - lava_callback - INFO - Starting async job submit for node 69dc5c155dbfa74e32f9967d 2026-04-15 02:59:53,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,040 - lava_callback - DEBUG - Processing node 69dc5c155dbfa74e32f9967d: baseline-arm64-clabbe 2026-04-15 02:59:53,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c155dbfa74e32f9967d 2026-04-15 02:59:53,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:59:53,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,104 - lava_callback - ERROR - Error processing callback for node 69dc5c155dbfa74e32f9967d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:01,864 - lava_callback - INFO - Received callback for node 69deff1cf490930782fbbe0c INFO: 172.21.0.1:40962 - "POST /node/69deff1cf490930782fbbe0c HTTP/1.0" 202 Accepted 2026-04-15 03:00:01,869 - lava_callback - INFO - Starting async job submit for node 69deff1cf490930782fbbe0c 2026-04-15 03:00:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:01,886 - lava_callback - DEBUG - Processing node 69deff1cf490930782fbbe0c: baseline-nfs-arm64 2026-04-15 03:00:01,887 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:00:01,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:00:02,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:00:02,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69deff1cf490930782fbbe0c/lava-logs.yaml 2026-04-15 03:00:02,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:00:02,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:00:02,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69deff1cf490930782fbbe0c/lava_callback.json.gz 2026-04-15 03:00:02,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:02,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:00:02,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:02,285 - lava_callback - INFO - Completed processing callback for node 69deff1cf490930782fbbe0c INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:07,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:07,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:53,117 - lava_callback - INFO - Received callback for node 69dc5c5c5dbfa74e32f996c3 INFO: 172.21.0.1:46228 - "POST /node/69dc5c5c5dbfa74e32f996c3 HTTP/1.0" 202 Accepted 2026-04-15 03:00:53,123 - lava_callback - INFO - Starting async job submit for node 69dc5c5c5dbfa74e32f996c3 2026-04-15 03:00:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,138 - lava_callback - DEBUG - Processing node 69dc5c5c5dbfa74e32f996c3: baseline-arm64-clabbe 2026-04-15 03:00:53,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c5c5dbfa74e32f996c3 2026-04-15 03:00:53,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:00:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,191 - lava_callback - ERROR - Error processing callback for node 69dc5c5c5dbfa74e32f996c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46244 - "GET /node/6992ea2a31166481c8dd8bb2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:32,640 - lava_callback - INFO - Received callback for node 69deff5cf490930782fbbe5e INFO: 172.21.0.1:37254 - "POST /node/69deff5cf490930782fbbe5e HTTP/1.0" 202 Accepted 2026-04-15 03:01:32,647 - lava_callback - INFO - Starting async job submit for node 69deff5cf490930782fbbe5e 2026-04-15 03:01:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:32,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:32,697 - lava_callback - DEBUG - Processing node 69deff5cf490930782fbbe5e: baseline-arm64 2026-04-15 03:01:32,851 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:01:32,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:01:33,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:01:33,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69deff5cf490930782fbbe5e/lava-logs.yaml 2026-04-15 03:01:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:01:33,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:01:33,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69deff5cf490930782fbbe5e/lava_callback.json.gz 2026-04-15 03:01:33,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:33,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:01:33,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:33,499 - lava_callback - INFO - Completed processing callback for node 69deff5cf490930782fbbe5e INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:37,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:37,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:53,129 - lava_callback - INFO - Received callback for node 69dc5c9b5dbfa74e32f99721 INFO: 172.21.0.1:58490 - "POST /node/69dc5c9b5dbfa74e32f99721 HTTP/1.0" 202 Accepted 2026-04-15 03:01:53,135 - lava_callback - INFO - Starting async job submit for node 69dc5c9b5dbfa74e32f99721 2026-04-15 03:01:53,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,151 - lava_callback - DEBUG - Processing node 69dc5c9b5dbfa74e32f99721: baseline-arm64-clabbe 2026-04-15 03:01:53,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c9b5dbfa74e32f99721 2026-04-15 03:01:53,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:01:53,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,199 - lava_callback - ERROR - Error processing callback for node 69dc5c9b5dbfa74e32f99721: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:03:13,247 - lava_callback - INFO - Received callback for node 69dc5cde5dbfa74e32f9978b INFO: 172.21.0.1:47376 - "POST /node/69dc5cde5dbfa74e32f9978b HTTP/1.0" 202 Accepted 2026-04-15 03:03:13,252 - lava_callback - INFO - Starting async job submit for node 69dc5cde5dbfa74e32f9978b 2026-04-15 03:03:13,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,268 - lava_callback - DEBUG - Processing node 69dc5cde5dbfa74e32f9978b: baseline-arm64-clabbe 2026-04-15 03:03:13,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5cde5dbfa74e32f9978b 2026-04-15 03:03:13,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:03:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,316 - lava_callback - ERROR - Error processing callback for node 69dc5cde5dbfa74e32f9978b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET /node/693fca36575bc060ce14a1af%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET /node/69b831b80b8ad4124cec369c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:04:13,237 - lava_callback - INFO - Received callback for node 69dc5d215dbfa74e32f997d3 INFO: 172.21.0.1:33718 - "POST /node/69dc5d215dbfa74e32f997d3 HTTP/1.0" 202 Accepted 2026-04-15 03:04:13,242 - lava_callback - INFO - Starting async job submit for node 69dc5d215dbfa74e32f997d3 2026-04-15 03:04:13,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,270 - lava_callback - DEBUG - Processing node 69dc5d215dbfa74e32f997d3: baseline-arm64-clabbe 2026-04-15 03:04:13,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5d215dbfa74e32f997d3 2026-04-15 03:04:13,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:04:13,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,350 - lava_callback - ERROR - Error processing callback for node 69dc5d215dbfa74e32f997d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:05:13,223 - lava_callback - INFO - Received callback for node 69dc5d655dbfa74e32f9981b INFO: 172.21.0.1:51516 - "POST /node/69dc5d655dbfa74e32f9981b HTTP/1.0" 202 Accepted 2026-04-15 03:05:13,228 - lava_callback - INFO - Starting async job submit for node 69dc5d655dbfa74e32f9981b 2026-04-15 03:05:13,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,268 - lava_callback - DEBUG - Processing node 69dc5d655dbfa74e32f9981b: baseline-arm64-clabbe 2026-04-15 03:05:13,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5d655dbfa74e32f9981b 2026-04-15 03:05:13,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:05:13,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,321 - lava_callback - ERROR - Error processing callback for node 69dc5d655dbfa74e32f9981b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET /node/694a309c2060d3d84792197a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET /node/69bc36d017e5cb936602e4d4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET /node/6992680498a8bdb31c3920e1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /node/698e2a85952a14bf500e412f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET /node/6949cd9ad45a0a86fbe282c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60990 - "GET /node/69884c69e408e9ea60fad25c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET /node/6985d90a71989fb14149a896%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57036 - "GET /node/69a00f7662feda9f0694f0f1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET /node/698b8f1f0a16aea5a0dc8ec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET /node/6982ace13507dcddca590696%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET /node/698a41d422b4cc0f227b0687%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET /node/698fcc2d76d4b6342e9d75e5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42842 - "GET /node/698fc5d476d4b6342e9d717a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /node/698524403ff18e47df615276%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45852 - "GET /node/69a3fba36ebb1cc56c1decef%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET /node/69937308cebe99dd8e069d19%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44530 - "GET /node/698a184922b4cc0f227ae507%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:31:24,066 - lava_callback - INFO - Received callback for node 69df064ef490930782fbc5a2 INFO: 172.21.0.1:58276 - "POST /node/69df064ef490930782fbc5a2 HTTP/1.0" 202 Accepted 2026-04-15 03:31:24,073 - lava_callback - INFO - Starting async job submit for node 69df064ef490930782fbc5a2 2026-04-15 03:31:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:24,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:24,121 - lava_callback - DEBUG - Processing node 69df064ef490930782fbc5a2: baseline-arm64 2026-04-15 03:31:24,265 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:31:24,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:31:24,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:31:24,688 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df064ef490930782fbc5a2/lava-logs.yaml 2026-04-15 03:31:24,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:31:25,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:31:25,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df064ef490930782fbc5a2/lava_callback.json.gz 2026-04-15 03:31:25,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:25,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:31:25,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:25,292 - lava_callback - INFO - Completed processing callback for node 69df064ef490930782fbc5a2 INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:31:37,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:37,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:05,929 - lava_callback - INFO - Received callback for node 69df0830f490930782fbc7ca INFO: 172.21.0.1:48594 - "POST /node/69df0830f490930782fbc7ca HTTP/1.0" 202 Accepted 2026-04-15 03:44:05,938 - lava_callback - INFO - Starting async job submit for node 69df0830f490930782fbc7ca 2026-04-15 03:44:05,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:06,008 - lava_callback - DEBUG - Processing node 69df0830f490930782fbc7ca: baseline-arm64-foundriesio INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:07,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:07,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/log.txt.gz 2026-04-15 03:44:08,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:08,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:08,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/lava-logs.yaml 2026-04-15 03:44:08,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:08,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:08,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/lava_callback.json.gz DEBUG: Setup failed for 69df0830f490930782fbc7ca. Transitting job node result: incomplete -> fail 2026-04-15 03:44:08,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:08,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:44:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:08,868 - lava_callback - INFO - Completed processing callback for node 69df0830f490930782fbc7ca INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:37,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:37,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:45:32,944 - lava_callback - INFO - Received callback for node 69df08abf490930782fbc840 INFO: 172.21.0.1:40078 - "POST /node/69df08abf490930782fbc840 HTTP/1.0" 202 Accepted 2026-04-15 03:45:32,950 - lava_callback - INFO - Starting async job submit for node 69df08abf490930782fbc840 2026-04-15 03:45:32,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:32,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:32,990 - lava_callback - DEBUG - Processing node 69df08abf490930782fbc840: baseline-arm64 2026-04-15 03:45:33,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:33,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:33,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/log.txt.gz 2026-04-15 03:45:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:34,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:34,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/lava-logs.yaml 2026-04-15 03:45:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:34,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:34,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/lava_callback.json.gz 2026-04-15 03:45:34,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:45:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:34,364 - lava_callback - INFO - Completed processing callback for node 69df08abf490930782fbc840 INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:45:37,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:37,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:48:32,057 - lava_callback - INFO - Received callback for node 69df0943f490930782fbc8d4 INFO: 172.21.0.1:54568 - "POST /node/69df0943f490930782fbc8d4 HTTP/1.0" 202 Accepted 2026-04-15 03:48:32,064 - lava_callback - INFO - Starting async job submit for node 69df0943f490930782fbc8d4 2026-04-15 03:48:32,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:32,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:32,121 - lava_callback - DEBUG - Processing node 69df0943f490930782fbc8d4: baseline-arm64 2026-04-15 03:48:32,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:32,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:32,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/log.txt.gz 2026-04-15 03:48:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:33,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:33,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/lava-logs.yaml 2026-04-15 03:48:33,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:33,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:33,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/lava_callback.json.gz DEBUG: Setup failed for 69df0943f490930782fbc8d4. Transitting job node result: incomplete -> fail 2026-04-15 03:48:33,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:48:33,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:33,521 - lava_callback - INFO - Completed processing callback for node 69df0943f490930782fbc8d4 INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:48:37,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:37,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:10:14,116 - lava_callback - INFO - Received callback for node 69df0b87f490930782fbcb64 INFO: 172.21.0.1:45988 - "POST /node/69df0b87f490930782fbcb64 HTTP/1.0" 202 Accepted 2026-04-15 04:10:14,122 - lava_callback - INFO - Starting async job submit for node 69df0b87f490930782fbcb64 2026-04-15 04:10:14,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:14,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:14,198 - lava_callback - DEBUG - Processing node 69df0b87f490930782fbcb64: baseline-arm 2026-04-15 04:10:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:14,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:14,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/log.txt.gz INFO: 172.21.0.1:45994 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 04:10:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:15,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:15,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/lava-logs.yaml 2026-04-15 04:10:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:15,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:15,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/lava_callback.json.gz DEBUG: Setup failed for 69df0b87f490930782fbcb64. Transitting job node result: incomplete -> fail 2026-04-15 04:10:15,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:15,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 04:10:15,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:16,027 - lava_callback - INFO - Completed processing callback for node 69df0b87f490930782fbcb64 INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:10:37,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:19:20,311 - lava_callback - INFO - Received callback for node 69df11bef490930782fbd0fe INFO: 172.21.0.1:57938 - "POST /node/69df11bef490930782fbd0fe HTTP/1.0" 202 Accepted 2026-04-15 04:19:20,316 - lava_callback - INFO - Starting async job submit for node 69df11bef490930782fbd0fe 2026-04-15 04:19:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,334 - lava_callback - DEBUG - Processing node 69df11bef490930782fbd0fe: baseline-nfs-arm64 2026-04-15 04:19:20,335 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:19:20,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:19:20,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:19:20,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df11bef490930782fbd0fe/lava-logs.yaml 2026-04-15 04:19:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:19:20,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:19:20,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df11bef490930782fbd0fe/lava_callback.json.gz 2026-04-15 04:19:20,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:19:20,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,798 - lava_callback - INFO - Completed processing callback for node 69df11bef490930782fbd0fe INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:19:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:37,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:21:02,291 - lava_callback - INFO - Received callback for node 69df0d61f490930782fbcd0d INFO: 172.21.0.1:41004 - "POST /node/69df0d61f490930782fbcd0d HTTP/1.0" 202 Accepted 2026-04-15 04:21:02,298 - lava_callback - INFO - Starting async job submit for node 69df0d61f490930782fbcd0d 2026-04-15 04:21:02,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:02,355 - lava_callback - DEBUG - Processing node 69df0d61f490930782fbcd0d: baseline-x86 2026-04-15 04:21:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/log.txt.gz 2026-04-15 04:21:03,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/lava-logs.yaml 2026-04-15 04:21:03,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/lava_callback.json.gz DEBUG: Setup failed for 69df0d61f490930782fbcd0d. Transitting job node result: incomplete -> fail 2026-04-15 04:21:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:03,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 04:21:03,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:04,016 - lava_callback - INFO - Completed processing callback for node 69df0d61f490930782fbcd0d INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:21:07,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:07,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 04:22:15,997 - lava_callback - INFO - Received callback for node 69df124af490930782fbd17c INFO: 172.21.0.1:52484 - "POST /node/69df124af490930782fbd17c HTTP/1.0" 202 Accepted 2026-04-15 04:22:16,005 - lava_callback - INFO - Starting async job submit for node 69df124af490930782fbd17c 2026-04-15 04:22:16,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,050 - lava_callback - DEBUG - Processing node 69df124af490930782fbd17c: baseline-arm64 2026-04-15 04:22:16,187 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:22:16,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:22:16,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:22:16,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df124af490930782fbd17c/lava-logs.yaml 2026-04-15 04:22:16,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:22:16,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:22:16,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df124af490930782fbd17c/lava_callback.json.gz 2026-04-15 04:22:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:22:16,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,747 - lava_callback - INFO - Completed processing callback for node 69df124af490930782fbd17c INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:22:37,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:29:00,817 - lava_callback - INFO - Received callback for node 69df0f69f490930782fbcefa INFO: 172.21.0.1:51866 - "POST /node/69df0f69f490930782fbcefa HTTP/1.0" 202 Accepted 2026-04-15 04:29:00,826 - lava_callback - INFO - Starting async job submit for node 69df0f69f490930782fbcefa 2026-04-15 04:29:00,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:00,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:00,886 - lava_callback - DEBUG - Processing node 69df0f69f490930782fbcefa: baseline-nfs-arm64 2026-04-15 04:29:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:02,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:02,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/log.txt.gz 2026-04-15 04:29:03,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:03,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:03,765 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/lava-logs.yaml 2026-04-15 04:29:03,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:03,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:03,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/lava_callback.json.gz DEBUG: Setup failed for 69df0f69f490930782fbcefa. Transitting job node result: incomplete -> fail 2026-04-15 04:29:04,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:04,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:29:04,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:04,251 - lava_callback - INFO - Completed processing callback for node 69df0f69f490930782fbcefa INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:29:07,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:07,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:30:35,736 - lava_callback - INFO - Received callback for node 69df1043f490930782fbcfa9 INFO: 172.21.0.1:55736 - "POST /node/69df1043f490930782fbcfa9 HTTP/1.0" 202 Accepted 2026-04-15 04:30:35,743 - lava_callback - INFO - Starting async job submit for node 69df1043f490930782fbcfa9 2026-04-15 04:30:35,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:35,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:35,816 - lava_callback - DEBUG - Processing node 69df1043f490930782fbcfa9: ltp-smoke 2026-04-15 04:30:36,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:30:36,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:36,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/log.txt.gz 2026-04-15 04:30:36,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:30:37,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:37,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/lava-logs.yaml 2026-04-15 04:30:37,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:30:37,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:37,272 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/lava_callback.json.gz 2026-04-15 04:30:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:37,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 04:30:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:37,539 - lava_callback - INFO - Completed processing callback for node 69df1043f490930782fbcfa9 2026-04-15 04:30:37,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:34:36,685 - lava_callback - INFO - Received callback for node 69df1099f490930782fbcfff INFO: 172.21.0.1:46900 - "POST /node/69df1099f490930782fbcfff HTTP/1.0" 202 Accepted 2026-04-15 04:34:36,693 - lava_callback - INFO - Starting async job submit for node 69df1099f490930782fbcfff 2026-04-15 04:34:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:36,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:36,762 - lava_callback - DEBUG - Processing node 69df1099f490930782fbcfff: baseline-nfs-arm64 2026-04-15 04:34:37,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:37,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:37,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/log.txt.gz 2026-04-15 04:34:38,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:38,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:38,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/lava-logs.yaml 2026-04-15 04:34:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:38,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:38,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/lava_callback.json.gz DEBUG: Setup failed for 69df1099f490930782fbcfff. Transitting job node result: incomplete -> fail 2026-04-15 04:34:38,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:34:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:39,045 - lava_callback - INFO - Completed processing callback for node 69df1099f490930782fbcfff INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:35:07,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:35:07,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET /node/693ae813fee8383e92b6563c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57024 - "GET /node/6986fdfe6e077e4126a7d8fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:39:06,079 - lava_callback - INFO - Received callback for node 69df1634f490930782fbd515 INFO: 172.21.0.1:33940 - "POST /node/69df1634f490930782fbd515 HTTP/1.0" 202 Accepted 2026-04-15 04:39:06,086 - lava_callback - INFO - Starting async job submit for node 69df1634f490930782fbd515 2026-04-15 04:39:06,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,132 - lava_callback - DEBUG - Processing node 69df1634f490930782fbd515: baseline-arm64 2026-04-15 04:39:06,276 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:39:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:39:06,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:39:06,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1634f490930782fbd515/lava-logs.yaml 2026-04-15 04:39:06,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:39:06,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:39:06,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1634f490930782fbd515/lava_callback.json.gz 2026-04-15 04:39:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:39:06,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,959 - lava_callback - INFO - Completed processing callback for node 69df1634f490930782fbd515 2026-04-15 04:39:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET /node/698d62ee820eff0a56c16925%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /node/698f87313013abef95d02349%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52950 - "GET /node/693f16d024745582e399b040%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:42:47,361 - lava_callback - INFO - Received callback for node 69dc74425dbfa74e32f99903 INFO: 172.21.0.1:54390 - "POST /node/69dc74425dbfa74e32f99903 HTTP/1.0" 202 Accepted 2026-04-15 04:42:47,367 - lava_callback - INFO - Starting async job submit for node 69dc74425dbfa74e32f99903 2026-04-15 04:42:47,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,388 - lava_callback - DEBUG - Processing node 69dc74425dbfa74e32f99903: baseline-arm-baylibre 2026-04-15 04:42:47,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74425dbfa74e32f99903 2026-04-15 04:42:47,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:42:47,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,435 - lava_callback - ERROR - Error processing callback for node 69dc74425dbfa74e32f99903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:43:47,387 - lava_callback - INFO - Received callback for node 69dc747b5dbfa74e32f99945 INFO: 172.21.0.1:40156 - "POST /node/69dc747b5dbfa74e32f99945 HTTP/1.0" 202 Accepted 2026-04-15 04:43:47,393 - lava_callback - INFO - Starting async job submit for node 69dc747b5dbfa74e32f99945 2026-04-15 04:43:47,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,418 - lava_callback - DEBUG - Processing node 69dc747b5dbfa74e32f99945: baseline-arm-baylibre 2026-04-15 04:43:47,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc747b5dbfa74e32f99945 2026-04-15 04:43:47,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:43:47,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,577 - lava_callback - ERROR - Error processing callback for node 69dc747b5dbfa74e32f99945: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:27,475 - lava_callback - INFO - Received callback for node 69dc749a5dbfa74e32f99954 INFO: 172.21.0.1:53426 - "POST /node/69dc749a5dbfa74e32f99954 HTTP/1.0" 202 Accepted 2026-04-15 04:44:27,482 - lava_callback - INFO - Starting async job submit for node 69dc749a5dbfa74e32f99954 2026-04-15 04:44:27,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,498 - lava_callback - DEBUG - Processing node 69dc749a5dbfa74e32f99954: baseline-arm-baylibre 2026-04-15 04:44:27,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc749a5dbfa74e32f99954 2026-04-15 04:44:27,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:44:27,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,558 - lava_callback - ERROR - Error processing callback for node 69dc749a5dbfa74e32f99954: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 04:44:34,616 - lava_callback - INFO - Received callback for node 69df16c4f490930782fbd5b4 INFO: 172.21.0.1:44360 - "POST /node/69df16c4f490930782fbd5b4 HTTP/1.0" 202 Accepted 2026-04-15 04:44:34,622 - lava_callback - INFO - Starting async job submit for node 69df16c4f490930782fbd5b4 2026-04-15 04:44:34,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:34,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:34,655 - lava_callback - DEBUG - Processing node 69df16c4f490930782fbd5b4: baseline-arm64 2026-04-15 04:44:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/log.txt.gz 2026-04-15 04:44:35,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/lava-logs.yaml 2026-04-15 04:44:35,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/lava_callback.json.gz 2026-04-15 04:44:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:35,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:44:35,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:35,864 - lava_callback - INFO - Completed processing callback for node 69df16c4f490930782fbd5b4 INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:37,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:37,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 04:44:41,561 - lava_callback - INFO - Received callback for node 69df1699f490930782fbd55a INFO: 172.21.0.1:50680 - "POST /node/69df1699f490930782fbd55a HTTP/1.0" 202 Accepted 2026-04-15 04:44:41,570 - lava_callback - INFO - Starting async job submit for node 69df1699f490930782fbd55a 2026-04-15 04:44:41,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:41,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:41,690 - lava_callback - DEBUG - Processing node 69df1699f490930782fbd55a: baseline-arm64-foundriesio 2026-04-15 04:44:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:43,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:43,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/log.txt.gz 2026-04-15 04:44:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:44,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:44,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/lava-logs.yaml 2026-04-15 04:44:44,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:44,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:44,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/lava_callback.json.gz DEBUG: 69df1699f490930782fbd55a Transitting job node result: pass -> incomplete 2026-04-15 04:44:44,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:44:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:44,374 - lava_callback - INFO - Completed processing callback for node 69df1699f490930782fbd55a INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:47,423 - lava_callback - INFO - Received callback for node 69dc74bc5dbfa74e32f99983 INFO: 172.21.0.1:50696 - "POST /node/69dc74bc5dbfa74e32f99983 HTTP/1.0" 202 Accepted 2026-04-15 04:44:47,429 - lava_callback - INFO - Starting async job submit for node 69dc74bc5dbfa74e32f99983 2026-04-15 04:44:47,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,444 - lava_callback - DEBUG - Processing node 69dc74bc5dbfa74e32f99983: baseline-arm-baylibre 2026-04-15 04:44:47,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74bc5dbfa74e32f99983 2026-04-15 04:44:47,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:44:47,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,492 - lava_callback - ERROR - Error processing callback for node 69dc74bc5dbfa74e32f99983: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:45:07,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:07,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:45:47,768 - lava_callback - INFO - Received callback for node 69dc74f55dbfa74e32f999b2 INFO: 172.21.0.1:51276 - "POST /node/69dc74f55dbfa74e32f999b2 HTTP/1.0" 202 Accepted 2026-04-15 04:45:47,774 - lava_callback - INFO - Starting async job submit for node 69dc74f55dbfa74e32f999b2 2026-04-15 04:45:47,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,789 - lava_callback - DEBUG - Processing node 69dc74f55dbfa74e32f999b2: baseline-arm-baylibre 2026-04-15 04:45:47,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74f55dbfa74e32f999b2 2026-04-15 04:45:47,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:45:47,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,841 - lava_callback - ERROR - Error processing callback for node 69dc74f55dbfa74e32f999b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:46:27,543 - lava_callback - INFO - Received callback for node 69dc75165dbfa74e32f999c1 INFO: 172.21.0.1:33842 - "POST /node/69dc75165dbfa74e32f999c1 HTTP/1.0" 202 Accepted 2026-04-15 04:46:27,549 - lava_callback - INFO - Starting async job submit for node 69dc75165dbfa74e32f999c1 2026-04-15 04:46:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,566 - lava_callback - DEBUG - Processing node 69dc75165dbfa74e32f999c1: baseline-arm-baylibre 2026-04-15 04:46:27,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75165dbfa74e32f999c1 2026-04-15 04:46:27,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:46:27,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,641 - lava_callback - ERROR - Error processing callback for node 69dc75165dbfa74e32f999c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:48:17,554 - lava_callback - INFO - Received callback for node 69dc75895dbfa74e32f99a2d INFO: 172.21.0.1:47270 - "POST /node/69dc75895dbfa74e32f99a2d HTTP/1.0" 202 Accepted 2026-04-15 04:48:17,559 - lava_callback - INFO - Starting async job submit for node 69dc75895dbfa74e32f99a2d 2026-04-15 04:48:17,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,575 - lava_callback - DEBUG - Processing node 69dc75895dbfa74e32f99a2d: baseline-arm-clabbe 2026-04-15 04:48:17,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75895dbfa74e32f99a2d 2026-04-15 04:48:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:48:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,627 - lava_callback - ERROR - Error processing callback for node 69dc75895dbfa74e32f99a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:48:57,500 - lava_callback - INFO - Received callback for node 69dc75ac5dbfa74e32f99a61 INFO: 172.21.0.1:44126 - "POST /node/69dc75ac5dbfa74e32f99a61 HTTP/1.0" 202 Accepted 2026-04-15 04:48:57,506 - lava_callback - INFO - Starting async job submit for node 69dc75ac5dbfa74e32f99a61 2026-04-15 04:48:57,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,526 - lava_callback - DEBUG - Processing node 69dc75ac5dbfa74e32f99a61: baseline-arm-clabbe 2026-04-15 04:48:57,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75ac5dbfa74e32f99a61 2026-04-15 04:48:57,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:48:57,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,583 - lava_callback - ERROR - Error processing callback for node 69dc75ac5dbfa74e32f99a61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:34,436 - lava_callback - INFO - Received callback for node 69df1713f490930782fbd5e9 INFO: 172.21.0.1:39138 - "POST /node/69df1713f490930782fbd5e9 HTTP/1.0" 202 Accepted 2026-04-15 04:49:34,443 - lava_callback - INFO - Starting async job submit for node 69df1713f490930782fbd5e9 2026-04-15 04:49:34,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:34,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:34,686 - lava_callback - DEBUG - Processing node 69df1713f490930782fbd5e9: baseline-arm64 2026-04-15 04:49:35,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/log.txt.gz 2026-04-15 04:49:35,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/lava-logs.yaml 2026-04-15 04:49:35,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/lava_callback.json.gz DEBUG: Setup failed for 69df1713f490930782fbd5e9. Transitting job node result: incomplete -> fail 2026-04-15 04:49:35,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:35,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:49:35,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:36,058 - lava_callback - INFO - Completed processing callback for node 69df1713f490930782fbd5e9 INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:37,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:37,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:57,644 - lava_callback - INFO - Received callback for node 69dc75e75dbfa74e32f99a8c INFO: 172.21.0.1:48812 - "POST /node/69dc75e75dbfa74e32f99a8c HTTP/1.0" 202 Accepted 2026-04-15 04:49:57,650 - lava_callback - INFO - Starting async job submit for node 69dc75e75dbfa74e32f99a8c 2026-04-15 04:49:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,667 - lava_callback - DEBUG - Processing node 69dc75e75dbfa74e32f99a8c: baseline-arm-clabbe 2026-04-15 04:49:57,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75e75dbfa74e32f99a8c 2026-04-15 04:49:57,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:49:57,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,720 - lava_callback - ERROR - Error processing callback for node 69dc75e75dbfa74e32f99a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:50:37,555 - lava_callback - INFO - Received callback for node 69dc76095dbfa74e32f99a9e INFO: 172.21.0.1:47804 - "POST /node/69dc76095dbfa74e32f99a9e HTTP/1.0" 202 Accepted 2026-04-15 04:50:37,561 - lava_callback - INFO - Starting async job submit for node 69dc76095dbfa74e32f99a9e 2026-04-15 04:50:37,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,588 - lava_callback - DEBUG - Processing node 69dc76095dbfa74e32f99a9e: baseline-arm-clabbe 2026-04-15 04:50:37,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76095dbfa74e32f99a9e 2026-04-15 04:50:37,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:50:37,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,648 - lava_callback - ERROR - Error processing callback for node 69dc76095dbfa74e32f99a9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:50:57,615 - lava_callback - INFO - Received callback for node 69dc762b5dbfa74e32f99abc INFO: 172.21.0.1:51600 - "POST /node/69dc762b5dbfa74e32f99abc HTTP/1.0" 202 Accepted 2026-04-15 04:50:57,621 - lava_callback - INFO - Starting async job submit for node 69dc762b5dbfa74e32f99abc 2026-04-15 04:50:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,648 - lava_callback - DEBUG - Processing node 69dc762b5dbfa74e32f99abc: baseline-arm-clabbe 2026-04-15 04:50:57,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc762b5dbfa74e32f99abc 2026-04-15 04:50:57,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:50:57,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,702 - lava_callback - ERROR - Error processing callback for node 69dc762b5dbfa74e32f99abc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43708 - "GET /node/698ff21176d4b6342e9db945%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:51:37,601 - lava_callback - INFO - Received callback for node 69dc764a5dbfa74e32f99afa INFO: 172.21.0.1:34434 - "POST /node/69dc764a5dbfa74e32f99afa HTTP/1.0" 202 Accepted 2026-04-15 04:51:37,607 - lava_callback - INFO - Starting async job submit for node 69dc764a5dbfa74e32f99afa 2026-04-15 04:51:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,625 - lava_callback - DEBUG - Processing node 69dc764a5dbfa74e32f99afa: baseline-arm-clabbe 2026-04-15 04:51:37,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc764a5dbfa74e32f99afa 2026-04-15 04:51:37,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:51:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,673 - lava_callback - ERROR - Error processing callback for node 69dc764a5dbfa74e32f99afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:51:57,644 - lava_callback - INFO - Received callback for node 69dc76675dbfa74e32f99b32 INFO: 172.21.0.1:40452 - "POST /node/69dc76675dbfa74e32f99b32 HTTP/1.0" 202 Accepted 2026-04-15 04:51:57,649 - lava_callback - INFO - Starting async job submit for node 69dc76675dbfa74e32f99b32 2026-04-15 04:51:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,665 - lava_callback - DEBUG - Processing node 69dc76675dbfa74e32f99b32: baseline-arm-clabbe 2026-04-15 04:51:57,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76675dbfa74e32f99b32 2026-04-15 04:51:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:51:57,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,713 - lava_callback - ERROR - Error processing callback for node 69dc76675dbfa74e32f99b32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:52:37,652 - lava_callback - INFO - Received callback for node 69dc76865dbfa74e32f99b5a INFO: 172.21.0.1:39552 - "POST /node/69dc76865dbfa74e32f99b5a HTTP/1.0" 202 Accepted 2026-04-15 04:52:37,657 - lava_callback - INFO - Starting async job submit for node 69dc76865dbfa74e32f99b5a 2026-04-15 04:52:37,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,673 - lava_callback - DEBUG - Processing node 69dc76865dbfa74e32f99b5a: baseline-arm-clabbe 2026-04-15 04:52:37,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76865dbfa74e32f99b5a 2026-04-15 04:52:37,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:52:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,734 - lava_callback - ERROR - Error processing callback for node 69dc76865dbfa74e32f99b5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:52:57,652 - lava_callback - INFO - Received callback for node 69dc76a65dbfa74e32f99b81 INFO: 172.21.0.1:41452 - "POST /node/69dc76a65dbfa74e32f99b81 HTTP/1.0" 202 Accepted 2026-04-15 04:52:57,658 - lava_callback - INFO - Starting async job submit for node 69dc76a65dbfa74e32f99b81 2026-04-15 04:52:57,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,673 - lava_callback - DEBUG - Processing node 69dc76a65dbfa74e32f99b81: baseline-arm-clabbe 2026-04-15 04:52:57,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76a65dbfa74e32f99b81 2026-04-15 04:52:57,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:52:57,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,725 - lava_callback - ERROR - Error processing callback for node 69dc76a65dbfa74e32f99b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET /node/698e2af8952a14bf500e41a1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET /node/69d05ed5d2be3e1cf2a5acf4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET /node/693f044124745582e399741a%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 05:00:08,625 - lava_callback - INFO - Received callback for node 69dc78435dbfa74e32f99bcd INFO: 172.21.0.1:34974 - "POST /node/69dc78435dbfa74e32f99bcd HTTP/1.0" 202 Accepted 2026-04-15 05:00:08,630 - lava_callback - INFO - Starting async job submit for node 69dc78435dbfa74e32f99bcd 2026-04-15 05:00:08,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,664 - lava_callback - DEBUG - Processing node 69dc78435dbfa74e32f99bcd: baseline-arm-baylibre 2026-04-15 05:00:08,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc78435dbfa74e32f99bcd 2026-04-15 05:00:08,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:00:08,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,712 - lava_callback - ERROR - Error processing callback for node 69dc78435dbfa74e32f99bcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53898 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:00:28,295 - lava_callback - INFO - Received callback for node 69dc78675dbfa74e32f99bf0 INFO: 172.21.0.1:53900 - "POST /node/69dc78675dbfa74e32f99bf0 HTTP/1.0" 202 Accepted 2026-04-15 05:00:28,301 - lava_callback - INFO - Starting async job submit for node 69dc78675dbfa74e32f99bf0 2026-04-15 05:00:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,316 - lava_callback - DEBUG - Processing node 69dc78675dbfa74e32f99bf0: baseline-arm-baylibre 2026-04-15 05:00:28,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc78675dbfa74e32f99bf0 2026-04-15 05:00:28,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:00:28,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,369 - lava_callback - ERROR - Error processing callback for node 69dc78675dbfa74e32f99bf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET /node/69d0cfe5691bac272b3234c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49120 - "GET /node/6988c5b59fc35f969e1eeba6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:01:28,358 - lava_callback - INFO - Received callback for node 69dc789e5dbfa74e32f99c0e INFO: 172.21.0.1:52974 - "POST /node/69dc789e5dbfa74e32f99c0e HTTP/1.0" 202 Accepted 2026-04-15 05:01:28,364 - lava_callback - INFO - Starting async job submit for node 69dc789e5dbfa74e32f99c0e 2026-04-15 05:01:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,379 - lava_callback - DEBUG - Processing node 69dc789e5dbfa74e32f99c0e: baseline-arm-baylibre 2026-04-15 05:01:28,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc789e5dbfa74e32f99c0e 2026-04-15 05:01:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:01:28,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,446 - lava_callback - ERROR - Error processing callback for node 69dc789e5dbfa74e32f99c0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET /node/6986fd4d6e077e4126a7d842%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:02:51,460 - lava_callback - INFO - Received callback for node 69df1761f490930782fbd653 INFO: 172.21.0.1:40296 - "POST /node/69df1761f490930782fbd653 HTTP/1.0" 202 Accepted 2026-04-15 05:02:51,469 - lava_callback - INFO - Starting async job submit for node 69df1761f490930782fbd653 2026-04-15 05:02:51,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:51,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:51,532 - lava_callback - DEBUG - Processing node 69df1761f490930782fbd653: baseline-nfs-arm64 2026-04-15 05:02:52,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:52,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:52,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/log.txt.gz 2026-04-15 05:02:53,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:53,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:53,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/lava-logs.yaml 2026-04-15 05:02:53,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:53,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:53,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/lava_callback.json.gz DEBUG: Setup failed for 69df1761f490930782fbd653. Transitting job node result: incomplete -> fail 2026-04-15 05:02:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:54,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:02:54,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:54,171 - lava_callback - INFO - Completed processing callback for node 69df1761f490930782fbd653 INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:07,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:18,260 - lava_callback - INFO - Received callback for node 69dc79075dbfa74e32f99c2b INFO: 172.21.0.1:47792 - "POST /node/69dc79075dbfa74e32f99c2b HTTP/1.0" 202 Accepted 2026-04-15 05:03:18,266 - lava_callback - INFO - Starting async job submit for node 69dc79075dbfa74e32f99c2b 2026-04-15 05:03:18,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,282 - lava_callback - DEBUG - Processing node 69dc79075dbfa74e32f99c2b: baseline-arm-clabbe 2026-04-15 05:03:18,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79075dbfa74e32f99c2b 2026-04-15 05:03:18,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:03:18,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,339 - lava_callback - ERROR - Error processing callback for node 69dc79075dbfa74e32f99c2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:58,198 - lava_callback - INFO - Received callback for node 69dc792f5dbfa74e32f99c4d INFO: 172.21.0.1:48750 - "POST /node/69dc792f5dbfa74e32f99c4d HTTP/1.0" 202 Accepted 2026-04-15 05:03:58,204 - lava_callback - INFO - Starting async job submit for node 69dc792f5dbfa74e32f99c4d 2026-04-15 05:03:58,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,220 - lava_callback - DEBUG - Processing node 69dc792f5dbfa74e32f99c4d: baseline-arm-clabbe 2026-04-15 05:03:58,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc792f5dbfa74e32f99c4d 2026-04-15 05:03:58,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:03:58,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,277 - lava_callback - ERROR - Error processing callback for node 69dc792f5dbfa74e32f99c4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57500 - "GET /node/6910c3b4699dbc4cda8e1caf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:28,553 - lava_callback - INFO - Received callback for node 69dc794e5dbfa74e32f99c5b INFO: 172.21.0.1:38304 - "POST /node/69dc794e5dbfa74e32f99c5b HTTP/1.0" 202 Accepted 2026-04-15 05:04:28,558 - lava_callback - INFO - Starting async job submit for node 69dc794e5dbfa74e32f99c5b 2026-04-15 05:04:28,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,574 - lava_callback - DEBUG - Processing node 69dc794e5dbfa74e32f99c5b: baseline-arm-baylibre 2026-04-15 05:04:28,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc794e5dbfa74e32f99c5b 2026-04-15 05:04:28,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:04:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,631 - lava_callback - ERROR - Error processing callback for node 69dc794e5dbfa74e32f99c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 05:04:32,820 - lava_callback - INFO - Received callback for node 69df17adf490930782fbd69a INFO: 172.21.0.1:60422 - "POST /node/69df17adf490930782fbd69a HTTP/1.0" 202 Accepted 2026-04-15 05:04:32,828 - lava_callback - INFO - Starting async job submit for node 69df17adf490930782fbd69a 2026-04-15 05:04:32,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:32,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:32,896 - lava_callback - DEBUG - Processing node 69df17adf490930782fbd69a: baseline-nfs-arm64 2026-04-15 05:04:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/log.txt.gz 2026-04-15 05:04:34,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/lava-logs.yaml 2026-04-15 05:04:34,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/lava_callback.json.gz DEBUG: Setup failed for 69df17adf490930782fbd69a. Transitting job node result: incomplete -> fail 2026-04-15 05:04:35,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:35,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:04:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:35,194 - lava_callback - INFO - Completed processing callback for node 69df17adf490930782fbd69a INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:37,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:37,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:58,270 - lava_callback - INFO - Received callback for node 69dc79725dbfa74e32f99c75 INFO: 172.21.0.1:44704 - "POST /node/69dc79725dbfa74e32f99c75 HTTP/1.0" 202 Accepted 2026-04-15 05:04:58,276 - lava_callback - INFO - Starting async job submit for node 69dc79725dbfa74e32f99c75 2026-04-15 05:04:58,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,304 - lava_callback - DEBUG - Processing node 69dc79725dbfa74e32f99c75: baseline-arm-clabbe 2026-04-15 05:04:58,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79725dbfa74e32f99c75 2026-04-15 05:04:58,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:04:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,356 - lava_callback - ERROR - Error processing callback for node 69dc79725dbfa74e32f99c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:05:38,278 - lava_callback - INFO - Received callback for node 69dc79965dbfa74e32f99c9f INFO: 172.21.0.1:47864 - "POST /node/69dc79965dbfa74e32f99c9f HTTP/1.0" 202 Accepted 2026-04-15 05:05:38,284 - lava_callback - INFO - Starting async job submit for node 69dc79965dbfa74e32f99c9f 2026-04-15 05:05:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,345 - lava_callback - DEBUG - Processing node 69dc79965dbfa74e32f99c9f: baseline-arm-clabbe 2026-04-15 05:05:38,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79965dbfa74e32f99c9f 2026-04-15 05:05:38,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:05:38,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,392 - lava_callback - ERROR - Error processing callback for node 69dc79965dbfa74e32f99c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:06:18,342 - lava_callback - INFO - Received callback for node 69dc79b75dbfa74e32f99cc9 INFO: 172.21.0.1:40666 - "POST /node/69dc79b75dbfa74e32f99cc9 HTTP/1.0" 202 Accepted 2026-04-15 05:06:18,348 - lava_callback - INFO - Starting async job submit for node 69dc79b75dbfa74e32f99cc9 2026-04-15 05:06:18,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,372 - lava_callback - DEBUG - Processing node 69dc79b75dbfa74e32f99cc9: baseline-arm-clabbe 2026-04-15 05:06:18,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79b75dbfa74e32f99cc9 2026-04-15 05:06:18,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:06:18,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,437 - lava_callback - ERROR - Error processing callback for node 69dc79b75dbfa74e32f99cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:06:38,288 - lava_callback - INFO - Received callback for node 69dc79db5dbfa74e32f99cd6 INFO: 172.21.0.1:40366 - "POST /node/69dc79db5dbfa74e32f99cd6 HTTP/1.0" 202 Accepted 2026-04-15 05:06:38,294 - lava_callback - INFO - Starting async job submit for node 69dc79db5dbfa74e32f99cd6 2026-04-15 05:06:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,310 - lava_callback - DEBUG - Processing node 69dc79db5dbfa74e32f99cd6: baseline-arm-clabbe 2026-04-15 05:06:38,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79db5dbfa74e32f99cd6 2026-04-15 05:06:38,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:06:38,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,359 - lava_callback - ERROR - Error processing callback for node 69dc79db5dbfa74e32f99cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:07:08,688 - lava_callback - INFO - Received callback for node 69dc79f95dbfa74e32f99cfc INFO: 172.21.0.1:36234 - "POST /node/69dc79f95dbfa74e32f99cfc HTTP/1.0" 202 Accepted 2026-04-15 05:07:08,693 - lava_callback - INFO - Starting async job submit for node 69dc79f95dbfa74e32f99cfc 2026-04-15 05:07:08,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,710 - lava_callback - DEBUG - Processing node 69dc79f95dbfa74e32f99cfc: baseline-arm-baylibre 2026-04-15 05:07:08,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79f95dbfa74e32f99cfc 2026-04-15 05:07:08,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:07:08,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,766 - lava_callback - ERROR - Error processing callback for node 69dc79f95dbfa74e32f99cfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /node/6910a8f88b15debe9dd52c61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:07:58,411 - lava_callback - INFO - Received callback for node 69dc7a1f5dbfa74e32f99d1c INFO: 172.21.0.1:57716 - "POST /node/69dc7a1f5dbfa74e32f99d1c HTTP/1.0" 202 Accepted 2026-04-15 05:07:58,417 - lava_callback - INFO - Starting async job submit for node 69dc7a1f5dbfa74e32f99d1c 2026-04-15 05:07:58,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,440 - lava_callback - DEBUG - Processing node 69dc7a1f5dbfa74e32f99d1c: baseline-arm-clabbe 2026-04-15 05:07:58,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a1f5dbfa74e32f99d1c 2026-04-15 05:07:58,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:07:58,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,495 - lava_callback - ERROR - Error processing callback for node 69dc7a1f5dbfa74e32f99d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:08:28,765 - lava_callback - INFO - Received callback for node 69dc7a405dbfa74e32f99d2f INFO: 172.21.0.1:57002 - "POST /node/69dc7a405dbfa74e32f99d2f HTTP/1.0" 202 Accepted 2026-04-15 05:08:28,771 - lava_callback - INFO - Starting async job submit for node 69dc7a405dbfa74e32f99d2f 2026-04-15 05:08:28,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,798 - lava_callback - DEBUG - Processing node 69dc7a405dbfa74e32f99d2f: baseline-arm-baylibre 2026-04-15 05:08:28,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a405dbfa74e32f99d2f 2026-04-15 05:08:28,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:08:28,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,845 - lava_callback - ERROR - Error processing callback for node 69dc7a405dbfa74e32f99d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:08:58,453 - lava_callback - INFO - Received callback for node 69dc7a615dbfa74e32f99d44 INFO: 172.21.0.1:38250 - "POST /node/69dc7a615dbfa74e32f99d44 HTTP/1.0" 202 Accepted 2026-04-15 05:08:58,460 - lava_callback - INFO - Starting async job submit for node 69dc7a615dbfa74e32f99d44 2026-04-15 05:08:58,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,480 - lava_callback - DEBUG - Processing node 69dc7a615dbfa74e32f99d44: baseline-arm-clabbe 2026-04-15 05:08:58,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a615dbfa74e32f99d44 2026-04-15 05:08:58,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:08:58,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,538 - lava_callback - ERROR - Error processing callback for node 69dc7a615dbfa74e32f99d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:09:28,769 - lava_callback - INFO - Received callback for node 69dc7a825dbfa74e32f99d6c INFO: 172.21.0.1:47600 - "POST /node/69dc7a825dbfa74e32f99d6c HTTP/1.0" 202 Accepted 2026-04-15 05:09:28,775 - lava_callback - INFO - Starting async job submit for node 69dc7a825dbfa74e32f99d6c 2026-04-15 05:09:28,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,791 - lava_callback - DEBUG - Processing node 69dc7a825dbfa74e32f99d6c: baseline-arm-baylibre 2026-04-15 05:09:28,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a825dbfa74e32f99d6c 2026-04-15 05:09:28,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:09:28,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,866 - lava_callback - ERROR - Error processing callback for node 69dc7a825dbfa74e32f99d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:09:58,543 - lava_callback - INFO - Received callback for node 69dc7aa35dbfa74e32f99d93 INFO: 172.21.0.1:36520 - "POST /node/69dc7aa35dbfa74e32f99d93 HTTP/1.0" 202 Accepted 2026-04-15 05:09:58,548 - lava_callback - INFO - Starting async job submit for node 69dc7aa35dbfa74e32f99d93 2026-04-15 05:09:58,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,564 - lava_callback - DEBUG - Processing node 69dc7aa35dbfa74e32f99d93: baseline-arm-clabbe 2026-04-15 05:09:58,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7aa35dbfa74e32f99d93 2026-04-15 05:09:58,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:09:58,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,625 - lava_callback - ERROR - Error processing callback for node 69dc7aa35dbfa74e32f99d93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:10:38,507 - lava_callback - INFO - Received callback for node 69dc7ac75dbfa74e32f99da0 INFO: 172.21.0.1:40578 - "POST /node/69dc7ac75dbfa74e32f99da0 HTTP/1.0" 202 Accepted 2026-04-15 05:10:38,513 - lava_callback - INFO - Starting async job submit for node 69dc7ac75dbfa74e32f99da0 2026-04-15 05:10:38,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,528 - lava_callback - DEBUG - Processing node 69dc7ac75dbfa74e32f99da0: baseline-arm-clabbe 2026-04-15 05:10:38,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7ac75dbfa74e32f99da0 2026-04-15 05:10:38,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:10:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,595 - lava_callback - ERROR - Error processing callback for node 69dc7ac75dbfa74e32f99da0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:11:18,592 - lava_callback - INFO - Received callback for node 69dc7aee5dbfa74e32f99db3 INFO: 172.21.0.1:46528 - "POST /node/69dc7aee5dbfa74e32f99db3 HTTP/1.0" 202 Accepted 2026-04-15 05:11:18,599 - lava_callback - INFO - Starting async job submit for node 69dc7aee5dbfa74e32f99db3 2026-04-15 05:11:18,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,619 - lava_callback - DEBUG - Processing node 69dc7aee5dbfa74e32f99db3: baseline-arm-clabbe 2026-04-15 05:11:18,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7aee5dbfa74e32f99db3 2026-04-15 05:11:18,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:11:18,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,720 - lava_callback - ERROR - Error processing callback for node 69dc7aee5dbfa74e32f99db3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:11:58,588 - lava_callback - INFO - Received callback for node 69dc7b125dbfa74e32f99dc6 INFO: 172.21.0.1:58016 - "POST /node/69dc7b125dbfa74e32f99dc6 HTTP/1.0" 202 Accepted 2026-04-15 05:11:58,594 - lava_callback - INFO - Starting async job submit for node 69dc7b125dbfa74e32f99dc6 2026-04-15 05:11:58,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,610 - lava_callback - DEBUG - Processing node 69dc7b125dbfa74e32f99dc6: baseline-arm-clabbe 2026-04-15 05:11:58,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b125dbfa74e32f99dc6 2026-04-15 05:11:58,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:11:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,663 - lava_callback - ERROR - Error processing callback for node 69dc7b125dbfa74e32f99dc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET /node/693f095b24745582e39985bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:12:58,659 - lava_callback - INFO - Received callback for node 69dc7b4e5dbfa74e32f99deb INFO: 172.21.0.1:35262 - "POST /node/69dc7b4e5dbfa74e32f99deb HTTP/1.0" 202 Accepted 2026-04-15 05:12:58,665 - lava_callback - INFO - Starting async job submit for node 69dc7b4e5dbfa74e32f99deb 2026-04-15 05:12:58,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,681 - lava_callback - DEBUG - Processing node 69dc7b4e5dbfa74e32f99deb: baseline-arm-clabbe 2026-04-15 05:12:58,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b4e5dbfa74e32f99deb 2026-04-15 05:12:58,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:12:58,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,754 - lava_callback - ERROR - Error processing callback for node 69dc7b4e5dbfa74e32f99deb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:13:49,055 - lava_callback - INFO - Received callback for node 69dc7b885dbfa74e32f99e0a INFO: 172.21.0.1:33988 - "POST /node/69dc7b885dbfa74e32f99e0a HTTP/1.0" 202 Accepted 2026-04-15 05:13:49,061 - lava_callback - INFO - Starting async job submit for node 69dc7b885dbfa74e32f99e0a 2026-04-15 05:13:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,085 - lava_callback - DEBUG - Processing node 69dc7b885dbfa74e32f99e0a: baseline-arm-baylibre 2026-04-15 05:13:49,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b885dbfa74e32f99e0a 2026-04-15 05:13:49,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:13:49,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,149 - lava_callback - ERROR - Error processing callback for node 69dc7b885dbfa74e32f99e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:14:38,670 - lava_callback - INFO - Received callback for node 69dc7bac5dbfa74e32f99e16 INFO: 172.21.0.1:41560 - "POST /node/69dc7bac5dbfa74e32f99e16 HTTP/1.0" 202 Accepted 2026-04-15 05:14:38,676 - lava_callback - INFO - Starting async job submit for node 69dc7bac5dbfa74e32f99e16 2026-04-15 05:14:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,693 - lava_callback - DEBUG - Processing node 69dc7bac5dbfa74e32f99e16: baseline-arm-clabbe 2026-04-15 05:14:38,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bac5dbfa74e32f99e16 2026-04-15 05:14:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:14:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,745 - lava_callback - ERROR - Error processing callback for node 69dc7bac5dbfa74e32f99e16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:14:58,652 - lava_callback - INFO - Received callback for node 69dc7bcc5dbfa74e32f99e4e INFO: 172.21.0.1:56566 - "POST /node/69dc7bcc5dbfa74e32f99e4e HTTP/1.0" 202 Accepted 2026-04-15 05:14:58,658 - lava_callback - INFO - Starting async job submit for node 69dc7bcc5dbfa74e32f99e4e 2026-04-15 05:14:58,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,688 - lava_callback - DEBUG - Processing node 69dc7bcc5dbfa74e32f99e4e: baseline-arm-clabbe 2026-04-15 05:14:58,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bcc5dbfa74e32f99e4e 2026-04-15 05:14:58,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:14:58,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,748 - lava_callback - ERROR - Error processing callback for node 69dc7bcc5dbfa74e32f99e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:15:29,216 - lava_callback - INFO - Received callback for node 69dc7bed5dbfa74e32f99e61 INFO: 172.21.0.1:33632 - "POST /node/69dc7bed5dbfa74e32f99e61 HTTP/1.0" 202 Accepted 2026-04-15 05:15:29,221 - lava_callback - INFO - Starting async job submit for node 69dc7bed5dbfa74e32f99e61 2026-04-15 05:15:29,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,237 - lava_callback - DEBUG - Processing node 69dc7bed5dbfa74e32f99e61: baseline-arm-baylibre 2026-04-15 05:15:29,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bed5dbfa74e32f99e61 2026-04-15 05:15:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:15:29,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,535 - lava_callback - ERROR - Error processing callback for node 69dc7bed5dbfa74e32f99e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:16:09,125 - lava_callback - INFO - Received callback for node 69dc7c125dbfa74e32f99e6d INFO: 172.21.0.1:35618 - "POST /node/69dc7c125dbfa74e32f99e6d HTTP/1.0" 202 Accepted 2026-04-15 05:16:09,131 - lava_callback - INFO - Starting async job submit for node 69dc7c125dbfa74e32f99e6d 2026-04-15 05:16:09,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,147 - lava_callback - DEBUG - Processing node 69dc7c125dbfa74e32f99e6d: baseline-arm-baylibre 2026-04-15 05:16:09,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c125dbfa74e32f99e6d 2026-04-15 05:16:09,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:16:09,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,205 - lava_callback - ERROR - Error processing callback for node 69dc7c125dbfa74e32f99e6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:16:58,812 - lava_callback - INFO - Received callback for node 69dc7c3f5dbfa74e32f99e7f INFO: 172.21.0.1:45356 - "POST /node/69dc7c3f5dbfa74e32f99e7f HTTP/1.0" 202 Accepted 2026-04-15 05:16:58,817 - lava_callback - INFO - Starting async job submit for node 69dc7c3f5dbfa74e32f99e7f 2026-04-15 05:16:58,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,833 - lava_callback - DEBUG - Processing node 69dc7c3f5dbfa74e32f99e7f: baseline-arm-clabbe 2026-04-15 05:16:58,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c3f5dbfa74e32f99e7f 2026-04-15 05:16:58,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:16:58,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,923 - lava_callback - ERROR - Error processing callback for node 69dc7c3f5dbfa74e32f99e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:17:38,764 - lava_callback - INFO - Received callback for node 69dc7c645dbfa74e32f99e8c INFO: 172.21.0.1:38576 - "POST /node/69dc7c645dbfa74e32f99e8c HTTP/1.0" 202 Accepted 2026-04-15 05:17:38,770 - lava_callback - INFO - Starting async job submit for node 69dc7c645dbfa74e32f99e8c 2026-04-15 05:17:38,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,821 - lava_callback - DEBUG - Processing node 69dc7c645dbfa74e32f99e8c: baseline-arm-clabbe 2026-04-15 05:17:38,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c645dbfa74e32f99e8c 2026-04-15 05:17:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:17:38,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,877 - lava_callback - ERROR - Error processing callback for node 69dc7c645dbfa74e32f99e8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:18:09,292 - lava_callback - INFO - Received callback for node 69dc7c825dbfa74e32f99eaa INFO: 172.21.0.1:43132 - "POST /node/69dc7c825dbfa74e32f99eaa HTTP/1.0" 202 Accepted 2026-04-15 05:18:09,297 - lava_callback - INFO - Starting async job submit for node 69dc7c825dbfa74e32f99eaa 2026-04-15 05:18:09,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,324 - lava_callback - DEBUG - Processing node 69dc7c825dbfa74e32f99eaa: baseline-arm-baylibre 2026-04-15 05:18:09,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c825dbfa74e32f99eaa 2026-04-15 05:18:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:18:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,381 - lava_callback - ERROR - Error processing callback for node 69dc7c825dbfa74e32f99eaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:18:59,299 - lava_callback - INFO - Received callback for node 69dc7cb75dbfa74e32f99ecc INFO: 172.21.0.1:41982 - "POST /node/69dc7cb75dbfa74e32f99ecc HTTP/1.0" 202 Accepted 2026-04-15 05:18:59,305 - lava_callback - INFO - Starting async job submit for node 69dc7cb75dbfa74e32f99ecc 2026-04-15 05:18:59,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,323 - lava_callback - DEBUG - Processing node 69dc7cb75dbfa74e32f99ecc: baseline-arm-clabbe 2026-04-15 05:18:59,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cb75dbfa74e32f99ecc 2026-04-15 05:18:59,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:18:59,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,375 - lava_callback - ERROR - Error processing callback for node 69dc7cb75dbfa74e32f99ecc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:19:18,774 - lava_callback - INFO - Received callback for node 69dc7cd45dbfa74e32f99edb INFO: 172.21.0.1:37396 - "POST /node/69dc7cd45dbfa74e32f99edb HTTP/1.0" 202 Accepted 2026-04-15 05:19:18,780 - lava_callback - INFO - Starting async job submit for node 69dc7cd45dbfa74e32f99edb 2026-04-15 05:19:18,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,804 - lava_callback - DEBUG - Processing node 69dc7cd45dbfa74e32f99edb: baseline-arm-clabbe 2026-04-15 05:19:18,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cd45dbfa74e32f99edb 2026-04-15 05:19:18,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:19:18,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,877 - lava_callback - ERROR - Error processing callback for node 69dc7cd45dbfa74e32f99edb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:19:58,845 - lava_callback - INFO - Received callback for node 69dc7cf85dbfa74e32f99f1c INFO: 172.21.0.1:58558 - "POST /node/69dc7cf85dbfa74e32f99f1c HTTP/1.0" 202 Accepted 2026-04-15 05:19:58,851 - lava_callback - INFO - Starting async job submit for node 69dc7cf85dbfa74e32f99f1c 2026-04-15 05:19:58,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,867 - lava_callback - DEBUG - Processing node 69dc7cf85dbfa74e32f99f1c: baseline-arm-clabbe 2026-04-15 05:19:58,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cf85dbfa74e32f99f1c 2026-04-15 05:19:58,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:19:58,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,917 - lava_callback - ERROR - Error processing callback for node 69dc7cf85dbfa74e32f99f1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:20:58,912 - lava_callback - INFO - Received callback for node 69dc7d305dbfa74e32f99f3c INFO: 172.21.0.1:37940 - "POST /node/69dc7d305dbfa74e32f99f3c HTTP/1.0" 202 Accepted 2026-04-15 05:20:58,918 - lava_callback - INFO - Starting async job submit for node 69dc7d305dbfa74e32f99f3c 2026-04-15 05:20:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,944 - lava_callback - DEBUG - Processing node 69dc7d305dbfa74e32f99f3c: baseline-arm-clabbe 2026-04-15 05:20:58,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7d305dbfa74e32f99f3c 2026-04-15 05:20:58,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:20:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,993 - lava_callback - ERROR - Error processing callback for node 69dc7d305dbfa74e32f99f3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:21:38,875 - lava_callback - INFO - Received callback for node 69dc7d4f5dbfa74e32f99f46 INFO: 172.21.0.1:59632 - "POST /node/69dc7d4f5dbfa74e32f99f46 HTTP/1.0" 202 Accepted 2026-04-15 05:21:38,881 - lava_callback - INFO - Starting async job submit for node 69dc7d4f5dbfa74e32f99f46 2026-04-15 05:21:38,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:38,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:38,940 - lava_callback - DEBUG - Processing node 69dc7d4f5dbfa74e32f99f46: baseline-arm-clabbe 2026-04-15 05:21:38,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7d4f5dbfa74e32f99f46 2026-04-15 05:21:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:38,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:39,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:21:39,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:39,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:39,049 - lava_callback - ERROR - Error processing callback for node 69dc7d4f5dbfa74e32f99f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:22:58,985 - lava_callback - INFO - Received callback for node 69dc7da85dbfa74e32f99f99 INFO: 172.21.0.1:39878 - "POST /node/69dc7da85dbfa74e32f99f99 HTTP/1.0" 202 Accepted 2026-04-15 05:22:58,991 - lava_callback - INFO - Starting async job submit for node 69dc7da85dbfa74e32f99f99 2026-04-15 05:22:58,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,007 - lava_callback - DEBUG - Processing node 69dc7da85dbfa74e32f99f99: baseline-arm-clabbe 2026-04-15 05:22:59,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7da85dbfa74e32f99f99 2026-04-15 05:22:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:22:59,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,054 - lava_callback - ERROR - Error processing callback for node 69dc7da85dbfa74e32f99f99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:23:59,068 - lava_callback - INFO - Received callback for node 69dc7de45dbfa74e32f99fab INFO: 172.21.0.1:38906 - "POST /node/69dc7de45dbfa74e32f99fab HTTP/1.0" 202 Accepted 2026-04-15 05:23:59,074 - lava_callback - INFO - Starting async job submit for node 69dc7de45dbfa74e32f99fab 2026-04-15 05:23:59,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,090 - lava_callback - DEBUG - Processing node 69dc7de45dbfa74e32f99fab: baseline-arm-clabbe 2026-04-15 05:23:59,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7de45dbfa74e32f99fab 2026-04-15 05:23:59,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:23:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,137 - lava_callback - ERROR - Error processing callback for node 69dc7de45dbfa74e32f99fab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:24:59,072 - lava_callback - INFO - Received callback for node 69dc7e205dbfa74e32f99fcc INFO: 172.21.0.1:43302 - "POST /node/69dc7e205dbfa74e32f99fcc HTTP/1.0" 202 Accepted 2026-04-15 05:24:59,080 - lava_callback - INFO - Starting async job submit for node 69dc7e205dbfa74e32f99fcc 2026-04-15 05:24:59,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,098 - lava_callback - DEBUG - Processing node 69dc7e205dbfa74e32f99fcc: baseline-arm-clabbe 2026-04-15 05:24:59,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e205dbfa74e32f99fcc 2026-04-15 05:24:59,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:24:59,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,146 - lava_callback - ERROR - Error processing callback for node 69dc7e205dbfa74e32f99fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:25:59,150 - lava_callback - INFO - Received callback for node 69dc7e5c5dbfa74e32f99ffd INFO: 172.21.0.1:38228 - "POST /node/69dc7e5c5dbfa74e32f99ffd HTTP/1.0" 202 Accepted 2026-04-15 05:25:59,156 - lava_callback - INFO - Starting async job submit for node 69dc7e5c5dbfa74e32f99ffd 2026-04-15 05:25:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,172 - lava_callback - DEBUG - Processing node 69dc7e5c5dbfa74e32f99ffd: baseline-arm-clabbe 2026-04-15 05:25:59,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e5c5dbfa74e32f99ffd 2026-04-15 05:25:59,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:25:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,241 - lava_callback - ERROR - Error processing callback for node 69dc7e5c5dbfa74e32f99ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:26:59,191 - lava_callback - INFO - Received callback for node 69dc7e995dbfa74e32f9a022 INFO: 172.21.0.1:53692 - "POST /node/69dc7e995dbfa74e32f9a022 HTTP/1.0" 202 Accepted 2026-04-15 05:26:59,197 - lava_callback - INFO - Starting async job submit for node 69dc7e995dbfa74e32f9a022 2026-04-15 05:26:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,236 - lava_callback - DEBUG - Processing node 69dc7e995dbfa74e32f9a022: baseline-arm-clabbe 2026-04-15 05:26:59,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e995dbfa74e32f9a022 2026-04-15 05:26:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:26:59,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,303 - lava_callback - ERROR - Error processing callback for node 69dc7e995dbfa74e32f9a022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:30:50,079 - lava_callback - INFO - Received callback for node 69dc7f755dbfa74e32f9a03e INFO: 172.21.0.1:52748 - "POST /node/69dc7f755dbfa74e32f9a03e HTTP/1.0" 202 Accepted 2026-04-15 05:30:50,084 - lava_callback - INFO - Starting async job submit for node 69dc7f755dbfa74e32f9a03e 2026-04-15 05:30:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,102 - lava_callback - DEBUG - Processing node 69dc7f755dbfa74e32f9a03e: baseline-arm64-baylibre 2026-04-15 05:30:50,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7f755dbfa74e32f9a03e 2026-04-15 05:30:50,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:30:50,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,184 - lava_callback - ERROR - Error processing callback for node 69dc7f755dbfa74e32f9a03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:10,121 - lava_callback - INFO - Received callback for node 69dc7fc55dbfa74e32f9a08d INFO: 172.21.0.1:33324 - "POST /node/69dc7fc55dbfa74e32f9a08d HTTP/1.0" 202 Accepted 2026-04-15 05:32:10,127 - lava_callback - INFO - Starting async job submit for node 69dc7fc55dbfa74e32f9a08d 2026-04-15 05:32:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,144 - lava_callback - DEBUG - Processing node 69dc7fc55dbfa74e32f9a08d: baseline-arm64-baylibre 2026-04-15 05:32:10,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7fc55dbfa74e32f9a08d 2026-04-15 05:32:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:32:10,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,205 - lava_callback - ERROR - Error processing callback for node 69dc7fc55dbfa74e32f9a08d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:16,763 - lava_callback - INFO - Received callback for node 69de8fa0f6535ffd5b3ef3a4 INFO: 172.21.0.1:33364 - "POST /node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.0" 202 Accepted 2026-04-15 05:32:16,769 - lava_callback - INFO - Starting async job submit for node 69de8fa0f6535ffd5b3ef3a4 2026-04-15 05:32:16,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:16,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:16,835 - lava_callback - DEBUG - Processing node 69de8fa0f6535ffd5b3ef3a4: baseline-arm64-broonie 2026-04-15 05:32:17,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,206 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/log.txt.gz 2026-04-15 05:32:17,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/lava-logs.yaml 2026-04-15 05:32:17,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/lava_callback.json.gz 2026-04-15 05:32:17,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:17,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 05:32:17,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:17,789 - lava_callback - INFO - Completed processing callback for node 69de8fa0f6535ffd5b3ef3a4 2026-04-15 05:32:18,308 - lava_callback - INFO - Received callback for node 69dea1047a8aab7fee69d785 INFO: 172.21.0.1:33366 - "POST /node/69dea1047a8aab7fee69d785 HTTP/1.0" 202 Accepted 2026-04-15 05:32:18,317 - lava_callback - INFO - Starting async job submit for node 69dea1047a8aab7fee69d785 2026-04-15 05:32:18,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:18,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:18,357 - lava_callback - DEBUG - Processing node 69dea1047a8aab7fee69d785: baseline-arm64-broonie 2026-04-15 05:32:18,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:18,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:18,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/log.txt.gz 2026-04-15 05:32:18,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:19,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:19,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/lava-logs.yaml 2026-04-15 05:32:19,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:19,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:19,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/lava_callback.json.gz 2026-04-15 05:32:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:19,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 05:32:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:19,265 - lava_callback - INFO - Completed processing callback for node 69dea1047a8aab7fee69d785 INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:37,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:37,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:10,141 - lava_callback - INFO - Received callback for node 69dc800b5dbfa74e32f9a0d3 INFO: 172.21.0.1:36734 - "POST /node/69dc800b5dbfa74e32f9a0d3 HTTP/1.0" 202 Accepted 2026-04-15 05:33:10,146 - lava_callback - INFO - Starting async job submit for node 69dc800b5dbfa74e32f9a0d3 2026-04-15 05:33:10,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,164 - lava_callback - DEBUG - Processing node 69dc800b5dbfa74e32f9a0d3: baseline-arm64-baylibre 2026-04-15 05:33:10,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc800b5dbfa74e32f9a0d3 2026-04-15 05:33:10,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:33:10,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,215 - lava_callback - ERROR - Error processing callback for node 69dc800b5dbfa74e32f9a0d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:36,699 - lava_callback - INFO - Received callback for node 69defc31f490930782fbba9c INFO: 172.21.0.1:50834 - "POST /node/69defc31f490930782fbba9c HTTP/1.0" 202 Accepted 2026-04-15 05:33:36,705 - lava_callback - INFO - Starting async job submit for node 69defc31f490930782fbba9c 2026-04-15 05:33:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:36,751 - lava_callback - DEBUG - Processing node 69defc31f490930782fbba9c: baseline-arm64-broonie 2026-04-15 05:33:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/log.txt.gz 2026-04-15 05:33:37,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/lava-logs.yaml 2026-04-15 05:33:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/lava_callback.json.gz 2026-04-15 05:33:37,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:37,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 05:33:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:37,651 - lava_callback - INFO - Completed processing callback for node 69defc31f490930782fbba9c 2026-04-15 05:33:37,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:57,520 - lava_callback - INFO - Received callback for node 69dee86df490930782fba3ea INFO: 172.21.0.1:46166 - "POST /node/69dee86df490930782fba3ea HTTP/1.0" 202 Accepted 2026-04-15 05:33:57,526 - lava_callback - INFO - Starting async job submit for node 69dee86df490930782fba3ea 2026-04-15 05:33:57,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:57,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:57,578 - lava_callback - DEBUG - Processing node 69dee86df490930782fba3ea: baseline-arm64-broonie 2026-04-15 05:33:57,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:57,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:57,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/log.txt.gz 2026-04-15 05:33:58,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:58,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:58,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/lava-logs.yaml 2026-04-15 05:33:58,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:58,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:58,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/lava_callback.json.gz 2026-04-15 05:33:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:58,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:33:58,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:58,530 - lava_callback - INFO - Completed processing callback for node 69dee86df490930782fba3ea INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:19,420 - lava_callback - INFO - Received callback for node 69dc80575dbfa74e32f9a111 INFO: 172.21.0.1:56042 - "POST /node/69dc80575dbfa74e32f9a111 HTTP/1.0" 202 Accepted 2026-04-15 05:34:19,428 - lava_callback - INFO - Starting async job submit for node 69dc80575dbfa74e32f9a111 2026-04-15 05:34:19,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,446 - lava_callback - DEBUG - Processing node 69dc80575dbfa74e32f9a111: baseline-arm64-clabbe 2026-04-15 05:34:19,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80575dbfa74e32f9a111 2026-04-15 05:34:19,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:34:19,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,506 - lava_callback - ERROR - Error processing callback for node 69dc80575dbfa74e32f9a111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:56,696 - lava_callback - INFO - Received callback for node 69df0364f490930782fbc2ac INFO: 172.21.0.1:45176 - "POST /node/69df0364f490930782fbc2ac HTTP/1.0" 202 Accepted 2026-04-15 05:34:56,702 - lava_callback - INFO - Starting async job submit for node 69df0364f490930782fbc2ac 2026-04-15 05:34:56,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:56,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:56,744 - lava_callback - DEBUG - Processing node 69df0364f490930782fbc2ac: baseline-arm64-broonie 2026-04-15 05:34:56,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/log.txt.gz 2026-04-15 05:34:57,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/lava-logs.yaml 2026-04-15 05:34:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/lava_callback.json.gz 2026-04-15 05:34:57,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:57,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 05:34:57,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:57,861 - lava_callback - INFO - Completed processing callback for node 69df0364f490930782fbc2ac INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:35:08,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:35:59,493 - lava_callback - INFO - Received callback for node 69dc80aa5dbfa74e32f9a183 INFO: 172.21.0.1:39808 - "POST /node/69dc80aa5dbfa74e32f9a183 HTTP/1.0" 202 Accepted 2026-04-15 05:35:59,499 - lava_callback - INFO - Starting async job submit for node 69dc80aa5dbfa74e32f9a183 2026-04-15 05:35:59,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,526 - lava_callback - DEBUG - Processing node 69dc80aa5dbfa74e32f9a183: baseline-arm64-clabbe 2026-04-15 05:35:59,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80aa5dbfa74e32f9a183 2026-04-15 05:35:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:35:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,587 - lava_callback - ERROR - Error processing callback for node 69dc80aa5dbfa74e32f9a183: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:36:59,530 - lava_callback - INFO - Received callback for node 69dc80ef5dbfa74e32f9a1c6 INFO: 172.21.0.1:44838 - "POST /node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.0" 202 Accepted 2026-04-15 05:36:59,536 - lava_callback - INFO - Starting async job submit for node 69dc80ef5dbfa74e32f9a1c6 2026-04-15 05:36:59,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,583 - lava_callback - DEBUG - Processing node 69dc80ef5dbfa74e32f9a1c6: baseline-arm64-clabbe 2026-04-15 05:36:59,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80ef5dbfa74e32f9a1c6 2026-04-15 05:36:59,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:36:59,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,656 - lava_callback - ERROR - Error processing callback for node 69dc80ef5dbfa74e32f9a1c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:38:19,622 - lava_callback - INFO - Received callback for node 69dc81355dbfa74e32f9a22e INFO: 172.21.0.1:52202 - "POST /node/69dc81355dbfa74e32f9a22e HTTP/1.0" 202 Accepted 2026-04-15 05:38:19,628 - lava_callback - INFO - Starting async job submit for node 69dc81355dbfa74e32f9a22e 2026-04-15 05:38:19,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,651 - lava_callback - DEBUG - Processing node 69dc81355dbfa74e32f9a22e: baseline-arm64-clabbe 2026-04-15 05:38:19,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc81355dbfa74e32f9a22e 2026-04-15 05:38:19,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:38:19,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,703 - lava_callback - ERROR - Error processing callback for node 69dc81355dbfa74e32f9a22e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:39:19,601 - lava_callback - INFO - Received callback for node 69dc817e5dbfa74e32f9a25f INFO: 172.21.0.1:53630 - "POST /node/69dc817e5dbfa74e32f9a25f HTTP/1.0" 202 Accepted 2026-04-15 05:39:19,607 - lava_callback - INFO - Starting async job submit for node 69dc817e5dbfa74e32f9a25f 2026-04-15 05:39:19,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,623 - lava_callback - DEBUG - Processing node 69dc817e5dbfa74e32f9a25f: baseline-arm64-clabbe 2026-04-15 05:39:19,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc817e5dbfa74e32f9a25f 2026-04-15 05:39:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:39:19,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,675 - lava_callback - ERROR - Error processing callback for node 69dc817e5dbfa74e32f9a25f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:40:39,717 - lava_callback - INFO - Received callback for node 69dc81cb5dbfa74e32f9a2ac INFO: 172.21.0.1:34598 - "POST /node/69dc81cb5dbfa74e32f9a2ac HTTP/1.0" 202 Accepted 2026-04-15 05:40:39,723 - lava_callback - INFO - Starting async job submit for node 69dc81cb5dbfa74e32f9a2ac 2026-04-15 05:40:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,739 - lava_callback - DEBUG - Processing node 69dc81cb5dbfa74e32f9a2ac: baseline-arm64-clabbe 2026-04-15 05:40:39,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc81cb5dbfa74e32f9a2ac 2026-04-15 05:40:39,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:40:39,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,800 - lava_callback - ERROR - Error processing callback for node 69dc81cb5dbfa74e32f9a2ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:42:59,820 - lava_callback - INFO - Received callback for node 69dc82525dbfa74e32f9a34a INFO: 172.21.0.1:45750 - "POST /node/69dc82525dbfa74e32f9a34a HTTP/1.0" 202 Accepted 2026-04-15 05:42:59,826 - lava_callback - INFO - Starting async job submit for node 69dc82525dbfa74e32f9a34a 2026-04-15 05:42:59,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,843 - lava_callback - DEBUG - Processing node 69dc82525dbfa74e32f9a34a: baseline-arm64-clabbe 2026-04-15 05:42:59,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc82525dbfa74e32f9a34a 2026-04-15 05:42:59,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:42:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,899 - lava_callback - ERROR - Error processing callback for node 69dc82525dbfa74e32f9a34a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:47:51,028 - lava_callback - INFO - Received callback for node 69dc83725dbfa74e32f9a458 INFO: 172.21.0.1:53690 - "POST /node/69dc83725dbfa74e32f9a458 HTTP/1.0" 202 Accepted 2026-04-15 05:47:51,034 - lava_callback - INFO - Starting async job submit for node 69dc83725dbfa74e32f9a458 2026-04-15 05:47:51,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,052 - lava_callback - DEBUG - Processing node 69dc83725dbfa74e32f9a458: baseline-arm64-baylibre 2026-04-15 05:47:51,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83725dbfa74e32f9a458 2026-04-15 05:47:51,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:47:51,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,110 - lava_callback - ERROR - Error processing callback for node 69dc83725dbfa74e32f9a458: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:48:51,017 - lava_callback - INFO - Received callback for node 69dc83b15dbfa74e32f9a4b7 INFO: 172.21.0.1:55194 - "POST /node/69dc83b15dbfa74e32f9a4b7 HTTP/1.0" 202 Accepted 2026-04-15 05:48:51,022 - lava_callback - INFO - Starting async job submit for node 69dc83b15dbfa74e32f9a4b7 2026-04-15 05:48:51,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,038 - lava_callback - DEBUG - Processing node 69dc83b15dbfa74e32f9a4b7: baseline-arm64-baylibre 2026-04-15 05:48:51,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83b15dbfa74e32f9a4b7 2026-04-15 05:48:51,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:48:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,087 - lava_callback - ERROR - Error processing callback for node 69dc83b15dbfa74e32f9a4b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:49:51,101 - lava_callback - INFO - Received callback for node 69dc83f45dbfa74e32f9a501 INFO: 172.21.0.1:52868 - "POST /node/69dc83f45dbfa74e32f9a501 HTTP/1.0" 202 Accepted 2026-04-15 05:49:51,107 - lava_callback - INFO - Starting async job submit for node 69dc83f45dbfa74e32f9a501 2026-04-15 05:49:51,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,124 - lava_callback - DEBUG - Processing node 69dc83f45dbfa74e32f9a501: baseline-arm64-baylibre 2026-04-15 05:49:51,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83f45dbfa74e32f9a501 2026-04-15 05:49:51,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:49:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,184 - lava_callback - ERROR - Error processing callback for node 69dc83f45dbfa74e32f9a501: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:50:51,143 - lava_callback - INFO - Received callback for node 69dc84375dbfa74e32f9a544 INFO: 172.21.0.1:52328 - "POST /node/69dc84375dbfa74e32f9a544 HTTP/1.0" 202 Accepted 2026-04-15 05:50:51,149 - lava_callback - INFO - Starting async job submit for node 69dc84375dbfa74e32f9a544 2026-04-15 05:50:51,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,167 - lava_callback - DEBUG - Processing node 69dc84375dbfa74e32f9a544: baseline-arm64-baylibre 2026-04-15 05:50:51,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc84375dbfa74e32f9a544 2026-04-15 05:50:51,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:50:51,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,214 - lava_callback - ERROR - Error processing callback for node 69dc84375dbfa74e32f9a544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:52:11,266 - lava_callback - INFO - Received callback for node 69dc847e5dbfa74e32f9a5a4 INFO: 172.21.0.1:35480 - "POST /node/69dc847e5dbfa74e32f9a5a4 HTTP/1.0" 202 Accepted 2026-04-15 05:52:11,272 - lava_callback - INFO - Starting async job submit for node 69dc847e5dbfa74e32f9a5a4 2026-04-15 05:52:11,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,289 - lava_callback - DEBUG - Processing node 69dc847e5dbfa74e32f9a5a4: baseline-arm64-baylibre 2026-04-15 05:52:11,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc847e5dbfa74e32f9a5a4 2026-04-15 05:52:11,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:52:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,337 - lava_callback - ERROR - Error processing callback for node 69dc847e5dbfa74e32f9a5a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:53:11,319 - lava_callback - INFO - Received callback for node 69dc84bb5dbfa74e32f9a610 INFO: 172.21.0.1:42574 - "POST /node/69dc84bb5dbfa74e32f9a610 HTTP/1.0" 202 Accepted 2026-04-15 05:53:11,328 - lava_callback - INFO - Starting async job submit for node 69dc84bb5dbfa74e32f9a610 2026-04-15 05:53:11,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,345 - lava_callback - DEBUG - Processing node 69dc84bb5dbfa74e32f9a610: baseline-arm64-baylibre 2026-04-15 05:53:11,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc84bb5dbfa74e32f9a610 2026-04-15 05:53:11,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:53:11,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,410 - lava_callback - ERROR - Error processing callback for node 69dc84bb5dbfa74e32f9a610: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:54:20,323 - lava_callback - INFO - Received callback for node 69dc85085dbfa74e32f9a642 INFO: 172.21.0.1:43394 - "POST /node/69dc85085dbfa74e32f9a642 HTTP/1.0" 202 Accepted 2026-04-15 05:54:20,329 - lava_callback - INFO - Starting async job submit for node 69dc85085dbfa74e32f9a642 2026-04-15 05:54:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,349 - lava_callback - DEBUG - Processing node 69dc85085dbfa74e32f9a642: baseline-arm64-clabbe 2026-04-15 05:54:20,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85085dbfa74e32f9a642 2026-04-15 05:54:20,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:54:20,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,397 - lava_callback - ERROR - Error processing callback for node 69dc85085dbfa74e32f9a642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:55:40,325 - lava_callback - INFO - Received callback for node 69dc854f5dbfa74e32f9a678 INFO: 172.21.0.1:38700 - "POST /node/69dc854f5dbfa74e32f9a678 HTTP/1.0" 202 Accepted 2026-04-15 05:55:40,331 - lava_callback - INFO - Starting async job submit for node 69dc854f5dbfa74e32f9a678 2026-04-15 05:55:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,347 - lava_callback - DEBUG - Processing node 69dc854f5dbfa74e32f9a678: baseline-arm64-clabbe 2026-04-15 05:55:40,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc854f5dbfa74e32f9a678 2026-04-15 05:55:40,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:55:40,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,400 - lava_callback - ERROR - Error processing callback for node 69dc854f5dbfa74e32f9a678: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:56:40,405 - lava_callback - INFO - Received callback for node 69dc85915dbfa74e32f9a6d3 INFO: 172.21.0.1:49100 - "POST /node/69dc85915dbfa74e32f9a6d3 HTTP/1.0" 202 Accepted 2026-04-15 05:56:40,411 - lava_callback - INFO - Starting async job submit for node 69dc85915dbfa74e32f9a6d3 2026-04-15 05:56:40,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,427 - lava_callback - DEBUG - Processing node 69dc85915dbfa74e32f9a6d3: baseline-arm64-clabbe 2026-04-15 05:56:40,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85915dbfa74e32f9a6d3 2026-04-15 05:56:40,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:56:40,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,485 - lava_callback - ERROR - Error processing callback for node 69dc85915dbfa74e32f9a6d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:58:20,462 - lava_callback - INFO - Received callback for node 69dc85ed5dbfa74e32f9a71c INFO: 172.21.0.1:49992 - "POST /node/69dc85ed5dbfa74e32f9a71c HTTP/1.0" 202 Accepted 2026-04-15 05:58:20,468 - lava_callback - INFO - Starting async job submit for node 69dc85ed5dbfa74e32f9a71c 2026-04-15 05:58:20,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,484 - lava_callback - DEBUG - Processing node 69dc85ed5dbfa74e32f9a71c: baseline-arm64-clabbe 2026-04-15 05:58:20,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85ed5dbfa74e32f9a71c 2026-04-15 05:58:20,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:58:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,545 - lava_callback - ERROR - Error processing callback for node 69dc85ed5dbfa74e32f9a71c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:59:20,583 - lava_callback - INFO - Received callback for node 69dc86305dbfa74e32f9a771 INFO: 172.21.0.1:38004 - "POST /node/69dc86305dbfa74e32f9a771 HTTP/1.0" 202 Accepted 2026-04-15 05:59:20,589 - lava_callback - INFO - Starting async job submit for node 69dc86305dbfa74e32f9a771 2026-04-15 05:59:20,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,605 - lava_callback - DEBUG - Processing node 69dc86305dbfa74e32f9a771: baseline-arm64-clabbe 2026-04-15 05:59:20,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86305dbfa74e32f9a771 2026-04-15 05:59:20,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:59:20,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,656 - lava_callback - ERROR - Error processing callback for node 69dc86305dbfa74e32f9a771: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:00:40,615 - lava_callback - INFO - Received callback for node 69dc86775dbfa74e32f9a7ab INFO: 172.21.0.1:50132 - "POST /node/69dc86775dbfa74e32f9a7ab HTTP/1.0" 202 Accepted 2026-04-15 06:00:40,621 - lava_callback - INFO - Starting async job submit for node 69dc86775dbfa74e32f9a7ab 2026-04-15 06:00:40,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,638 - lava_callback - DEBUG - Processing node 69dc86775dbfa74e32f9a7ab: baseline-arm64-clabbe 2026-04-15 06:00:40,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86775dbfa74e32f9a7ab 2026-04-15 06:00:40,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 06:00:40,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,684 - lava_callback - ERROR - Error processing callback for node 69dc86775dbfa74e32f9a7ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:01:40,623 - lava_callback - INFO - Received callback for node 69dc86c15dbfa74e32f9a7ed INFO: 172.21.0.1:44676 - "POST /node/69dc86c15dbfa74e32f9a7ed HTTP/1.0" 202 Accepted 2026-04-15 06:01:40,637 - lava_callback - INFO - Starting async job submit for node 69dc86c15dbfa74e32f9a7ed 2026-04-15 06:01:40,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,672 - lava_callback - DEBUG - Processing node 69dc86c15dbfa74e32f9a7ed: baseline-arm64-clabbe 2026-04-15 06:01:40,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86c15dbfa74e32f9a7ed 2026-04-15 06:01:40,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 06:01:40,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,745 - lava_callback - ERROR - Error processing callback for node 69dc86c15dbfa74e32f9a7ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:03:11,832 - lava_callback - INFO - Received callback for node 69dc87115dbfa74e32f9a84e INFO: 172.21.0.1:41798 - "POST /node/69dc87115dbfa74e32f9a84e HTTP/1.0" 202 Accepted 2026-04-15 06:03:11,838 - lava_callback - INFO - Starting async job submit for node 69dc87115dbfa74e32f9a84e 2026-04-15 06:03:11,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,860 - lava_callback - DEBUG - Processing node 69dc87115dbfa74e32f9a84e: baseline-arm64-baylibre 2026-04-15 06:03:11,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87115dbfa74e32f9a84e 2026-04-15 06:03:11,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:03:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,931 - lava_callback - ERROR - Error processing callback for node 69dc87115dbfa74e32f9a84e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:05:11,933 - lava_callback - INFO - Received callback for node 69dc87895dbfa74e32f9a88a INFO: 172.21.0.1:56420 - "POST /node/69dc87895dbfa74e32f9a88a HTTP/1.0" 202 Accepted 2026-04-15 06:05:11,938 - lava_callback - INFO - Starting async job submit for node 69dc87895dbfa74e32f9a88a 2026-04-15 06:05:11,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:11,956 - lava_callback - DEBUG - Processing node 69dc87895dbfa74e32f9a88a: baseline-arm64-baylibre 2026-04-15 06:05:11,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87895dbfa74e32f9a88a 2026-04-15 06:05:11,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:11,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:05:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:12,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:12,011 - lava_callback - ERROR - Error processing callback for node 69dc87895dbfa74e32f9a88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:06:11,922 - lava_callback - INFO - Received callback for node 69dc87d05dbfa74e32f9a8c4 INFO: 172.21.0.1:54634 - "POST /node/69dc87d05dbfa74e32f9a8c4 HTTP/1.0" 202 Accepted 2026-04-15 06:06:11,928 - lava_callback - INFO - Starting async job submit for node 69dc87d05dbfa74e32f9a8c4 2026-04-15 06:06:11,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:11,947 - lava_callback - DEBUG - Processing node 69dc87d05dbfa74e32f9a8c4: baseline-arm64-baylibre 2026-04-15 06:06:11,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87d05dbfa74e32f9a8c4 2026-04-15 06:06:11,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:11,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:06:11,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:12,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:12,006 - lava_callback - ERROR - Error processing callback for node 69dc87d05dbfa74e32f9a8c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:07:32,045 - lava_callback - INFO - Received callback for node 69dc88135dbfa74e32f9a903 INFO: 172.21.0.1:53878 - "POST /node/69dc88135dbfa74e32f9a903 HTTP/1.0" 202 Accepted 2026-04-15 06:07:32,051 - lava_callback - INFO - Starting async job submit for node 69dc88135dbfa74e32f9a903 2026-04-15 06:07:32,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,074 - lava_callback - DEBUG - Processing node 69dc88135dbfa74e32f9a903: baseline-arm64-baylibre 2026-04-15 06:07:32,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc88135dbfa74e32f9a903 2026-04-15 06:07:32,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:07:32,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,139 - lava_callback - ERROR - Error processing callback for node 69dc88135dbfa74e32f9a903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:09:52,177 - lava_callback - INFO - Received callback for node 69dc889b5dbfa74e32f9a9ac INFO: 172.21.0.1:53850 - "POST /node/69dc889b5dbfa74e32f9a9ac HTTP/1.0" 202 Accepted 2026-04-15 06:09:52,183 - lava_callback - INFO - Starting async job submit for node 69dc889b5dbfa74e32f9a9ac 2026-04-15 06:09:52,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,199 - lava_callback - DEBUG - Processing node 69dc889b5dbfa74e32f9a9ac: baseline-arm64-baylibre 2026-04-15 06:09:52,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc889b5dbfa74e32f9a9ac 2026-04-15 06:09:52,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:09:52,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,256 - lava_callback - ERROR - Error processing callback for node 69dc889b5dbfa74e32f9a9ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:11:12,279 - lava_callback - INFO - Received callback for node 69dc88f55dbfa74e32f9a9e5 INFO: 172.21.0.1:34318 - "POST /node/69dc88f55dbfa74e32f9a9e5 HTTP/1.0" 202 Accepted 2026-04-15 06:11:12,284 - lava_callback - INFO - Starting async job submit for node 69dc88f55dbfa74e32f9a9e5 2026-04-15 06:11:12,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,301 - lava_callback - DEBUG - Processing node 69dc88f55dbfa74e32f9a9e5: baseline-arm64-baylibre 2026-04-15 06:11:12,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc88f55dbfa74e32f9a9e5 2026-04-15 06:11:12,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:11:12,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,351 - lava_callback - ERROR - Error processing callback for node 69dc88f55dbfa74e32f9a9e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:12:32,338 - lava_callback - INFO - Received callback for node 69dc893b5dbfa74e32f9aa1e INFO: 172.21.0.1:53980 - "POST /node/69dc893b5dbfa74e32f9aa1e HTTP/1.0" 202 Accepted 2026-04-15 06:12:32,347 - lava_callback - INFO - Starting async job submit for node 69dc893b5dbfa74e32f9aa1e 2026-04-15 06:12:32,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,366 - lava_callback - DEBUG - Processing node 69dc893b5dbfa74e32f9aa1e: baseline-arm64-baylibre 2026-04-15 06:12:32,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc893b5dbfa74e32f9aa1e 2026-04-15 06:12:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:12:32,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,431 - lava_callback - ERROR - Error processing callback for node 69dc893b5dbfa74e32f9aa1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:13:12,276 - lava_callback - INFO - Received callback for node 69dc89755dbfa74e32f9aa83 INFO: 172.21.0.1:43534 - "POST /node/69dc89755dbfa74e32f9aa83 HTTP/1.0" 202 Accepted 2026-04-15 06:13:12,282 - lava_callback - INFO - Starting async job submit for node 69dc89755dbfa74e32f9aa83 2026-04-15 06:13:12,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,301 - lava_callback - DEBUG - Processing node 69dc89755dbfa74e32f9aa83: baseline-arm64-baylibre 2026-04-15 06:13:12,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc89755dbfa74e32f9aa83 2026-04-15 06:13:12,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:13:12,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,352 - lava_callback - ERROR - Error processing callback for node 69dc89755dbfa74e32f9aa83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET /node/69876aaee31b58f834f19719%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET /node/6986fe426e077e4126a7dbb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:37:53,769 - lava_callback - INFO - Received callback for node 69dc8f3f5dbfa74e32f9aace INFO: 172.21.0.1:47624 - "POST /node/69dc8f3f5dbfa74e32f9aace HTTP/1.0" 202 Accepted 2026-04-15 06:37:53,774 - lava_callback - INFO - Starting async job submit for node 69dc8f3f5dbfa74e32f9aace 2026-04-15 06:37:53,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,799 - lava_callback - DEBUG - Processing node 69dc8f3f5dbfa74e32f9aace: baseline-arm-baylibre 2026-04-15 06:37:53,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f3f5dbfa74e32f9aace 2026-04-15 06:37:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:37:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,854 - lava_callback - ERROR - Error processing callback for node 69dc8f3f5dbfa74e32f9aace: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET /node/6993536e523507f3806a7f05%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:38:53,682 - lava_callback - INFO - Received callback for node 69dc8f795dbfa74e32f9aae1 INFO: 172.21.0.1:35376 - "POST /node/69dc8f795dbfa74e32f9aae1 HTTP/1.0" 202 Accepted 2026-04-15 06:38:53,687 - lava_callback - INFO - Starting async job submit for node 69dc8f795dbfa74e32f9aae1 2026-04-15 06:38:53,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,703 - lava_callback - DEBUG - Processing node 69dc8f795dbfa74e32f9aae1: baseline-arm-baylibre 2026-04-15 06:38:53,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f795dbfa74e32f9aae1 2026-04-15 06:38:53,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:38:53,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,761 - lava_callback - ERROR - Error processing callback for node 69dc8f795dbfa74e32f9aae1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET /node/69bd094505e4bbd6ba635697%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:39:33,715 - lava_callback - INFO - Received callback for node 69dc8f985dbfa74e32f9aaec INFO: 172.21.0.1:47732 - "POST /node/69dc8f985dbfa74e32f9aaec HTTP/1.0" 202 Accepted 2026-04-15 06:39:33,724 - lava_callback - INFO - Starting async job submit for node 69dc8f985dbfa74e32f9aaec 2026-04-15 06:39:33,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,746 - lava_callback - DEBUG - Processing node 69dc8f985dbfa74e32f9aaec: baseline-arm-baylibre 2026-04-15 06:39:33,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f985dbfa74e32f9aaec 2026-04-15 06:39:33,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:39:33,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,805 - lava_callback - ERROR - Error processing callback for node 69dc8f985dbfa74e32f9aaec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:40:13,737 - lava_callback - INFO - Received callback for node 69dc8fb85dbfa74e32f9ab21 INFO: 172.21.0.1:53220 - "POST /node/69dc8fb85dbfa74e32f9ab21 HTTP/1.0" 202 Accepted 2026-04-15 06:40:13,742 - lava_callback - INFO - Starting async job submit for node 69dc8fb85dbfa74e32f9ab21 2026-04-15 06:40:13,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,758 - lava_callback - DEBUG - Processing node 69dc8fb85dbfa74e32f9ab21: baseline-arm-baylibre 2026-04-15 06:40:13,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8fb85dbfa74e32f9ab21 2026-04-15 06:40:13,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:40:13,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,818 - lava_callback - ERROR - Error processing callback for node 69dc8fb85dbfa74e32f9ab21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /node/693f17d524745582e399b298%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:40:33,708 - lava_callback - INFO - Received callback for node 69dc8fdd5dbfa74e32f9ab46 INFO: 172.21.0.1:59506 - "POST /node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.0" 202 Accepted 2026-04-15 06:40:33,714 - lava_callback - INFO - Starting async job submit for node 69dc8fdd5dbfa74e32f9ab46 2026-04-15 06:40:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,730 - lava_callback - DEBUG - Processing node 69dc8fdd5dbfa74e32f9ab46: baseline-arm-baylibre 2026-04-15 06:40:33,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8fdd5dbfa74e32f9ab46 2026-04-15 06:40:33,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:40:33,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,777 - lava_callback - ERROR - Error processing callback for node 69dc8fdd5dbfa74e32f9ab46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:42:13,899 - lava_callback - INFO - Received callback for node 69dc903f5dbfa74e32f9abab INFO: 172.21.0.1:37534 - "POST /node/69dc903f5dbfa74e32f9abab HTTP/1.0" 202 Accepted 2026-04-15 06:42:13,905 - lava_callback - INFO - Starting async job submit for node 69dc903f5dbfa74e32f9abab 2026-04-15 06:42:13,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,921 - lava_callback - DEBUG - Processing node 69dc903f5dbfa74e32f9abab: baseline-arm-baylibre 2026-04-15 06:42:13,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc903f5dbfa74e32f9abab 2026-04-15 06:42:13,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:42:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,976 - lava_callback - ERROR - Error processing callback for node 69dc903f5dbfa74e32f9abab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET /node/693f4bdf8b4d8f471e43d2c2%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:42:53,867 - lava_callback - INFO - Received callback for node 69dc905f5dbfa74e32f9abd8 INFO: 172.21.0.1:55314 - "POST /node/69dc905f5dbfa74e32f9abd8 HTTP/1.0" 202 Accepted 2026-04-15 06:42:53,873 - lava_callback - INFO - Starting async job submit for node 69dc905f5dbfa74e32f9abd8 2026-04-15 06:42:53,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,890 - lava_callback - DEBUG - Processing node 69dc905f5dbfa74e32f9abd8: baseline-arm-baylibre 2026-04-15 06:42:53,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc905f5dbfa74e32f9abd8 2026-04-15 06:42:53,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:42:53,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,968 - lava_callback - ERROR - Error processing callback for node 69dc905f5dbfa74e32f9abd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:43:33,926 - lava_callback - INFO - Received callback for node 69dc90825dbfa74e32f9abf1 INFO: 172.21.0.1:57764 - "POST /node/69dc90825dbfa74e32f9abf1 HTTP/1.0" 202 Accepted 2026-04-15 06:43:33,935 - lava_callback - INFO - Starting async job submit for node 69dc90825dbfa74e32f9abf1 2026-04-15 06:43:33,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:33,952 - lava_callback - DEBUG - Processing node 69dc90825dbfa74e32f9abf1: baseline-arm-baylibre 2026-04-15 06:43:33,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc90825dbfa74e32f9abf1 2026-04-15 06:43:33,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:33,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:43:33,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:34,005 - lava_callback - ERROR - Error processing callback for node 69dc90825dbfa74e32f9abf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:43:53,902 - lava_callback - INFO - Received callback for node 69dc90a15dbfa74e32f9ac05 INFO: 172.21.0.1:50688 - "POST /node/69dc90a15dbfa74e32f9ac05 HTTP/1.0" 202 Accepted 2026-04-15 06:43:53,908 - lava_callback - INFO - Starting async job submit for node 69dc90a15dbfa74e32f9ac05 2026-04-15 06:43:53,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,924 - lava_callback - DEBUG - Processing node 69dc90a15dbfa74e32f9ac05: baseline-arm-baylibre 2026-04-15 06:43:53,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc90a15dbfa74e32f9ac05 2026-04-15 06:43:53,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:43:53,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,976 - lava_callback - ERROR - Error processing callback for node 69dc90a15dbfa74e32f9ac05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:45:42,536 - lava_callback - INFO - Received callback for node 69dc91075dbfa74e32f9ac57 INFO: 172.21.0.1:39824 - "POST /node/69dc91075dbfa74e32f9ac57 HTTP/1.0" 202 Accepted 2026-04-15 06:45:42,542 - lava_callback - INFO - Starting async job submit for node 69dc91075dbfa74e32f9ac57 2026-04-15 06:45:42,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,558 - lava_callback - DEBUG - Processing node 69dc91075dbfa74e32f9ac57: baseline-arm-clabbe 2026-04-15 06:45:42,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91075dbfa74e32f9ac57 2026-04-15 06:45:42,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:45:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,620 - lava_callback - ERROR - Error processing callback for node 69dc91075dbfa74e32f9ac57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:46:14,131 - lava_callback - INFO - Received callback for node 69dc91255dbfa74e32f9ac7b INFO: 172.21.0.1:35526 - "POST /node/69dc91255dbfa74e32f9ac7b HTTP/1.0" 202 Accepted 2026-04-15 06:46:14,136 - lava_callback - INFO - Starting async job submit for node 69dc91255dbfa74e32f9ac7b 2026-04-15 06:46:14,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,152 - lava_callback - DEBUG - Processing node 69dc91255dbfa74e32f9ac7b: baseline-arm-baylibre 2026-04-15 06:46:14,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91255dbfa74e32f9ac7b 2026-04-15 06:46:14,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:46:14,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,207 - lava_callback - ERROR - Error processing callback for node 69dc91255dbfa74e32f9ac7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:46:34,060 - lava_callback - INFO - Received callback for node 69dc91435dbfa74e32f9acaf INFO: 172.21.0.1:35774 - "POST /node/69dc91435dbfa74e32f9acaf HTTP/1.0" 202 Accepted 2026-04-15 06:46:34,065 - lava_callback - INFO - Starting async job submit for node 69dc91435dbfa74e32f9acaf 2026-04-15 06:46:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,082 - lava_callback - DEBUG - Processing node 69dc91435dbfa74e32f9acaf: baseline-arm-baylibre 2026-04-15 06:46:34,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91435dbfa74e32f9acaf 2026-04-15 06:46:34,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:46:34,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,139 - lava_callback - ERROR - Error processing callback for node 69dc91435dbfa74e32f9acaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET /node/698b8d5f0a16aea5a0dc8dd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET /node/6991f78701ff1e8e0859d3b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40018 - "GET /node/693ae3a2fee8383e92b641aa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET /node/693f58570d8ce4018da8b56f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:48:34,212 - lava_callback - INFO - Received callback for node 69dc91b85dbfa74e32f9ad3c INFO: 172.21.0.1:44814 - "POST /node/69dc91b85dbfa74e32f9ad3c HTTP/1.0" 202 Accepted 2026-04-15 06:48:34,217 - lava_callback - INFO - Starting async job submit for node 69dc91b85dbfa74e32f9ad3c 2026-04-15 06:48:34,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,241 - lava_callback - DEBUG - Processing node 69dc91b85dbfa74e32f9ad3c: baseline-arm-baylibre 2026-04-15 06:48:34,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91b85dbfa74e32f9ad3c 2026-04-15 06:48:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:48:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,297 - lava_callback - ERROR - Error processing callback for node 69dc91b85dbfa74e32f9ad3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:49:14,272 - lava_callback - INFO - Received callback for node 69dc91da5dbfa74e32f9ad76 INFO: 172.21.0.1:50156 - "POST /node/69dc91da5dbfa74e32f9ad76 HTTP/1.0" 202 Accepted 2026-04-15 06:49:14,277 - lava_callback - INFO - Starting async job submit for node 69dc91da5dbfa74e32f9ad76 2026-04-15 06:49:14,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,293 - lava_callback - DEBUG - Processing node 69dc91da5dbfa74e32f9ad76: baseline-arm-baylibre 2026-04-15 06:49:14,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91da5dbfa74e32f9ad76 2026-04-15 06:49:14,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:49:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,357 - lava_callback - ERROR - Error processing callback for node 69dc91da5dbfa74e32f9ad76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:49:42,672 - lava_callback - INFO - Received callback for node 69dc91f75dbfa74e32f9adb5 INFO: 172.21.0.1:36120 - "POST /node/69dc91f75dbfa74e32f9adb5 HTTP/1.0" 202 Accepted 2026-04-15 06:49:42,679 - lava_callback - INFO - Starting async job submit for node 69dc91f75dbfa74e32f9adb5 2026-04-15 06:49:42,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,695 - lava_callback - DEBUG - Processing node 69dc91f75dbfa74e32f9adb5: baseline-arm-clabbe 2026-04-15 06:49:42,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91f75dbfa74e32f9adb5 2026-04-15 06:49:42,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:49:42,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,764 - lava_callback - ERROR - Error processing callback for node 69dc91f75dbfa74e32f9adb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36122 - "GET /node/698f87313013abef95d0234c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36130 - "GET /node/6953789e31522df6df79e986%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:50:14,272 - lava_callback - INFO - Received callback for node 69dc92185dbfa74e32f9adc3 INFO: 172.21.0.1:43598 - "POST /node/69dc92185dbfa74e32f9adc3 HTTP/1.0" 202 Accepted 2026-04-15 06:50:14,278 - lava_callback - INFO - Starting async job submit for node 69dc92185dbfa74e32f9adc3 2026-04-15 06:50:14,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,294 - lava_callback - DEBUG - Processing node 69dc92185dbfa74e32f9adc3: baseline-arm-baylibre 2026-04-15 06:50:14,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92185dbfa74e32f9adc3 2026-04-15 06:50:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:50:14,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,364 - lava_callback - ERROR - Error processing callback for node 69dc92185dbfa74e32f9adc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET /node/698f868a3013abef95d02170%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43254 - "GET /node/693e3edf407f32424eb5ce5b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:50:54,345 - lava_callback - INFO - Received callback for node 69dc923c5dbfa74e32f9add2 INFO: 172.21.0.1:41296 - "POST /node/69dc923c5dbfa74e32f9add2 HTTP/1.0" 202 Accepted 2026-04-15 06:50:54,350 - lava_callback - INFO - Starting async job submit for node 69dc923c5dbfa74e32f9add2 2026-04-15 06:50:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,367 - lava_callback - DEBUG - Processing node 69dc923c5dbfa74e32f9add2: baseline-arm-baylibre 2026-04-15 06:50:54,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc923c5dbfa74e32f9add2 2026-04-15 06:50:54,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:50:54,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,428 - lava_callback - ERROR - Error processing callback for node 69dc923c5dbfa74e32f9add2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:51:14,330 - lava_callback - INFO - Received callback for node 69dc925c5dbfa74e32f9adf6 INFO: 172.21.0.1:41634 - "POST /node/69dc925c5dbfa74e32f9adf6 HTTP/1.0" 202 Accepted 2026-04-15 06:51:14,339 - lava_callback - INFO - Starting async job submit for node 69dc925c5dbfa74e32f9adf6 2026-04-15 06:51:14,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,357 - lava_callback - DEBUG - Processing node 69dc925c5dbfa74e32f9adf6: baseline-arm-baylibre 2026-04-15 06:51:14,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc925c5dbfa74e32f9adf6 2026-04-15 06:51:14,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:51:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,421 - lava_callback - ERROR - Error processing callback for node 69dc925c5dbfa74e32f9adf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET /node/6992eebe31166481c8dda08c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:52:42,848 - lava_callback - INFO - Received callback for node 69dc92b75dbfa74e32f9ae6b INFO: 172.21.0.1:48352 - "POST /node/69dc92b75dbfa74e32f9ae6b HTTP/1.0" 202 Accepted 2026-04-15 06:52:42,855 - lava_callback - INFO - Starting async job submit for node 69dc92b75dbfa74e32f9ae6b 2026-04-15 06:52:42,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,871 - lava_callback - DEBUG - Processing node 69dc92b75dbfa74e32f9ae6b: baseline-arm-clabbe 2026-04-15 06:52:42,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92b75dbfa74e32f9ae6b 2026-04-15 06:52:42,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:52:42,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,921 - lava_callback - ERROR - Error processing callback for node 69dc92b75dbfa74e32f9ae6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:53:22,782 - lava_callback - INFO - Received callback for node 69dc92d85dbfa74e32f9ae9a INFO: 172.21.0.1:41444 - "POST /node/69dc92d85dbfa74e32f9ae9a HTTP/1.0" 202 Accepted 2026-04-15 06:53:22,788 - lava_callback - INFO - Starting async job submit for node 69dc92d85dbfa74e32f9ae9a 2026-04-15 06:53:22,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,804 - lava_callback - DEBUG - Processing node 69dc92d85dbfa74e32f9ae9a: baseline-arm-clabbe 2026-04-15 06:53:22,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92d85dbfa74e32f9ae9a 2026-04-15 06:53:22,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:53:22,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,860 - lava_callback - ERROR - Error processing callback for node 69dc92d85dbfa74e32f9ae9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41454 - "GET /node/6985ea5671989fb14149cb75%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41460 - "GET /node/69876d86e31b58f834f19d47%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:54:02,886 - lava_callback - INFO - Received callback for node 69dc92fb5dbfa74e32f9aebc INFO: 172.21.0.1:33870 - "POST /node/69dc92fb5dbfa74e32f9aebc HTTP/1.0" 202 Accepted 2026-04-15 06:54:02,891 - lava_callback - INFO - Starting async job submit for node 69dc92fb5dbfa74e32f9aebc 2026-04-15 06:54:02,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,907 - lava_callback - DEBUG - Processing node 69dc92fb5dbfa74e32f9aebc: baseline-arm-clabbe 2026-04-15 06:54:02,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92fb5dbfa74e32f9aebc 2026-04-15 06:54:02,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:54:02,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,970 - lava_callback - ERROR - Error processing callback for node 69dc92fb5dbfa74e32f9aebc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:54:22,815 - lava_callback - INFO - Received callback for node 69dc93185dbfa74e32f9aed2 INFO: 172.21.0.1:59364 - "POST /node/69dc93185dbfa74e32f9aed2 HTTP/1.0" 202 Accepted 2026-04-15 06:54:22,824 - lava_callback - INFO - Starting async job submit for node 69dc93185dbfa74e32f9aed2 2026-04-15 06:54:22,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,846 - lava_callback - DEBUG - Processing node 69dc93185dbfa74e32f9aed2: baseline-arm-clabbe 2026-04-15 06:54:22,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93185dbfa74e32f9aed2 2026-04-15 06:54:22,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:54:22,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,909 - lava_callback - ERROR - Error processing callback for node 69dc93185dbfa74e32f9aed2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET /node/698937a785773790cd34cdb1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54316 - "GET /node/698a9aadd9a1cfa777a24bab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:55:02,863 - lava_callback - INFO - Received callback for node 69dc93335dbfa74e32f9af0b INFO: 172.21.0.1:40724 - "POST /node/69dc93335dbfa74e32f9af0b HTTP/1.0" 202 Accepted 2026-04-15 06:55:02,869 - lava_callback - INFO - Starting async job submit for node 69dc93335dbfa74e32f9af0b 2026-04-15 06:55:02,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,892 - lava_callback - DEBUG - Processing node 69dc93335dbfa74e32f9af0b: baseline-arm-clabbe 2026-04-15 06:55:02,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93335dbfa74e32f9af0b 2026-04-15 06:55:02,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:55:02,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,977 - lava_callback - ERROR - Error processing callback for node 69dc93335dbfa74e32f9af0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET /node/6988bc5c9fc35f969e1ecda7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:55:22,891 - lava_callback - INFO - Received callback for node 69dc934d5dbfa74e32f9af58 INFO: 172.21.0.1:33288 - "POST /node/69dc934d5dbfa74e32f9af58 HTTP/1.0" 202 Accepted 2026-04-15 06:55:22,897 - lava_callback - INFO - Starting async job submit for node 69dc934d5dbfa74e32f9af58 2026-04-15 06:55:22,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,913 - lava_callback - DEBUG - Processing node 69dc934d5dbfa74e32f9af58: baseline-arm-clabbe 2026-04-15 06:55:22,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc934d5dbfa74e32f9af58 2026-04-15 06:55:22,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:55:22,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,965 - lava_callback - ERROR - Error processing callback for node 69dc934d5dbfa74e32f9af58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:56:02,926 - lava_callback - INFO - Received callback for node 69dc936d5dbfa74e32f9af7f INFO: 172.21.0.1:41274 - "POST /node/69dc936d5dbfa74e32f9af7f HTTP/1.0" 202 Accepted 2026-04-15 06:56:02,931 - lava_callback - INFO - Starting async job submit for node 69dc936d5dbfa74e32f9af7f 2026-04-15 06:56:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,947 - lava_callback - DEBUG - Processing node 69dc936d5dbfa74e32f9af7f: baseline-arm-clabbe 2026-04-15 06:56:02,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc936d5dbfa74e32f9af7f 2026-04-15 06:56:02,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:56:02,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,996 - lava_callback - ERROR - Error processing callback for node 69dc936d5dbfa74e32f9af7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:56:22,959 - lava_callback - INFO - Received callback for node 69dc93905dbfa74e32f9afa8 INFO: 172.21.0.1:54654 - "POST /node/69dc93905dbfa74e32f9afa8 HTTP/1.0" 202 Accepted 2026-04-15 06:56:22,966 - lava_callback - INFO - Starting async job submit for node 69dc93905dbfa74e32f9afa8 2026-04-15 06:56:22,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:22,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:22,985 - lava_callback - DEBUG - Processing node 69dc93905dbfa74e32f9afa8: baseline-arm-clabbe 2026-04-15 06:56:22,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93905dbfa74e32f9afa8 2026-04-15 06:56:22,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:22,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:23,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:23,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:56:23,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:23,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:23,033 - lava_callback - ERROR - Error processing callback for node 69dc93905dbfa74e32f9afa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET /node/699358e2523507f3806a953d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48860 - "GET /node/695323b831522df6df79b357%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:57:02,992 - lava_callback - INFO - Received callback for node 69dc93b15dbfa74e32f9afbf INFO: 172.21.0.1:48864 - "POST /node/69dc93b15dbfa74e32f9afbf HTTP/1.0" 202 Accepted 2026-04-15 06:57:02,998 - lava_callback - INFO - Starting async job submit for node 69dc93b15dbfa74e32f9afbf 2026-04-15 06:57:02,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,017 - lava_callback - DEBUG - Processing node 69dc93b15dbfa74e32f9afbf: baseline-arm-clabbe 2026-04-15 06:57:03,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93b15dbfa74e32f9afbf 2026-04-15 06:57:03,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:57:03,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,079 - lava_callback - ERROR - Error processing callback for node 69dc93b15dbfa74e32f9afbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:57:34,764 - lava_callback - INFO - Received callback for node 69dc93d15dbfa74e32f9afda INFO: 172.21.0.1:59814 - "POST /node/69dc93d15dbfa74e32f9afda HTTP/1.0" 202 Accepted 2026-04-15 06:57:34,770 - lava_callback - INFO - Starting async job submit for node 69dc93d15dbfa74e32f9afda 2026-04-15 06:57:34,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,785 - lava_callback - DEBUG - Processing node 69dc93d15dbfa74e32f9afda: baseline-arm-baylibre 2026-04-15 06:57:34,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93d15dbfa74e32f9afda 2026-04-15 06:57:34,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:57:34,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,837 - lava_callback - ERROR - Error processing callback for node 69dc93d15dbfa74e32f9afda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:58:03,083 - lava_callback - INFO - Received callback for node 69dc93f75dbfa74e32f9aff6 INFO: 172.21.0.1:43412 - "POST /node/69dc93f75dbfa74e32f9aff6 HTTP/1.0" 202 Accepted 2026-04-15 06:58:03,088 - lava_callback - INFO - Starting async job submit for node 69dc93f75dbfa74e32f9aff6 2026-04-15 06:58:03,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,105 - lava_callback - DEBUG - Processing node 69dc93f75dbfa74e32f9aff6: baseline-arm-clabbe 2026-04-15 06:58:03,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93f75dbfa74e32f9aff6 2026-04-15 06:58:03,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:58:03,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,154 - lava_callback - ERROR - Error processing callback for node 69dc93f75dbfa74e32f9aff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:58:43,071 - lava_callback - INFO - Received callback for node 69dc941b5dbfa74e32f9b002 INFO: 172.21.0.1:60820 - "POST /node/69dc941b5dbfa74e32f9b002 HTTP/1.0" 202 Accepted 2026-04-15 06:58:43,077 - lava_callback - INFO - Starting async job submit for node 69dc941b5dbfa74e32f9b002 2026-04-15 06:58:43,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,092 - lava_callback - DEBUG - Processing node 69dc941b5dbfa74e32f9b002: baseline-arm-clabbe 2026-04-15 06:58:43,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc941b5dbfa74e32f9b002 2026-04-15 06:58:43,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:58:43,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,146 - lava_callback - ERROR - Error processing callback for node 69dc941b5dbfa74e32f9b002: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:59:23,100 - lava_callback - INFO - Received callback for node 69dc943f5dbfa74e32f9b02b INFO: 172.21.0.1:57082 - "POST /node/69dc943f5dbfa74e32f9b02b HTTP/1.0" 202 Accepted 2026-04-15 06:59:23,108 - lava_callback - INFO - Starting async job submit for node 69dc943f5dbfa74e32f9b02b 2026-04-15 06:59:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,124 - lava_callback - DEBUG - Processing node 69dc943f5dbfa74e32f9b02b: baseline-arm-clabbe 2026-04-15 06:59:23,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc943f5dbfa74e32f9b02b 2026-04-15 06:59:23,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:59:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,176 - lava_callback - ERROR - Error processing callback for node 69dc943f5dbfa74e32f9b02b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:00:03,113 - lava_callback - INFO - Received callback for node 69dc94635dbfa74e32f9b046 INFO: 172.21.0.1:56834 - "POST /node/69dc94635dbfa74e32f9b046 HTTP/1.0" 202 Accepted 2026-04-15 07:00:03,119 - lava_callback - INFO - Starting async job submit for node 69dc94635dbfa74e32f9b046 2026-04-15 07:00:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,143 - lava_callback - DEBUG - Processing node 69dc94635dbfa74e32f9b046: baseline-arm-clabbe 2026-04-15 07:00:03,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94635dbfa74e32f9b046 2026-04-15 07:00:03,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:00:03,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,201 - lava_callback - ERROR - Error processing callback for node 69dc94635dbfa74e32f9b046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56838 - "GET /node/6951454c55ab4e5dcfcc0962%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:00:23,158 - lava_callback - INFO - Received callback for node 69dc94845dbfa74e32f9b072 INFO: 172.21.0.1:54582 - "POST /node/69dc94845dbfa74e32f9b072 HTTP/1.0" 202 Accepted 2026-04-15 07:00:23,163 - lava_callback - INFO - Starting async job submit for node 69dc94845dbfa74e32f9b072 2026-04-15 07:00:23,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,180 - lava_callback - DEBUG - Processing node 69dc94845dbfa74e32f9b072: baseline-arm-clabbe 2026-04-15 07:00:23,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94845dbfa74e32f9b072 2026-04-15 07:00:23,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:00:23,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,230 - lava_callback - ERROR - Error processing callback for node 69dc94845dbfa74e32f9b072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:01:03,163 - lava_callback - INFO - Received callback for node 69dc94a55dbfa74e32f9b08e INFO: 172.21.0.1:52666 - "POST /node/69dc94a55dbfa74e32f9b08e HTTP/1.0" 202 Accepted 2026-04-15 07:01:03,168 - lava_callback - INFO - Starting async job submit for node 69dc94a55dbfa74e32f9b08e 2026-04-15 07:01:03,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,194 - lava_callback - DEBUG - Processing node 69dc94a55dbfa74e32f9b08e: baseline-arm-clabbe 2026-04-15 07:01:03,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94a55dbfa74e32f9b08e 2026-04-15 07:01:03,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:01:03,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,255 - lava_callback - ERROR - Error processing callback for node 69dc94a55dbfa74e32f9b08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET /node/698a7f2bd9a1cfa777a229a5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59036 - "GET /node/69522ba95318368af0c48ecb%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 07:01:43,190 - lava_callback - INFO - Received callback for node 69dc94c65dbfa74e32f9b0af INFO: 172.21.0.1:59044 - "POST /node/69dc94c65dbfa74e32f9b0af HTTP/1.0" 202 Accepted 2026-04-15 07:01:43,198 - lava_callback - INFO - Starting async job submit for node 69dc94c65dbfa74e32f9b0af 2026-04-15 07:01:43,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,216 - lava_callback - DEBUG - Processing node 69dc94c65dbfa74e32f9b0af: baseline-arm-clabbe 2026-04-15 07:01:43,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94c65dbfa74e32f9b0af 2026-04-15 07:01:43,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:01:43,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,296 - lava_callback - ERROR - Error processing callback for node 69dc94c65dbfa74e32f9b0af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:02:03,175 - lava_callback - INFO - Received callback for node 69dc94e35dbfa74e32f9b0d0 INFO: 172.21.0.1:39364 - "POST /node/69dc94e35dbfa74e32f9b0d0 HTTP/1.0" 202 Accepted 2026-04-15 07:02:03,187 - lava_callback - INFO - Starting async job submit for node 69dc94e35dbfa74e32f9b0d0 2026-04-15 07:02:03,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,218 - lava_callback - DEBUG - Processing node 69dc94e35dbfa74e32f9b0d0: baseline-arm-clabbe 2026-04-15 07:02:03,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94e35dbfa74e32f9b0d0 2026-04-15 07:02:03,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:02:03,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,285 - lava_callback - ERROR - Error processing callback for node 69dc94e35dbfa74e32f9b0d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:02:43,246 - lava_callback - INFO - Received callback for node 69dc95015dbfa74e32f9b105 INFO: 172.21.0.1:42106 - "POST /node/69dc95015dbfa74e32f9b105 HTTP/1.0" 202 Accepted 2026-04-15 07:02:43,251 - lava_callback - INFO - Starting async job submit for node 69dc95015dbfa74e32f9b105 2026-04-15 07:02:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,266 - lava_callback - DEBUG - Processing node 69dc95015dbfa74e32f9b105: baseline-arm-clabbe 2026-04-15 07:02:43,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95015dbfa74e32f9b105 2026-04-15 07:02:43,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:02:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,321 - lava_callback - ERROR - Error processing callback for node 69dc95015dbfa74e32f9b105: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:03:23,213 - lava_callback - INFO - Received callback for node 69dc95265dbfa74e32f9b144 INFO: 172.21.0.1:47590 - "POST /node/69dc95265dbfa74e32f9b144 HTTP/1.0" 202 Accepted 2026-04-15 07:03:23,219 - lava_callback - INFO - Starting async job submit for node 69dc95265dbfa74e32f9b144 2026-04-15 07:03:23,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,238 - lava_callback - DEBUG - Processing node 69dc95265dbfa74e32f9b144: baseline-arm-clabbe 2026-04-15 07:03:23,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95265dbfa74e32f9b144 2026-04-15 07:03:23,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:03:23,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,299 - lava_callback - ERROR - Error processing callback for node 69dc95265dbfa74e32f9b144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:03:43,265 - lava_callback - INFO - Received callback for node 69dc95475dbfa74e32f9b15f INFO: 172.21.0.1:49206 - "POST /node/69dc95475dbfa74e32f9b15f HTTP/1.0" 202 Accepted 2026-04-15 07:03:43,270 - lava_callback - INFO - Starting async job submit for node 69dc95475dbfa74e32f9b15f 2026-04-15 07:03:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,293 - lava_callback - DEBUG - Processing node 69dc95475dbfa74e32f9b15f: baseline-arm-clabbe 2026-04-15 07:03:43,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95475dbfa74e32f9b15f 2026-04-15 07:03:43,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:03:43,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,361 - lava_callback - ERROR - Error processing callback for node 69dc95475dbfa74e32f9b15f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:04:23,242 - lava_callback - INFO - Received callback for node 69dc95645dbfa74e32f9b18f INFO: 172.21.0.1:39538 - "POST /node/69dc95645dbfa74e32f9b18f HTTP/1.0" 202 Accepted 2026-04-15 07:04:23,250 - lava_callback - INFO - Starting async job submit for node 69dc95645dbfa74e32f9b18f 2026-04-15 07:04:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,271 - lava_callback - DEBUG - Processing node 69dc95645dbfa74e32f9b18f: baseline-arm-clabbe 2026-04-15 07:04:23,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95645dbfa74e32f9b18f 2026-04-15 07:04:23,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:04:23,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,341 - lava_callback - ERROR - Error processing callback for node 69dc95645dbfa74e32f9b18f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:04:43,304 - lava_callback - INFO - Received callback for node 69dc95865dbfa74e32f9b1a0 INFO: 172.21.0.1:38824 - "POST /node/69dc95865dbfa74e32f9b1a0 HTTP/1.0" 202 Accepted 2026-04-15 07:04:43,310 - lava_callback - INFO - Starting async job submit for node 69dc95865dbfa74e32f9b1a0 2026-04-15 07:04:43,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,325 - lava_callback - DEBUG - Processing node 69dc95865dbfa74e32f9b1a0: baseline-arm-clabbe 2026-04-15 07:04:43,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95865dbfa74e32f9b1a0 2026-04-15 07:04:43,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:04:43,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,378 - lava_callback - ERROR - Error processing callback for node 69dc95865dbfa74e32f9b1a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:05:23,327 - lava_callback - INFO - Received callback for node 69dc95a15dbfa74e32f9b1e1 INFO: 172.21.0.1:54116 - "POST /node/69dc95a15dbfa74e32f9b1e1 HTTP/1.0" 202 Accepted 2026-04-15 07:05:23,333 - lava_callback - INFO - Starting async job submit for node 69dc95a15dbfa74e32f9b1e1 2026-04-15 07:05:23,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,348 - lava_callback - DEBUG - Processing node 69dc95a15dbfa74e32f9b1e1: baseline-arm-clabbe 2026-04-15 07:05:23,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95a15dbfa74e32f9b1e1 2026-04-15 07:05:23,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:05:23,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,397 - lava_callback - ERROR - Error processing callback for node 69dc95a15dbfa74e32f9b1e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:05:43,350 - lava_callback - INFO - Received callback for node 69dc95c15dbfa74e32f9b211 INFO: 172.21.0.1:36328 - "POST /node/69dc95c15dbfa74e32f9b211 HTTP/1.0" 202 Accepted 2026-04-15 07:05:43,356 - lava_callback - INFO - Starting async job submit for node 69dc95c15dbfa74e32f9b211 2026-04-15 07:05:43,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,372 - lava_callback - DEBUG - Processing node 69dc95c15dbfa74e32f9b211: baseline-arm-clabbe 2026-04-15 07:05:43,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95c15dbfa74e32f9b211 2026-04-15 07:05:43,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:05:43,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,422 - lava_callback - ERROR - Error processing callback for node 69dc95c15dbfa74e32f9b211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:06:23,331 - lava_callback - INFO - Received callback for node 69dc95e35dbfa74e32f9b236 INFO: 172.21.0.1:35108 - "POST /node/69dc95e35dbfa74e32f9b236 HTTP/1.0" 202 Accepted 2026-04-15 07:06:23,337 - lava_callback - INFO - Starting async job submit for node 69dc95e35dbfa74e32f9b236 2026-04-15 07:06:23,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,357 - lava_callback - DEBUG - Processing node 69dc95e35dbfa74e32f9b236: baseline-arm-clabbe 2026-04-15 07:06:23,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95e35dbfa74e32f9b236 2026-04-15 07:06:23,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:06:23,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,426 - lava_callback - ERROR - Error processing callback for node 69dc95e35dbfa74e32f9b236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET /node/691a0af0eaa94778a74d5ac1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:13:35,644 - lava_callback - INFO - Received callback for node 69dc97915dbfa74e32f9b452 INFO: 172.21.0.1:53566 - "POST /node/69dc97915dbfa74e32f9b452 HTTP/1.0" 202 Accepted 2026-04-15 07:13:35,650 - lava_callback - INFO - Starting async job submit for node 69dc97915dbfa74e32f9b452 2026-04-15 07:13:35,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,665 - lava_callback - DEBUG - Processing node 69dc97915dbfa74e32f9b452: baseline-arm64-baylibre 2026-04-15 07:13:35,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc97915dbfa74e32f9b452 2026-04-15 07:13:35,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:13:35,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,741 - lava_callback - ERROR - Error processing callback for node 69dc97915dbfa74e32f9b452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:14:35,645 - lava_callback - INFO - Received callback for node 69dc97d25dbfa74e32f9b4b9 INFO: 172.21.0.1:57420 - "POST /node/69dc97d25dbfa74e32f9b4b9 HTTP/1.0" 202 Accepted 2026-04-15 07:14:35,651 - lava_callback - INFO - Starting async job submit for node 69dc97d25dbfa74e32f9b4b9 2026-04-15 07:14:35,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,668 - lava_callback - DEBUG - Processing node 69dc97d25dbfa74e32f9b4b9: baseline-arm64-baylibre 2026-04-15 07:14:35,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc97d25dbfa74e32f9b4b9 2026-04-15 07:14:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:14:35,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,743 - lava_callback - ERROR - Error processing callback for node 69dc97d25dbfa74e32f9b4b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:16:55,710 - lava_callback - INFO - Received callback for node 69dc98605dbfa74e32f9b539 INFO: 172.21.0.1:48422 - "POST /node/69dc98605dbfa74e32f9b539 HTTP/1.0" 202 Accepted 2026-04-15 07:16:55,717 - lava_callback - INFO - Starting async job submit for node 69dc98605dbfa74e32f9b539 2026-04-15 07:16:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,732 - lava_callback - DEBUG - Processing node 69dc98605dbfa74e32f9b539: baseline-arm64-baylibre 2026-04-15 07:16:55,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98605dbfa74e32f9b539 2026-04-15 07:16:55,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:16:55,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,785 - lava_callback - ERROR - Error processing callback for node 69dc98605dbfa74e32f9b539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:17:55,786 - lava_callback - INFO - Received callback for node 69dc98a25dbfa74e32f9b58c INFO: 172.21.0.1:60646 - "POST /node/69dc98a25dbfa74e32f9b58c HTTP/1.0" 202 Accepted 2026-04-15 07:17:55,795 - lava_callback - INFO - Starting async job submit for node 69dc98a25dbfa74e32f9b58c 2026-04-15 07:17:55,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,822 - lava_callback - DEBUG - Processing node 69dc98a25dbfa74e32f9b58c: baseline-arm64-baylibre 2026-04-15 07:17:55,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98a25dbfa74e32f9b58c 2026-04-15 07:17:55,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:17:55,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,884 - lava_callback - ERROR - Error processing callback for node 69dc98a25dbfa74e32f9b58c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 07:19:15,946 - lava_callback - INFO - Received callback for node 69dc98e95dbfa74e32f9b5c8 INFO: 172.21.0.1:36054 - "POST /node/69dc98e95dbfa74e32f9b5c8 HTTP/1.0" 202 Accepted 2026-04-15 07:19:15,952 - lava_callback - INFO - Starting async job submit for node 69dc98e95dbfa74e32f9b5c8 2026-04-15 07:19:15,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:15,968 - lava_callback - DEBUG - Processing node 69dc98e95dbfa74e32f9b5c8: baseline-arm64-baylibre 2026-04-15 07:19:15,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98e95dbfa74e32f9b5c8 2026-04-15 07:19:15,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:19:15,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:16,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:16,021 - lava_callback - ERROR - Error processing callback for node 69dc98e95dbfa74e32f9b5c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 07:20:15,887 - lava_callback - INFO - Received callback for node 69dc992e5dbfa74e32f9b616 INFO: 172.21.0.1:34024 - "POST /node/69dc992e5dbfa74e32f9b616 HTTP/1.0" 202 Accepted 2026-04-15 07:20:15,894 - lava_callback - INFO - Starting async job submit for node 69dc992e5dbfa74e32f9b616 2026-04-15 07:20:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,917 - lava_callback - DEBUG - Processing node 69dc992e5dbfa74e32f9b616: baseline-arm64-baylibre 2026-04-15 07:20:15,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc992e5dbfa74e32f9b616 2026-04-15 07:20:15,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:20:15,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,980 - lava_callback - ERROR - Error processing callback for node 69dc992e5dbfa74e32f9b616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:21:43,950 - lava_callback - INFO - Received callback for node 69dc997b5dbfa74e32f9b64f INFO: 172.21.0.1:58114 - "POST /node/69dc997b5dbfa74e32f9b64f HTTP/1.0" 202 Accepted 2026-04-15 07:21:43,956 - lava_callback - INFO - Starting async job submit for node 69dc997b5dbfa74e32f9b64f 2026-04-15 07:21:43,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:43,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:43,974 - lava_callback - DEBUG - Processing node 69dc997b5dbfa74e32f9b64f: baseline-arm64-clabbe 2026-04-15 07:21:43,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc997b5dbfa74e32f9b64f 2026-04-15 07:21:43,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:43,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:43,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:44,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:21:44,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:44,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:44,046 - lava_callback - ERROR - Error processing callback for node 69dc997b5dbfa74e32f9b64f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:23:03,954 - lava_callback - INFO - Received callback for node 69dc99c55dbfa74e32f9b675 INFO: 172.21.0.1:43098 - "POST /node/69dc99c55dbfa74e32f9b675 HTTP/1.0" 202 Accepted 2026-04-15 07:23:03,962 - lava_callback - INFO - Starting async job submit for node 69dc99c55dbfa74e32f9b675 2026-04-15 07:23:03,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:03,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:03,979 - lava_callback - DEBUG - Processing node 69dc99c55dbfa74e32f9b675: baseline-arm64-clabbe 2026-04-15 07:23:03,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc99c55dbfa74e32f9b675 2026-04-15 07:23:03,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:03,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:03,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:04,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:23:04,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:04,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:04,042 - lava_callback - ERROR - Error processing callback for node 69dc99c55dbfa74e32f9b675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:24:04,083 - lava_callback - INFO - Received callback for node 69dc9a075dbfa74e32f9b6c9 INFO: 172.21.0.1:53272 - "POST /node/69dc9a075dbfa74e32f9b6c9 HTTP/1.0" 202 Accepted 2026-04-15 07:24:04,089 - lava_callback - INFO - Starting async job submit for node 69dc9a075dbfa74e32f9b6c9 2026-04-15 07:24:04,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,105 - lava_callback - DEBUG - Processing node 69dc9a075dbfa74e32f9b6c9: baseline-arm64-clabbe 2026-04-15 07:24:04,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a075dbfa74e32f9b6c9 2026-04-15 07:24:04,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:24:04,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,167 - lava_callback - ERROR - Error processing callback for node 69dc9a075dbfa74e32f9b6c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:25:04,052 - lava_callback - INFO - Received callback for node 69dc9a4c5dbfa74e32f9b711 INFO: 172.21.0.1:40378 - "POST /node/69dc9a4c5dbfa74e32f9b711 HTTP/1.0" 202 Accepted 2026-04-15 07:25:04,058 - lava_callback - INFO - Starting async job submit for node 69dc9a4c5dbfa74e32f9b711 2026-04-15 07:25:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,076 - lava_callback - DEBUG - Processing node 69dc9a4c5dbfa74e32f9b711: baseline-arm64-clabbe 2026-04-15 07:25:04,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a4c5dbfa74e32f9b711 2026-04-15 07:25:04,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:25:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,124 - lava_callback - ERROR - Error processing callback for node 69dc9a4c5dbfa74e32f9b711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:26:24,145 - lava_callback - INFO - Received callback for node 69dc9a965dbfa74e32f9b742 INFO: 172.21.0.1:39370 - "POST /node/69dc9a965dbfa74e32f9b742 HTTP/1.0" 202 Accepted 2026-04-15 07:26:24,151 - lava_callback - INFO - Starting async job submit for node 69dc9a965dbfa74e32f9b742 2026-04-15 07:26:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,172 - lava_callback - DEBUG - Processing node 69dc9a965dbfa74e32f9b742: baseline-arm64-clabbe 2026-04-15 07:26:24,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a965dbfa74e32f9b742 2026-04-15 07:26:24,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:26:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,223 - lava_callback - ERROR - Error processing callback for node 69dc9a965dbfa74e32f9b742: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:27:44,122 - lava_callback - INFO - Received callback for node 69dc9ade5dbfa74e32f9b76f INFO: 172.21.0.1:39434 - "POST /node/69dc9ade5dbfa74e32f9b76f HTTP/1.0" 202 Accepted 2026-04-15 07:27:44,127 - lava_callback - INFO - Starting async job submit for node 69dc9ade5dbfa74e32f9b76f 2026-04-15 07:27:44,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,144 - lava_callback - DEBUG - Processing node 69dc9ade5dbfa74e32f9b76f: baseline-arm64-clabbe 2026-04-15 07:27:44,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ade5dbfa74e32f9b76f 2026-04-15 07:27:44,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:27:44,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,199 - lava_callback - ERROR - Error processing callback for node 69dc9ade5dbfa74e32f9b76f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:28:44,175 - lava_callback - INFO - Received callback for node 69dc9b205dbfa74e32f9b7d8 INFO: 172.21.0.1:39970 - "POST /node/69dc9b205dbfa74e32f9b7d8 HTTP/1.0" 202 Accepted 2026-04-15 07:28:44,180 - lava_callback - INFO - Starting async job submit for node 69dc9b205dbfa74e32f9b7d8 2026-04-15 07:28:44,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,209 - lava_callback - DEBUG - Processing node 69dc9b205dbfa74e32f9b7d8: baseline-arm64-clabbe 2026-04-15 07:28:44,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9b205dbfa74e32f9b7d8 2026-04-15 07:28:44,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:28:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,258 - lava_callback - ERROR - Error processing callback for node 69dc9b205dbfa74e32f9b7d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:29:56,524 - lava_callback - INFO - Received callback for node 69dc9b645dbfa74e32f9b7fd INFO: 172.21.0.1:45206 - "POST /node/69dc9b645dbfa74e32f9b7fd HTTP/1.0" 202 Accepted 2026-04-15 07:29:56,530 - lava_callback - INFO - Starting async job submit for node 69dc9b645dbfa74e32f9b7fd 2026-04-15 07:29:56,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:29:56,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,551 - lava_callback - DEBUG - Processing node 69dc9b645dbfa74e32f9b7fd: baseline-arm64-baylibre 2026-04-15 07:29:56,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9b645dbfa74e32f9b7fd 2026-04-15 07:29:56,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:29:56,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,631 - lava_callback - ERROR - Error processing callback for node 69dc9b645dbfa74e32f9b7fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:30:56,449 - lava_callback - INFO - Received callback for node 69dc9ba65dbfa74e32f9b82e INFO: 172.21.0.1:32992 - "POST /node/69dc9ba65dbfa74e32f9b82e HTTP/1.0" 202 Accepted 2026-04-15 07:30:56,458 - lava_callback - INFO - Starting async job submit for node 69dc9ba65dbfa74e32f9b82e 2026-04-15 07:30:56,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,476 - lava_callback - DEBUG - Processing node 69dc9ba65dbfa74e32f9b82e: baseline-arm64-baylibre 2026-04-15 07:30:56,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ba65dbfa74e32f9b82e 2026-04-15 07:30:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:30:56,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:30:56,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,548 - lava_callback - ERROR - Error processing callback for node 69dc9ba65dbfa74e32f9b82e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:32:16,604 - lava_callback - INFO - Received callback for node 69dc9bec5dbfa74e32f9b882 INFO: 172.21.0.1:51804 - "POST /node/69dc9bec5dbfa74e32f9b882 HTTP/1.0" 202 Accepted 2026-04-15 07:32:16,610 - lava_callback - INFO - Starting async job submit for node 69dc9bec5dbfa74e32f9b882 2026-04-15 07:32:16,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,626 - lava_callback - DEBUG - Processing node 69dc9bec5dbfa74e32f9b882: baseline-arm64-baylibre 2026-04-15 07:32:16,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9bec5dbfa74e32f9b882 2026-04-15 07:32:16,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:32:16,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,677 - lava_callback - ERROR - Error processing callback for node 69dc9bec5dbfa74e32f9b882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:33:16,546 - lava_callback - INFO - Received callback for node 69dc9c315dbfa74e32f9b8d7 INFO: 172.21.0.1:52714 - "POST /node/69dc9c315dbfa74e32f9b8d7 HTTP/1.0" 202 Accepted 2026-04-15 07:33:16,552 - lava_callback - INFO - Starting async job submit for node 69dc9c315dbfa74e32f9b8d7 2026-04-15 07:33:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,567 - lava_callback - DEBUG - Processing node 69dc9c315dbfa74e32f9b8d7: baseline-arm64-baylibre 2026-04-15 07:33:16,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9c315dbfa74e32f9b8d7 2026-04-15 07:33:16,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:33:16,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,641 - lava_callback - ERROR - Error processing callback for node 69dc9c315dbfa74e32f9b8d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:34:36,728 - lava_callback - INFO - Received callback for node 69dc9c775dbfa74e32f9b90e INFO: 172.21.0.1:43904 - "POST /node/69dc9c775dbfa74e32f9b90e HTTP/1.0" 202 Accepted 2026-04-15 07:34:36,734 - lava_callback - INFO - Starting async job submit for node 69dc9c775dbfa74e32f9b90e 2026-04-15 07:34:36,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,751 - lava_callback - DEBUG - Processing node 69dc9c775dbfa74e32f9b90e: baseline-arm64-baylibre 2026-04-15 07:34:36,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9c775dbfa74e32f9b90e 2026-04-15 07:34:36,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:34:36,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,803 - lava_callback - ERROR - Error processing callback for node 69dc9c775dbfa74e32f9b90e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:35:36,926 - lava_callback - INFO - Received callback for node 69dc9cb95dbfa74e32f9b95a INFO: 172.21.0.1:48338 - "POST /node/69dc9cb95dbfa74e32f9b95a HTTP/1.0" 202 Accepted 2026-04-15 07:35:36,936 - lava_callback - INFO - Starting async job submit for node 69dc9cb95dbfa74e32f9b95a 2026-04-15 07:35:36,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:36,953 - lava_callback - DEBUG - Processing node 69dc9cb95dbfa74e32f9b95a: baseline-arm64-baylibre 2026-04-15 07:35:36,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9cb95dbfa74e32f9b95a 2026-04-15 07:35:36,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:35:36,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:37,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:37,016 - lava_callback - ERROR - Error processing callback for node 69dc9cb95dbfa74e32f9b95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:36:44,594 - lava_callback - INFO - Received callback for node 69dc9cfd5dbfa74e32f9b9e3 INFO: 172.21.0.1:50490 - "POST /node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.0" 202 Accepted 2026-04-15 07:36:44,601 - lava_callback - INFO - Starting async job submit for node 69dc9cfd5dbfa74e32f9b9e3 2026-04-15 07:36:44,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,629 - lava_callback - DEBUG - Processing node 69dc9cfd5dbfa74e32f9b9e3: baseline-arm64-clabbe 2026-04-15 07:36:44,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9cfd5dbfa74e32f9b9e3 2026-04-15 07:36:44,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:36:44,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,681 - lava_callback - ERROR - Error processing callback for node 69dc9cfd5dbfa74e32f9b9e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:37:36,843 - lava_callback - INFO - Received callback for node 69dc9d3d5dbfa74e32f9ba2d INFO: 172.21.0.1:60376 - "POST /node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.0" 202 Accepted 2026-04-15 07:37:36,849 - lava_callback - INFO - Starting async job submit for node 69dc9d3d5dbfa74e32f9ba2d 2026-04-15 07:37:36,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,869 - lava_callback - DEBUG - Processing node 69dc9d3d5dbfa74e32f9ba2d: baseline-arm64-baylibre 2026-04-15 07:37:36,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9d3d5dbfa74e32f9ba2d 2026-04-15 07:37:36,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:37:36,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,929 - lava_callback - ERROR - Error processing callback for node 69dc9d3d5dbfa74e32f9ba2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:39:04,652 - lava_callback - INFO - Received callback for node 69dc9d8a5dbfa74e32f9ba68 INFO: 172.21.0.1:38302 - "POST /node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.0" 202 Accepted 2026-04-15 07:39:04,657 - lava_callback - INFO - Starting async job submit for node 69dc9d8a5dbfa74e32f9ba68 2026-04-15 07:39:04,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,674 - lava_callback - DEBUG - Processing node 69dc9d8a5dbfa74e32f9ba68: baseline-arm64-clabbe 2026-04-15 07:39:04,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9d8a5dbfa74e32f9ba68 2026-04-15 07:39:04,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:39:04,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,731 - lava_callback - ERROR - Error processing callback for node 69dc9d8a5dbfa74e32f9ba68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:40:04,672 - lava_callback - INFO - Received callback for node 69dc9dcf5dbfa74e32f9bac1 INFO: 172.21.0.1:52380 - "POST /node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.0" 202 Accepted 2026-04-15 07:40:04,678 - lava_callback - INFO - Starting async job submit for node 69dc9dcf5dbfa74e32f9bac1 2026-04-15 07:40:04,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,695 - lava_callback - DEBUG - Processing node 69dc9dcf5dbfa74e32f9bac1: baseline-arm64-clabbe 2026-04-15 07:40:04,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9dcf5dbfa74e32f9bac1 2026-04-15 07:40:04,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:40:04,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,754 - lava_callback - ERROR - Error processing callback for node 69dc9dcf5dbfa74e32f9bac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:41:24,743 - lava_callback - INFO - Received callback for node 69dc9e0e5dbfa74e32f9bb21 INFO: 172.21.0.1:43748 - "POST /node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.0" 202 Accepted 2026-04-15 07:41:24,749 - lava_callback - INFO - Starting async job submit for node 69dc9e0e5dbfa74e32f9bb21 2026-04-15 07:41:24,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,765 - lava_callback - DEBUG - Processing node 69dc9e0e5dbfa74e32f9bb21: baseline-arm64-clabbe 2026-04-15 07:41:24,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e0e5dbfa74e32f9bb21 2026-04-15 07:41:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:41:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,812 - lava_callback - ERROR - Error processing callback for node 69dc9e0e5dbfa74e32f9bb21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:42:24,789 - lava_callback - INFO - Received callback for node 69dc9e555dbfa74e32f9bb62 INFO: 172.21.0.1:53056 - "POST /node/69dc9e555dbfa74e32f9bb62 HTTP/1.0" 202 Accepted 2026-04-15 07:42:24,794 - lava_callback - INFO - Starting async job submit for node 69dc9e555dbfa74e32f9bb62 2026-04-15 07:42:24,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,816 - lava_callback - DEBUG - Processing node 69dc9e555dbfa74e32f9bb62: baseline-arm64-clabbe 2026-04-15 07:42:24,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e555dbfa74e32f9bb62 2026-04-15 07:42:24,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:42:24,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,871 - lava_callback - ERROR - Error processing callback for node 69dc9e555dbfa74e32f9bb62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:43:44,809 - lava_callback - INFO - Received callback for node 69dc9e9b5dbfa74e32f9bba3 INFO: 172.21.0.1:56368 - "POST /node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.0" 202 Accepted 2026-04-15 07:43:44,815 - lava_callback - INFO - Starting async job submit for node 69dc9e9b5dbfa74e32f9bba3 2026-04-15 07:43:44,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,834 - lava_callback - DEBUG - Processing node 69dc9e9b5dbfa74e32f9bba3: baseline-arm64-clabbe 2026-04-15 07:43:44,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e9b5dbfa74e32f9bba3 2026-04-15 07:43:44,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:43:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,887 - lava_callback - ERROR - Error processing callback for node 69dc9e9b5dbfa74e32f9bba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:44:44,911 - lava_callback - INFO - Received callback for node 69dc9edf5dbfa74e32f9bc00 INFO: 172.21.0.1:36604 - "POST /node/69dc9edf5dbfa74e32f9bc00 HTTP/1.0" 202 Accepted 2026-04-15 07:44:44,917 - lava_callback - INFO - Starting async job submit for node 69dc9edf5dbfa74e32f9bc00 2026-04-15 07:44:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:44,959 - lava_callback - DEBUG - Processing node 69dc9edf5dbfa74e32f9bc00: baseline-arm64-clabbe 2026-04-15 07:44:44,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9edf5dbfa74e32f9bc00 2026-04-15 07:44:44,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:44,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:44:44,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:45,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:45,015 - lava_callback - ERROR - Error processing callback for node 69dc9edf5dbfa74e32f9bc00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:46:04,955 - lava_callback - INFO - Received callback for node 69dc9f275dbfa74e32f9bc42 INFO: 172.21.0.1:41336 - "POST /node/69dc9f275dbfa74e32f9bc42 HTTP/1.0" 202 Accepted 2026-04-15 07:46:04,960 - lava_callback - INFO - Starting async job submit for node 69dc9f275dbfa74e32f9bc42 2026-04-15 07:46:04,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:04,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:04,977 - lava_callback - DEBUG - Processing node 69dc9f275dbfa74e32f9bc42: baseline-arm64-clabbe 2026-04-15 07:46:04,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9f275dbfa74e32f9bc42 2026-04-15 07:46:04,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:04,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:46:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:05,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:05,047 - lava_callback - ERROR - Error processing callback for node 69dc9f275dbfa74e32f9bc42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:47:05,033 - lava_callback - INFO - Received callback for node 69dc9f6c5dbfa74e32f9bc82 INFO: 172.21.0.1:47444 - "POST /node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.0" 202 Accepted 2026-04-15 07:47:05,039 - lava_callback - INFO - Starting async job submit for node 69dc9f6c5dbfa74e32f9bc82 2026-04-15 07:47:05,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,055 - lava_callback - DEBUG - Processing node 69dc9f6c5dbfa74e32f9bc82: baseline-arm64-clabbe 2026-04-15 07:47:05,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9f6c5dbfa74e32f9bc82 2026-04-15 07:47:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:47:05,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,104 - lava_callback - ERROR - Error processing callback for node 69dc9f6c5dbfa74e32f9bc82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:48:05,107 - lava_callback - INFO - Received callback for node 69dc9fb05dbfa74e32f9bce9 INFO: 172.21.0.1:44092 - "POST /node/69dc9fb05dbfa74e32f9bce9 HTTP/1.0" 202 Accepted 2026-04-15 07:48:05,113 - lava_callback - INFO - Starting async job submit for node 69dc9fb05dbfa74e32f9bce9 2026-04-15 07:48:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,128 - lava_callback - DEBUG - Processing node 69dc9fb05dbfa74e32f9bce9: baseline-arm64-clabbe 2026-04-15 07:48:05,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9fb05dbfa74e32f9bce9 2026-04-15 07:48:05,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:48:05,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,176 - lava_callback - ERROR - Error processing callback for node 69dc9fb05dbfa74e32f9bce9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:49:25,124 - lava_callback - INFO - Received callback for node 69dc9ff45dbfa74e32f9bd2d INFO: 172.21.0.1:45496 - "POST /node/69dc9ff45dbfa74e32f9bd2d HTTP/1.0" 202 Accepted 2026-04-15 07:49:25,129 - lava_callback - INFO - Starting async job submit for node 69dc9ff45dbfa74e32f9bd2d 2026-04-15 07:49:25,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,145 - lava_callback - DEBUG - Processing node 69dc9ff45dbfa74e32f9bd2d: baseline-arm64-clabbe 2026-04-15 07:49:25,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ff45dbfa74e32f9bd2d 2026-04-15 07:49:25,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:49:25,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,200 - lava_callback - ERROR - Error processing callback for node 69dc9ff45dbfa74e32f9bd2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:50:25,169 - lava_callback - INFO - Received callback for node 69dca03a5dbfa74e32f9bd77 INFO: 172.21.0.1:56662 - "POST /node/69dca03a5dbfa74e32f9bd77 HTTP/1.0" 202 Accepted 2026-04-15 07:50:25,175 - lava_callback - INFO - Starting async job submit for node 69dca03a5dbfa74e32f9bd77 2026-04-15 07:50:25,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,191 - lava_callback - DEBUG - Processing node 69dca03a5dbfa74e32f9bd77: baseline-arm64-clabbe 2026-04-15 07:50:25,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca03a5dbfa74e32f9bd77 2026-04-15 07:50:25,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:50:25,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,245 - lava_callback - ERROR - Error processing callback for node 69dca03a5dbfa74e32f9bd77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:51:45,271 - lava_callback - INFO - Received callback for node 69dca0845dbfa74e32f9bdbd INFO: 172.21.0.1:60734 - "POST /node/69dca0845dbfa74e32f9bdbd HTTP/1.0" 202 Accepted 2026-04-15 07:51:45,279 - lava_callback - INFO - Starting async job submit for node 69dca0845dbfa74e32f9bdbd 2026-04-15 07:51:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,312 - lava_callback - DEBUG - Processing node 69dca0845dbfa74e32f9bdbd: baseline-arm64-clabbe 2026-04-15 07:51:45,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0845dbfa74e32f9bdbd 2026-04-15 07:51:45,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:51:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,371 - lava_callback - ERROR - Error processing callback for node 69dca0845dbfa74e32f9bdbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:52:45,278 - lava_callback - INFO - Received callback for node 69dca0c55dbfa74e32f9be0f INFO: 172.21.0.1:60398 - "POST /node/69dca0c55dbfa74e32f9be0f HTTP/1.0" 202 Accepted 2026-04-15 07:52:45,288 - lava_callback - INFO - Starting async job submit for node 69dca0c55dbfa74e32f9be0f 2026-04-15 07:52:45,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,317 - lava_callback - DEBUG - Processing node 69dca0c55dbfa74e32f9be0f: baseline-arm64-clabbe 2026-04-15 07:52:45,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0c55dbfa74e32f9be0f 2026-04-15 07:52:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:52:45,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,374 - lava_callback - ERROR - Error processing callback for node 69dca0c55dbfa74e32f9be0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:53:37,660 - lava_callback - INFO - Received callback for node 69dca0fb5dbfa74e32f9be49 INFO: 172.21.0.1:34822 - "POST /node/69dca0fb5dbfa74e32f9be49 HTTP/1.0" 202 Accepted 2026-04-15 07:53:37,666 - lava_callback - INFO - Starting async job submit for node 69dca0fb5dbfa74e32f9be49 2026-04-15 07:53:37,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,682 - lava_callback - DEBUG - Processing node 69dca0fb5dbfa74e32f9be49: baseline-arm-baylibre 2026-04-15 07:53:37,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0fb5dbfa74e32f9be49 2026-04-15 07:53:37,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:53:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,730 - lava_callback - ERROR - Error processing callback for node 69dca0fb5dbfa74e32f9be49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:54:17,735 - lava_callback - INFO - Received callback for node 69dca11f5dbfa74e32f9be5d INFO: 172.21.0.1:60650 - "POST /node/69dca11f5dbfa74e32f9be5d HTTP/1.0" 202 Accepted 2026-04-15 07:54:17,741 - lava_callback - INFO - Starting async job submit for node 69dca11f5dbfa74e32f9be5d 2026-04-15 07:54:17,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,757 - lava_callback - DEBUG - Processing node 69dca11f5dbfa74e32f9be5d: baseline-arm-baylibre 2026-04-15 07:54:17,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca11f5dbfa74e32f9be5d 2026-04-15 07:54:17,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:54:17,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,804 - lava_callback - ERROR - Error processing callback for node 69dca11f5dbfa74e32f9be5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:54:57,795 - lava_callback - INFO - Received callback for node 69dca13e5dbfa74e32f9be88 INFO: 172.21.0.1:48356 - "POST /node/69dca13e5dbfa74e32f9be88 HTTP/1.0" 202 Accepted 2026-04-15 07:54:57,801 - lava_callback - INFO - Starting async job submit for node 69dca13e5dbfa74e32f9be88 2026-04-15 07:54:57,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,818 - lava_callback - DEBUG - Processing node 69dca13e5dbfa74e32f9be88: baseline-arm-baylibre 2026-04-15 07:54:57,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca13e5dbfa74e32f9be88 2026-04-15 07:54:57,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:54:57,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,900 - lava_callback - ERROR - Error processing callback for node 69dca13e5dbfa74e32f9be88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:55:25,416 - lava_callback - INFO - Received callback for node 69dca15f5dbfa74e32f9bea3 INFO: 172.21.0.1:52734 - "POST /node/69dca15f5dbfa74e32f9bea3 HTTP/1.0" 202 Accepted 2026-04-15 07:55:25,422 - lava_callback - INFO - Starting async job submit for node 69dca15f5dbfa74e32f9bea3 2026-04-15 07:55:25,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,439 - lava_callback - DEBUG - Processing node 69dca15f5dbfa74e32f9bea3: baseline-arm-clabbe 2026-04-15 07:55:25,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca15f5dbfa74e32f9bea3 2026-04-15 07:55:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:55:25,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,503 - lava_callback - ERROR - Error processing callback for node 69dca15f5dbfa74e32f9bea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:56:05,386 - lava_callback - INFO - Received callback for node 69dca1815dbfa74e32f9bec7 INFO: 172.21.0.1:58898 - "POST /node/69dca1815dbfa74e32f9bec7 HTTP/1.0" 202 Accepted 2026-04-15 07:56:05,392 - lava_callback - INFO - Starting async job submit for node 69dca1815dbfa74e32f9bec7 2026-04-15 07:56:05,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,407 - lava_callback - DEBUG - Processing node 69dca1815dbfa74e32f9bec7: baseline-arm-clabbe 2026-04-15 07:56:05,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1815dbfa74e32f9bec7 2026-04-15 07:56:05,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:56:05,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,456 - lava_callback - ERROR - Error processing callback for node 69dca1815dbfa74e32f9bec7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:56:25,470 - lava_callback - INFO - Received callback for node 69dca1a55dbfa74e32f9bed9 INFO: 172.21.0.1:58808 - "POST /node/69dca1a55dbfa74e32f9bed9 HTTP/1.0" 202 Accepted 2026-04-15 07:56:25,478 - lava_callback - INFO - Starting async job submit for node 69dca1a55dbfa74e32f9bed9 2026-04-15 07:56:25,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,513 - lava_callback - DEBUG - Processing node 69dca1a55dbfa74e32f9bed9: baseline-arm-clabbe 2026-04-15 07:56:25,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1a55dbfa74e32f9bed9 2026-04-15 07:56:25,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:56:25,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,565 - lava_callback - ERROR - Error processing callback for node 69dca1a55dbfa74e32f9bed9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:05,431 - lava_callback - INFO - Received callback for node 69dca1c15dbfa74e32f9bef0 INFO: 172.21.0.1:37442 - "POST /node/69dca1c15dbfa74e32f9bef0 HTTP/1.0" 202 Accepted 2026-04-15 07:57:05,440 - lava_callback - INFO - Starting async job submit for node 69dca1c15dbfa74e32f9bef0 2026-04-15 07:57:05,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,477 - lava_callback - DEBUG - Processing node 69dca1c15dbfa74e32f9bef0: baseline-arm-clabbe 2026-04-15 07:57:05,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1c15dbfa74e32f9bef0 2026-04-15 07:57:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:05,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,541 - lava_callback - ERROR - Error processing callback for node 69dca1c15dbfa74e32f9bef0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:45,525 - lava_callback - INFO - Received callback for node 69dca1e45dbfa74e32f9bf1d INFO: 172.21.0.1:44514 - "POST /node/69dca1e45dbfa74e32f9bf1d HTTP/1.0" 202 Accepted 2026-04-15 07:57:45,531 - lava_callback - INFO - Starting async job submit for node 69dca1e45dbfa74e32f9bf1d 2026-04-15 07:57:45,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,553 - lava_callback - DEBUG - Processing node 69dca1e45dbfa74e32f9bf1d: baseline-arm-clabbe 2026-04-15 07:57:45,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1e45dbfa74e32f9bf1d 2026-04-15 07:57:45,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:45,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,603 - lava_callback - ERROR - Error processing callback for node 69dca1e45dbfa74e32f9bf1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:57,981 - lava_callback - INFO - Received callback for node 69dca2025dbfa74e32f9bf34 INFO: 172.21.0.1:44706 - "POST /node/69dca2025dbfa74e32f9bf34 HTTP/1.0" 202 Accepted 2026-04-15 07:57:57,989 - lava_callback - INFO - Starting async job submit for node 69dca2025dbfa74e32f9bf34 2026-04-15 07:57:57,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,012 - lava_callback - DEBUG - Processing node 69dca2025dbfa74e32f9bf34: baseline-arm-baylibre 2026-04-15 07:57:58,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2025dbfa74e32f9bf34 2026-04-15 07:57:58,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:58,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,068 - lava_callback - ERROR - Error processing callback for node 69dca2025dbfa74e32f9bf34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-04-15 07:58:45,591 - lava_callback - INFO - Received callback for node 69dca2275dbfa74e32f9bf5e INFO: 172.21.0.1:47554 - "POST /node/69dca2275dbfa74e32f9bf5e HTTP/1.0" 202 Accepted 2026-04-15 07:58:45,597 - lava_callback - INFO - Starting async job submit for node 69dca2275dbfa74e32f9bf5e 2026-04-15 07:58:45,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,613 - lava_callback - DEBUG - Processing node 69dca2275dbfa74e32f9bf5e: baseline-arm-clabbe 2026-04-15 07:58:45,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2275dbfa74e32f9bf5e 2026-04-15 07:58:45,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:58:45,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,687 - lava_callback - ERROR - Error processing callback for node 69dca2275dbfa74e32f9bf5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:58:57,975 - lava_callback - INFO - Received callback for node 69dca2405dbfa74e32f9bf95 INFO: 172.21.0.1:44832 - "POST /node/69dca2405dbfa74e32f9bf95 HTTP/1.0" 202 Accepted 2026-04-15 07:58:57,981 - lava_callback - INFO - Starting async job submit for node 69dca2405dbfa74e32f9bf95 2026-04-15 07:58:57,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:57,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:57,997 - lava_callback - DEBUG - Processing node 69dca2405dbfa74e32f9bf95: baseline-arm-baylibre 2026-04-15 07:58:57,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2405dbfa74e32f9bf95 2026-04-15 07:58:57,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:58:58,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:58,078 - lava_callback - ERROR - Error processing callback for node 69dca2405dbfa74e32f9bf95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:59:45,573 - lava_callback - INFO - Received callback for node 69dca2645dbfa74e32f9bfbe INFO: 172.21.0.1:50204 - "POST /node/69dca2645dbfa74e32f9bfbe HTTP/1.0" 202 Accepted 2026-04-15 07:59:45,582 - lava_callback - INFO - Starting async job submit for node 69dca2645dbfa74e32f9bfbe 2026-04-15 07:59:45,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,599 - lava_callback - DEBUG - Processing node 69dca2645dbfa74e32f9bfbe: baseline-arm-clabbe 2026-04-15 07:59:45,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2645dbfa74e32f9bfbe 2026-04-15 07:59:45,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:59:45,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,661 - lava_callback - ERROR - Error processing callback for node 69dca2645dbfa74e32f9bfbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:00:25,594 - lava_callback - INFO - Received callback for node 69dca2865dbfa74e32f9bfd4 INFO: 172.21.0.1:41370 - "POST /node/69dca2865dbfa74e32f9bfd4 HTTP/1.0" 202 Accepted 2026-04-15 08:00:25,600 - lava_callback - INFO - Starting async job submit for node 69dca2865dbfa74e32f9bfd4 2026-04-15 08:00:25,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,624 - lava_callback - DEBUG - Processing node 69dca2865dbfa74e32f9bfd4: baseline-arm-clabbe 2026-04-15 08:00:25,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2865dbfa74e32f9bfd4 2026-04-15 08:00:25,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:00:25,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,692 - lava_callback - ERROR - Error processing callback for node 69dca2865dbfa74e32f9bfd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:00:38,118 - lava_callback - INFO - Received callback for node 69dca2a35dbfa74e32f9bffa INFO: 172.21.0.1:48600 - "POST /node/69dca2a35dbfa74e32f9bffa HTTP/1.0" 202 Accepted 2026-04-15 08:00:38,128 - lava_callback - INFO - Starting async job submit for node 69dca2a35dbfa74e32f9bffa 2026-04-15 08:00:38,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,145 - lava_callback - DEBUG - Processing node 69dca2a35dbfa74e32f9bffa: baseline-arm-baylibre 2026-04-15 08:00:38,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2a35dbfa74e32f9bffa 2026-04-15 08:00:38,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:00:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,206 - lava_callback - ERROR - Error processing callback for node 69dca2a35dbfa74e32f9bffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:01:25,709 - lava_callback - INFO - Received callback for node 69dca2cc5dbfa74e32f9c008 INFO: 172.21.0.1:60914 - "POST /node/69dca2cc5dbfa74e32f9c008 HTTP/1.0" 202 Accepted 2026-04-15 08:01:25,715 - lava_callback - INFO - Starting async job submit for node 69dca2cc5dbfa74e32f9c008 2026-04-15 08:01:25,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,731 - lava_callback - DEBUG - Processing node 69dca2cc5dbfa74e32f9c008: baseline-arm-clabbe 2026-04-15 08:01:25,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2cc5dbfa74e32f9c008 2026-04-15 08:01:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:01:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,778 - lava_callback - ERROR - Error processing callback for node 69dca2cc5dbfa74e32f9c008: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:05,581 - lava_callback - INFO - Received callback for node 69dca2ec5dbfa74e32f9c016 INFO: 172.21.0.1:34426 - "POST /node/69dca2ec5dbfa74e32f9c016 HTTP/1.0" 202 Accepted 2026-04-15 08:02:05,590 - lava_callback - INFO - Starting async job submit for node 69dca2ec5dbfa74e32f9c016 2026-04-15 08:02:05,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,607 - lava_callback - DEBUG - Processing node 69dca2ec5dbfa74e32f9c016: baseline-arm-clabbe 2026-04-15 08:02:05,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2ec5dbfa74e32f9c016 2026-04-15 08:02:05,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:05,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,675 - lava_callback - ERROR - Error processing callback for node 69dca2ec5dbfa74e32f9c016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:45,654 - lava_callback - INFO - Received callback for node 69dca3105dbfa74e32f9c03d INFO: 172.21.0.1:36698 - "POST /node/69dca3105dbfa74e32f9c03d HTTP/1.0" 202 Accepted 2026-04-15 08:02:45,660 - lava_callback - INFO - Starting async job submit for node 69dca3105dbfa74e32f9c03d 2026-04-15 08:02:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,676 - lava_callback - DEBUG - Processing node 69dca3105dbfa74e32f9c03d: baseline-arm-clabbe 2026-04-15 08:02:45,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3105dbfa74e32f9c03d 2026-04-15 08:02:45,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:45,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,728 - lava_callback - ERROR - Error processing callback for node 69dca3105dbfa74e32f9c03d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:58,215 - lava_callback - INFO - Received callback for node 69dca32c5dbfa74e32f9c048 INFO: 172.21.0.1:46024 - "POST /node/69dca32c5dbfa74e32f9c048 HTTP/1.0" 202 Accepted 2026-04-15 08:02:58,224 - lava_callback - INFO - Starting async job submit for node 69dca32c5dbfa74e32f9c048 2026-04-15 08:02:58,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,247 - lava_callback - DEBUG - Processing node 69dca32c5dbfa74e32f9c048: baseline-arm-baylibre 2026-04-15 08:02:58,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca32c5dbfa74e32f9c048 2026-04-15 08:02:58,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:58,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,310 - lava_callback - ERROR - Error processing callback for node 69dca32c5dbfa74e32f9c048: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:03:45,756 - lava_callback - INFO - Received callback for node 69dca3505dbfa74e32f9c071 INFO: 172.21.0.1:39748 - "POST /node/69dca3505dbfa74e32f9c071 HTTP/1.0" 202 Accepted 2026-04-15 08:03:45,762 - lava_callback - INFO - Starting async job submit for node 69dca3505dbfa74e32f9c071 2026-04-15 08:03:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,778 - lava_callback - DEBUG - Processing node 69dca3505dbfa74e32f9c071: baseline-arm-clabbe 2026-04-15 08:03:45,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3505dbfa74e32f9c071 2026-04-15 08:03:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:03:45,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,828 - lava_callback - ERROR - Error processing callback for node 69dca3505dbfa74e32f9c071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:04:18,515 - lava_callback - INFO - Received callback for node 69dca36f5dbfa74e32f9c08e INFO: 172.21.0.1:44252 - "POST /node/69dca36f5dbfa74e32f9c08e HTTP/1.0" 202 Accepted 2026-04-15 08:04:18,520 - lava_callback - INFO - Starting async job submit for node 69dca36f5dbfa74e32f9c08e 2026-04-15 08:04:18,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,536 - lava_callback - DEBUG - Processing node 69dca36f5dbfa74e32f9c08e: baseline-arm-baylibre 2026-04-15 08:04:18,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca36f5dbfa74e32f9c08e 2026-04-15 08:04:18,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:04:18,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,593 - lava_callback - ERROR - Error processing callback for node 69dca36f5dbfa74e32f9c08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:04:38,311 - lava_callback - INFO - Received callback for node 69dca38d5dbfa74e32f9c0c2 INFO: 172.21.0.1:46230 - "POST /node/69dca38d5dbfa74e32f9c0c2 HTTP/1.0" 202 Accepted 2026-04-15 08:04:38,317 - lava_callback - INFO - Starting async job submit for node 69dca38d5dbfa74e32f9c0c2 2026-04-15 08:04:38,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,333 - lava_callback - DEBUG - Processing node 69dca38d5dbfa74e32f9c0c2: baseline-arm-baylibre 2026-04-15 08:04:38,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca38d5dbfa74e32f9c0c2 2026-04-15 08:04:38,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:04:38,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,384 - lava_callback - ERROR - Error processing callback for node 69dca38d5dbfa74e32f9c0c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:05:18,352 - lava_callback - INFO - Received callback for node 69dca3ac5dbfa74e32f9c0f3 INFO: 172.21.0.1:55130 - "POST /node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.0" 202 Accepted 2026-04-15 08:05:18,361 - lava_callback - INFO - Starting async job submit for node 69dca3ac5dbfa74e32f9c0f3 2026-04-15 08:05:18,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,376 - lava_callback - DEBUG - Processing node 69dca3ac5dbfa74e32f9c0f3: baseline-arm-baylibre 2026-04-15 08:05:18,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3ac5dbfa74e32f9c0f3 2026-04-15 08:05:18,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:05:18,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,432 - lava_callback - ERROR - Error processing callback for node 69dca3ac5dbfa74e32f9c0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:05:45,837 - lava_callback - INFO - Received callback for node 69dca3d05dbfa74e32f9c10f INFO: 172.21.0.1:37456 - "POST /node/69dca3d05dbfa74e32f9c10f HTTP/1.0" 202 Accepted 2026-04-15 08:05:45,842 - lava_callback - INFO - Starting async job submit for node 69dca3d05dbfa74e32f9c10f 2026-04-15 08:05:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,863 - lava_callback - DEBUG - Processing node 69dca3d05dbfa74e32f9c10f: baseline-arm-clabbe 2026-04-15 08:05:45,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3d05dbfa74e32f9c10f 2026-04-15 08:05:45,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:05:45,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,912 - lava_callback - ERROR - Error processing callback for node 69dca3d05dbfa74e32f9c10f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:06:25,836 - lava_callback - INFO - Received callback for node 69dca3f45dbfa74e32f9c11e INFO: 172.21.0.1:48340 - "POST /node/69dca3f45dbfa74e32f9c11e HTTP/1.0" 202 Accepted 2026-04-15 08:06:25,842 - lava_callback - INFO - Starting async job submit for node 69dca3f45dbfa74e32f9c11e 2026-04-15 08:06:25,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,864 - lava_callback - DEBUG - Processing node 69dca3f45dbfa74e32f9c11e: baseline-arm-clabbe 2026-04-15 08:06:25,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3f45dbfa74e32f9c11e 2026-04-15 08:06:25,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:06:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,912 - lava_callback - ERROR - Error processing callback for node 69dca3f45dbfa74e32f9c11e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:06:58,418 - lava_callback - INFO - Received callback for node 69dca4165dbfa74e32f9c12c INFO: 172.21.0.1:34134 - "POST /node/69dca4165dbfa74e32f9c12c HTTP/1.0" 202 Accepted 2026-04-15 08:06:58,427 - lava_callback - INFO - Starting async job submit for node 69dca4165dbfa74e32f9c12c 2026-04-15 08:06:58,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,464 - lava_callback - DEBUG - Processing node 69dca4165dbfa74e32f9c12c: baseline-arm-baylibre 2026-04-15 08:06:58,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4165dbfa74e32f9c12c 2026-04-15 08:06:58,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:06:58,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,541 - lava_callback - ERROR - Error processing callback for node 69dca4165dbfa74e32f9c12c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:07:38,437 - lava_callback - INFO - Received callback for node 69dca4385dbfa74e32f9c147 INFO: 172.21.0.1:36320 - "POST /node/69dca4385dbfa74e32f9c147 HTTP/1.0" 202 Accepted 2026-04-15 08:07:38,444 - lava_callback - INFO - Starting async job submit for node 69dca4385dbfa74e32f9c147 2026-04-15 08:07:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,461 - lava_callback - DEBUG - Processing node 69dca4385dbfa74e32f9c147: baseline-arm-baylibre 2026-04-15 08:07:38,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4385dbfa74e32f9c147 2026-04-15 08:07:38,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:07:38,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,521 - lava_callback - ERROR - Error processing callback for node 69dca4385dbfa74e32f9c147: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:08:05,938 - lava_callback - INFO - Received callback for node 69dca45c5dbfa74e32f9c158 INFO: 172.21.0.1:52212 - "POST /node/69dca45c5dbfa74e32f9c158 HTTP/1.0" 202 Accepted 2026-04-15 08:08:05,944 - lava_callback - INFO - Starting async job submit for node 69dca45c5dbfa74e32f9c158 2026-04-15 08:08:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:05,961 - lava_callback - DEBUG - Processing node 69dca45c5dbfa74e32f9c158: baseline-arm-clabbe 2026-04-15 08:08:05,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca45c5dbfa74e32f9c158 2026-04-15 08:08:05,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:08:05,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:06,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:06,024 - lava_callback - ERROR - Error processing callback for node 69dca45c5dbfa74e32f9c158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:08:45,906 - lava_callback - INFO - Received callback for node 69dca4795dbfa74e32f9c173 INFO: 172.21.0.1:51284 - "POST /node/69dca4795dbfa74e32f9c173 HTTP/1.0" 202 Accepted 2026-04-15 08:08:45,911 - lava_callback - INFO - Starting async job submit for node 69dca4795dbfa74e32f9c173 2026-04-15 08:08:45,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,928 - lava_callback - DEBUG - Processing node 69dca4795dbfa74e32f9c173: baseline-arm-clabbe 2026-04-15 08:08:45,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4795dbfa74e32f9c173 2026-04-15 08:08:45,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:08:45,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,981 - lava_callback - ERROR - Error processing callback for node 69dca4795dbfa74e32f9c173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:09:05,965 - lava_callback - INFO - Received callback for node 69dca4985dbfa74e32f9c1a6 INFO: 172.21.0.1:44230 - "POST /node/69dca4985dbfa74e32f9c1a6 HTTP/1.0" 202 Accepted 2026-04-15 08:09:05,971 - lava_callback - INFO - Starting async job submit for node 69dca4985dbfa74e32f9c1a6 2026-04-15 08:09:05,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:05,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:05,992 - lava_callback - DEBUG - Processing node 69dca4985dbfa74e32f9c1a6: baseline-arm-clabbe 2026-04-15 08:09:05,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4985dbfa74e32f9c1a6 2026-04-15 08:09:05,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:06,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:09:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:06,050 - lava_callback - ERROR - Error processing callback for node 69dca4985dbfa74e32f9c1a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:09:45,961 - lava_callback - INFO - Received callback for node 69dca4bc5dbfa74e32f9c1e0 INFO: 172.21.0.1:48702 - "POST /node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.0" 202 Accepted 2026-04-15 08:09:45,968 - lava_callback - INFO - Starting async job submit for node 69dca4bc5dbfa74e32f9c1e0 2026-04-15 08:09:45,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:45,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:45,989 - lava_callback - DEBUG - Processing node 69dca4bc5dbfa74e32f9c1e0: baseline-arm-clabbe 2026-04-15 08:09:45,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4bc5dbfa74e32f9c1e0 2026-04-15 08:09:45,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:46,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:09:46,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:46,049 - lava_callback - ERROR - Error processing callback for node 69dca4bc5dbfa74e32f9c1e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:10:06,014 - lava_callback - INFO - Received callback for node 69dca4da5dbfa74e32f9c210 INFO: 172.21.0.1:43858 - "POST /node/69dca4da5dbfa74e32f9c210 HTTP/1.0" 202 Accepted 2026-04-15 08:10:06,020 - lava_callback - INFO - Starting async job submit for node 69dca4da5dbfa74e32f9c210 2026-04-15 08:10:06,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,036 - lava_callback - DEBUG - Processing node 69dca4da5dbfa74e32f9c210: baseline-arm-clabbe 2026-04-15 08:10:06,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4da5dbfa74e32f9c210 2026-04-15 08:10:06,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:10:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,083 - lava_callback - ERROR - Error processing callback for node 69dca4da5dbfa74e32f9c210: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:10:46,049 - lava_callback - INFO - Received callback for node 69dca4fb5dbfa74e32f9c22e INFO: 172.21.0.1:55006 - "POST /node/69dca4fb5dbfa74e32f9c22e HTTP/1.0" 202 Accepted 2026-04-15 08:10:46,055 - lava_callback - INFO - Starting async job submit for node 69dca4fb5dbfa74e32f9c22e 2026-04-15 08:10:46,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,070 - lava_callback - DEBUG - Processing node 69dca4fb5dbfa74e32f9c22e: baseline-arm-clabbe 2026-04-15 08:10:46,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4fb5dbfa74e32f9c22e 2026-04-15 08:10:46,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:10:46,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,130 - lava_callback - ERROR - Error processing callback for node 69dca4fb5dbfa74e32f9c22e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /node/698f5af23013abef95cf7751%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 08:11:26,133 - lava_callback - INFO - Received callback for node 69dca51e5dbfa74e32f9c246 INFO: 172.21.0.1:41506 - "POST /node/69dca51e5dbfa74e32f9c246 HTTP/1.0" 202 Accepted 2026-04-15 08:11:26,138 - lava_callback - INFO - Starting async job submit for node 69dca51e5dbfa74e32f9c246 2026-04-15 08:11:26,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,160 - lava_callback - DEBUG - Processing node 69dca51e5dbfa74e32f9c246: baseline-arm-clabbe 2026-04-15 08:11:26,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca51e5dbfa74e32f9c246 2026-04-15 08:11:26,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:11:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,222 - lava_callback - ERROR - Error processing callback for node 69dca51e5dbfa74e32f9c246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:11:46,078 - lava_callback - INFO - Received callback for node 69dca53e5dbfa74e32f9c268 INFO: 172.21.0.1:52206 - "POST /node/69dca53e5dbfa74e32f9c268 HTTP/1.0" 202 Accepted 2026-04-15 08:11:46,087 - lava_callback - INFO - Starting async job submit for node 69dca53e5dbfa74e32f9c268 2026-04-15 08:11:46,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,106 - lava_callback - DEBUG - Processing node 69dca53e5dbfa74e32f9c268: baseline-arm-clabbe 2026-04-15 08:11:46,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca53e5dbfa74e32f9c268 2026-04-15 08:11:46,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:11:46,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,165 - lava_callback - ERROR - Error processing callback for node 69dca53e5dbfa74e32f9c268: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40650 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:12:26,152 - lava_callback - INFO - Received callback for node 69dca5625dbfa74e32f9c27f INFO: 172.21.0.1:39078 - "POST /node/69dca5625dbfa74e32f9c27f HTTP/1.0" 202 Accepted 2026-04-15 08:12:26,160 - lava_callback - INFO - Starting async job submit for node 69dca5625dbfa74e32f9c27f 2026-04-15 08:12:26,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,187 - lava_callback - DEBUG - Processing node 69dca5625dbfa74e32f9c27f: baseline-arm-clabbe 2026-04-15 08:12:26,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca5625dbfa74e32f9c27f 2026-04-15 08:12:26,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:12:26,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,258 - lava_callback - ERROR - Error processing callback for node 69dca5625dbfa74e32f9c27f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:32:04,918 - lava_callback - INFO - Received callback for node 69dedc09f490930782fb6e62 2026-04-15 00:32:04,931 - lava_callback - INFO - Starting async job submit for node 69dedc09f490930782fb6e62 INFO: 172.21.0.1:58532 - "POST /node/69dedc09f490930782fb6e62 HTTP/1.0" 202 Accepted 2026-04-15 00:32:04,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:04,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:04,995 - lava_callback - DEBUG - Processing node 69dedc09f490930782fb6e62: baseline-arm 2026-04-15 00:32:05,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:05,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:05,528 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/log.txt.gz 2026-04-15 00:32:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:05,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:05,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/lava-logs.yaml 2026-04-15 00:32:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:32:06,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:32:06,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedc09f490930782fb6e62/lava_callback.json.gz 2026-04-15 00:32:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:06,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 00:32:06,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:06,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedc09f490930782fb6e62 HTTP/1.1" 200 None 2026-04-15 00:32:06,126 - lava_callback - INFO - Completed processing callback for node 69dedc09f490930782fb6e62 INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:32:36,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:32:36,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:37:34,251 - lava_callback - INFO - Received callback for node 69dc3ac25dbfa74e32f96e93 INFO: 172.21.0.1:42192 - "POST /node/69dc3ac25dbfa74e32f96e93 HTTP/1.0" 202 Accepted 2026-04-15 00:37:34,256 - lava_callback - INFO - Starting async job submit for node 69dc3ac25dbfa74e32f96e93 2026-04-15 00:37:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,273 - lava_callback - DEBUG - Processing node 69dc3ac25dbfa74e32f96e93: baseline-arm-baylibre 2026-04-15 00:37:34,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3ac25dbfa74e32f96e93 2026-04-15 00:37:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:37:34,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:37:34,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3ac25dbfa74e32f96e93 HTTP/1.1" 200 None 2026-04-15 00:37:34,321 - lava_callback - ERROR - Error processing callback for node 69dc3ac25dbfa74e32f96e93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:13,876 - lava_callback - INFO - Received callback for node 69dedd84f490930782fb7004 INFO: 172.21.0.1:49814 - "POST /node/69dedd84f490930782fb7004 HTTP/1.0" 202 Accepted 2026-04-15 00:38:13,883 - lava_callback - INFO - Starting async job submit for node 69dedd84f490930782fb7004 2026-04-15 00:38:13,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:13,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:13,920 - lava_callback - DEBUG - Processing node 69dedd84f490930782fb7004: baseline-x86 2026-04-15 00:38:14,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,212 - lava_callback - INFO - Received callback for node 69dc3ae45dbfa74e32f96ebc 2026-04-15 00:38:14,218 - lava_callback - INFO - Starting async job submit for node 69dc3ae45dbfa74e32f96ebc INFO: 172.21.0.1:49826 - "POST /node/69dc3ae45dbfa74e32f96ebc HTTP/1.0" 202 Accepted 2026-04-15 00:38:14,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,237 - lava_callback - DEBUG - Processing node 69dc3ae45dbfa74e32f96ebc: baseline-arm-baylibre 2026-04-15 00:38:14,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3ae45dbfa74e32f96ebc 2026-04-15 00:38:14,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/log.txt.gz 2026-04-15 00:38:14,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:38:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3ae45dbfa74e32f96ebc HTTP/1.1" 200 None 2026-04-15 00:38:14,395 - lava_callback - ERROR - Error processing callback for node 69dc3ae45dbfa74e32f96ebc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:38:14,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/lava-logs.yaml 2026-04-15 00:38:14,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:14,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:14,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7004/lava_callback.json.gz 2026-04-15 00:38:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:14,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:38:14,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:14,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd84f490930782fb7004 HTTP/1.1" 200 None 2026-04-15 00:38:14,891 - lava_callback - INFO - Completed processing callback for node 69dedd84f490930782fb7004 INFO: 172.21.0.1:49830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:34,204 - lava_callback - INFO - Received callback for node 69dc3b005dbfa74e32f96efc INFO: 172.21.0.1:49944 - "POST /node/69dc3b005dbfa74e32f96efc HTTP/1.0" 202 Accepted 2026-04-15 00:38:34,210 - lava_callback - INFO - Starting async job submit for node 69dc3b005dbfa74e32f96efc 2026-04-15 00:38:34,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,226 - lava_callback - DEBUG - Processing node 69dc3b005dbfa74e32f96efc: baseline-arm-baylibre 2026-04-15 00:38:34,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b005dbfa74e32f96efc 2026-04-15 00:38:34,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:38:34,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:34,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b005dbfa74e32f96efc HTTP/1.1" 200 None 2026-04-15 00:38:34,284 - lava_callback - ERROR - Error processing callback for node 69dc3b005dbfa74e32f96efc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:38:35,957 - lava_callback - INFO - Received callback for node 69dedd86f490930782fb700d INFO: 172.21.0.1:49956 - "POST /node/69dedd86f490930782fb700d HTTP/1.0" 202 Accepted 2026-04-15 00:38:35,963 - lava_callback - INFO - Starting async job submit for node 69dedd86f490930782fb700d 2026-04-15 00:38:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:35,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:35,996 - lava_callback - DEBUG - Processing node 69dedd86f490930782fb700d: baseline-x86 2026-04-15 00:38:36,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 00:38:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/log.txt.gz 2026-04-15 00:38:36,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:38:36,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,620 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/lava-logs.yaml 2026-04-15 00:38:36,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:38:36,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:38:36,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd86f490930782fb700d/lava_callback.json.gz 2026-04-15 00:38:36,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:38:36,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:38:36,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd86f490930782fb700d HTTP/1.1" 200 None 2026-04-15 00:38:36,868 - lava_callback - INFO - Completed processing callback for node 69dedd86f490930782fb700d INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:06,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:06,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:14,288 - lava_callback - INFO - Received callback for node 69dc3b235dbfa74e32f96f14 INFO: 172.21.0.1:38820 - "POST /node/69dc3b235dbfa74e32f96f14 HTTP/1.0" 202 Accepted 2026-04-15 00:39:14,294 - lava_callback - INFO - Starting async job submit for node 69dc3b235dbfa74e32f96f14 2026-04-15 00:39:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,324 - lava_callback - DEBUG - Processing node 69dc3b235dbfa74e32f96f14: baseline-arm-baylibre 2026-04-15 00:39:14,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b235dbfa74e32f96f14 2026-04-15 00:39:14,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:39:14,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:14,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b235dbfa74e32f96f14 HTTP/1.1" 200 None 2026-04-15 00:39:14,370 - lava_callback - ERROR - Error processing callback for node 69dc3b235dbfa74e32f96f14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:39:54,319 - lava_callback - INFO - Received callback for node 69dc3b465dbfa74e32f96f29 INFO: 172.21.0.1:49010 - "POST /node/69dc3b465dbfa74e32f96f29 HTTP/1.0" 202 Accepted 2026-04-15 00:39:54,328 - lava_callback - INFO - Starting async job submit for node 69dc3b465dbfa74e32f96f29 2026-04-15 00:39:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,356 - lava_callback - DEBUG - Processing node 69dc3b465dbfa74e32f96f29: baseline-arm-baylibre 2026-04-15 00:39:54,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b465dbfa74e32f96f29 2026-04-15 00:39:54,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:39:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b465dbfa74e32f96f29 HTTP/1.1" 200 None 2026-04-15 00:39:54,447 - lava_callback - ERROR - Error processing callback for node 69dc3b465dbfa74e32f96f29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:39:54,496 - lava_callback - INFO - Received callback for node 69dedd84f490930782fb7007 INFO: 172.21.0.1:49016 - "POST /node/69dedd84f490930782fb7007 HTTP/1.0" 202 Accepted 2026-04-15 00:39:54,518 - lava_callback - INFO - Starting async job submit for node 69dedd84f490930782fb7007 2026-04-15 00:39:54,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:54,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:54,651 - lava_callback - DEBUG - Processing node 69dedd84f490930782fb7007: baseline-x86 2026-04-15 00:39:55,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:55,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:55,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/log.txt.gz 2026-04-15 00:39:55,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:56,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:56,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/lava-logs.yaml 2026-04-15 00:39:56,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:39:56,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:39:56,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd84f490930782fb7007/lava_callback.json.gz 2026-04-15 00:39:56,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:56,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:39:56,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:39:56,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd84f490930782fb7007 HTTP/1.1" 200 None 2026-04-15 00:39:56,450 - lava_callback - INFO - Completed processing callback for node 69dedd84f490930782fb7007 INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:06,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:14,297 - lava_callback - INFO - Received callback for node 69dc3b655dbfa74e32f96f53 INFO: 172.21.0.1:54594 - "POST /node/69dc3b655dbfa74e32f96f53 HTTP/1.0" 202 Accepted 2026-04-15 00:40:14,306 - lava_callback - INFO - Starting async job submit for node 69dc3b655dbfa74e32f96f53 2026-04-15 00:40:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,338 - lava_callback - DEBUG - Processing node 69dc3b655dbfa74e32f96f53: baseline-arm-baylibre 2026-04-15 00:40:14,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b655dbfa74e32f96f53 2026-04-15 00:40:14,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:40:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:14,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b655dbfa74e32f96f53 HTTP/1.1" 200 None 2026-04-15 00:40:14,437 - lava_callback - ERROR - Error processing callback for node 69dc3b655dbfa74e32f96f53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:40:47,194 - lava_callback - INFO - Received callback for node 69dc3b895dbfa74e32f96f86 INFO: 172.21.0.1:53852 - "POST /node/69dc3b895dbfa74e32f96f86 HTTP/1.0" 202 Accepted 2026-04-15 00:40:47,200 - lava_callback - INFO - Starting async job submit for node 69dc3b895dbfa74e32f96f86 2026-04-15 00:40:47,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,218 - lava_callback - DEBUG - Processing node 69dc3b895dbfa74e32f96f86: baseline-arm-clabbe 2026-04-15 00:40:47,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3b895dbfa74e32f96f86 2026-04-15 00:40:47,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:40:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:40:47,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3b895dbfa74e32f96f86 HTTP/1.1" 200 None 2026-04-15 00:40:47,283 - lava_callback - ERROR - Error processing callback for node 69dc3b895dbfa74e32f96f86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:27,151 - lava_callback - INFO - Received callback for node 69dc3bae5dbfa74e32f96fea INFO: 172.21.0.1:40638 - "POST /node/69dc3bae5dbfa74e32f96fea HTTP/1.0" 202 Accepted 2026-04-15 00:41:27,162 - lava_callback - INFO - Starting async job submit for node 69dc3bae5dbfa74e32f96fea 2026-04-15 00:41:27,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,196 - lava_callback - DEBUG - Processing node 69dc3bae5dbfa74e32f96fea: baseline-arm-clabbe 2026-04-15 00:41:27,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bae5dbfa74e32f96fea 2026-04-15 00:41:27,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:41:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:27,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bae5dbfa74e32f96fea HTTP/1.1" 200 None 2026-04-15 00:41:27,281 - lava_callback - ERROR - Error processing callback for node 69dc3bae5dbfa74e32f96fea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:29,207 - lava_callback - INFO - Received callback for node 69dedeabf490930782fb719b INFO: 172.21.0.1:40646 - "POST /node/69dedeabf490930782fb719b HTTP/1.0" 202 Accepted 2026-04-15 00:41:29,214 - lava_callback - INFO - Starting async job submit for node 69dedeabf490930782fb719b 2026-04-15 00:41:29,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,232 - lava_callback - DEBUG - Processing node 69dedeabf490930782fb719b: baseline-arm 2026-04-15 00:41:29,238 - lava_callback - WARNING - Failed to upload log 2026-04-15 00:41:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:29,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:29,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719b/lava-logs.yaml 2026-04-15 00:41:29,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:29,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:29,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719b/lava_callback.json.gz 2026-04-15 00:41:29,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:41:29,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeabf490930782fb719b HTTP/1.1" 200 None 2026-04-15 00:41:29,687 - lava_callback - INFO - Completed processing callback for node 69dedeabf490930782fb719b 2026-04-15 00:41:34,434 - lava_callback - INFO - Received callback for node 69dc3bac5dbfa74e32f96fe4 INFO: 172.21.0.1:40620 - "POST /node/69dc3bac5dbfa74e32f96fe4 HTTP/1.0" 202 Accepted 2026-04-15 00:41:34,447 - lava_callback - INFO - Starting async job submit for node 69dc3bac5dbfa74e32f96fe4 2026-04-15 00:41:34,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,472 - lava_callback - DEBUG - Processing node 69dc3bac5dbfa74e32f96fe4: baseline-arm-baylibre 2026-04-15 00:41:34,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bac5dbfa74e32f96fe4 2026-04-15 00:41:34,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:34,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:34,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bac5dbfa74e32f96fe4 HTTP/1.1" 200 None 2026-04-15 00:41:34,577 - lava_callback - ERROR - Error processing callback for node 69dc3bac5dbfa74e32f96fe4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:35,085 - lava_callback - INFO - Received callback for node 69dc3bad5dbfa74e32f96fe7 INFO: 172.21.0.1:40622 - "POST /node/69dc3bad5dbfa74e32f96fe7 HTTP/1.0" 202 Accepted 2026-04-15 00:41:35,090 - lava_callback - INFO - Starting async job submit for node 69dc3bad5dbfa74e32f96fe7 2026-04-15 00:41:35,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,107 - lava_callback - DEBUG - Processing node 69dc3bad5dbfa74e32f96fe7: baseline-arm-baylibre 2026-04-15 00:41:35,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bad5dbfa74e32f96fe7 2026-04-15 00:41:35,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:35,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bad5dbfa74e32f96fe7 HTTP/1.1" 200 None 2026-04-15 00:41:35,159 - lava_callback - ERROR - Error processing callback for node 69dc3bad5dbfa74e32f96fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:35,759 - lava_callback - INFO - Received callback for node 69dc3bae5dbfa74e32f96fec INFO: 172.21.0.1:40630 - "POST /node/69dc3bae5dbfa74e32f96fec HTTP/1.0" 202 Accepted 2026-04-15 00:41:35,769 - lava_callback - INFO - Starting async job submit for node 69dc3bae5dbfa74e32f96fec 2026-04-15 00:41:35,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,801 - lava_callback - DEBUG - Processing node 69dc3bae5dbfa74e32f96fec: baseline-arm-baylibre 2026-04-15 00:41:35,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bae5dbfa74e32f96fec 2026-04-15 00:41:35,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:35,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:35,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bae5dbfa74e32f96fec HTTP/1.1" 200 None 2026-04-15 00:41:35,897 - lava_callback - ERROR - Error processing callback for node 69dc3bae5dbfa74e32f96fec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 00:41:36,423 - lava_callback - INFO - Received callback for node 69dc3bb15dbfa74e32f96ffa INFO: 172.21.0.1:40634 - "POST /node/69dc3bb15dbfa74e32f96ffa HTTP/1.0" 202 Accepted 2026-04-15 00:41:36,428 - lava_callback - INFO - Starting async job submit for node 69dc3bb15dbfa74e32f96ffa 2026-04-15 00:41:36,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,444 - lava_callback - DEBUG - Processing node 69dc3bb15dbfa74e32f96ffa: baseline-arm-baylibre 2026-04-15 00:41:36,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bb15dbfa74e32f96ffa 2026-04-15 00:41:36,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:36,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:36,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bb15dbfa74e32f96ffa HTTP/1.1" 200 None 2026-04-15 00:41:36,507 - lava_callback - ERROR - Error processing callback for node 69dc3bb15dbfa74e32f96ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:37,116 - lava_callback - INFO - Received callback for node 69dc3bb35dbfa74e32f96ffd INFO: 172.21.0.1:40650 - "POST /node/69dc3bb35dbfa74e32f96ffd HTTP/1.0" 202 Accepted 2026-04-15 00:41:37,121 - lava_callback - INFO - Starting async job submit for node 69dc3bb35dbfa74e32f96ffd 2026-04-15 00:41:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,138 - lava_callback - DEBUG - Processing node 69dc3bb35dbfa74e32f96ffd: baseline-arm-baylibre 2026-04-15 00:41:37,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bb35dbfa74e32f96ffd 2026-04-15 00:41:37,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:37,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bb35dbfa74e32f96ffd HTTP/1.1" 200 None 2026-04-15 00:41:37,194 - lava_callback - ERROR - Error processing callback for node 69dc3bb35dbfa74e32f96ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:37,788 - lava_callback - INFO - Received callback for node 69dc3bab5dbfa74e32f96fe1 INFO: 172.21.0.1:40656 - "POST /node/69dc3bab5dbfa74e32f96fe1 HTTP/1.0" 202 Accepted 2026-04-15 00:41:37,793 - lava_callback - INFO - Starting async job submit for node 69dc3bab5dbfa74e32f96fe1 2026-04-15 00:41:37,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,809 - lava_callback - DEBUG - Processing node 69dc3bab5dbfa74e32f96fe1: baseline-arm-baylibre 2026-04-15 00:41:37,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bab5dbfa74e32f96fe1 2026-04-15 00:41:37,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:37,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:37,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bab5dbfa74e32f96fe1 HTTP/1.1" 200 None 2026-04-15 00:41:37,858 - lava_callback - ERROR - Error processing callback for node 69dc3bab5dbfa74e32f96fe1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:41:47,136 - lava_callback - INFO - Received callback for node 69dc3bba5dbfa74e32f97012 INFO: 172.21.0.1:35252 - "POST /node/69dc3bba5dbfa74e32f97012 HTTP/1.0" 202 Accepted 2026-04-15 00:41:47,142 - lava_callback - INFO - Starting async job submit for node 69dc3bba5dbfa74e32f97012 2026-04-15 00:41:47,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,166 - lava_callback - DEBUG - Processing node 69dc3bba5dbfa74e32f97012: baseline-arm-clabbe 2026-04-15 00:41:47,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bba5dbfa74e32f97012 2026-04-15 00:41:47,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bba5dbfa74e32f97012 HTTP/1.1" 200 None 2026-04-15 00:41:47,232 - lava_callback - ERROR - Error processing callback for node 69dc3bba5dbfa74e32f97012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:47,862 - lava_callback - INFO - Received callback for node 69dc3bbb5dbfa74e32f97018 INFO: 172.21.0.1:35268 - "POST /node/69dc3bbb5dbfa74e32f97018 HTTP/1.0" 202 Accepted 2026-04-15 00:41:47,869 - lava_callback - INFO - Starting async job submit for node 69dc3bbb5dbfa74e32f97018 2026-04-15 00:41:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,891 - lava_callback - DEBUG - Processing node 69dc3bbb5dbfa74e32f97018: baseline-arm-clabbe 2026-04-15 00:41:47,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbb5dbfa74e32f97018 2026-04-15 00:41:47,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:47,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:47,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbb5dbfa74e32f97018 HTTP/1.1" 200 None 2026-04-15 00:41:47,940 - lava_callback - ERROR - Error processing callback for node 69dc3bbb5dbfa74e32f97018: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:48,582 - lava_callback - INFO - Received callback for node 69dc3bbc5dbfa74e32f9701c INFO: 172.21.0.1:35284 - "POST /node/69dc3bbc5dbfa74e32f9701c HTTP/1.0" 202 Accepted 2026-04-15 00:41:48,587 - lava_callback - INFO - Starting async job submit for node 69dc3bbc5dbfa74e32f9701c 2026-04-15 00:41:48,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,604 - lava_callback - DEBUG - Processing node 69dc3bbc5dbfa74e32f9701c: baseline-arm-clabbe 2026-04-15 00:41:48,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbc5dbfa74e32f9701c 2026-04-15 00:41:48,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:48,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbc5dbfa74e32f9701c HTTP/1.1" 200 None 2026-04-15 00:41:48,667 - lava_callback - ERROR - Error processing callback for node 69dc3bbc5dbfa74e32f9701c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:49,277 - lava_callback - INFO - Received callback for node 69dc3bbd5dbfa74e32f9701f INFO: 172.21.0.1:35286 - "POST /node/69dc3bbd5dbfa74e32f9701f HTTP/1.0" 202 Accepted 2026-04-15 00:41:49,283 - lava_callback - INFO - Starting async job submit for node 69dc3bbd5dbfa74e32f9701f 2026-04-15 00:41:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,299 - lava_callback - DEBUG - Processing node 69dc3bbd5dbfa74e32f9701f: baseline-arm-clabbe 2026-04-15 00:41:49,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbd5dbfa74e32f9701f 2026-04-15 00:41:49,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:49,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:49,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbd5dbfa74e32f9701f HTTP/1.1" 200 None 2026-04-15 00:41:49,350 - lava_callback - ERROR - Error processing callback for node 69dc3bbd5dbfa74e32f9701f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:50,063 - lava_callback - INFO - Received callback for node 69dc3bbd5dbfa74e32f97022 INFO: 172.21.0.1:48044 - "POST /node/69dc3bbd5dbfa74e32f97022 HTTP/1.0" 202 Accepted 2026-04-15 00:41:50,069 - lava_callback - INFO - Starting async job submit for node 69dc3bbd5dbfa74e32f97022 2026-04-15 00:41:50,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,089 - lava_callback - DEBUG - Processing node 69dc3bbd5dbfa74e32f97022: baseline-arm-clabbe 2026-04-15 00:41:50,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbd5dbfa74e32f97022 2026-04-15 00:41:50,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:50,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbd5dbfa74e32f97022 HTTP/1.1" 200 None 2026-04-15 00:41:50,205 - lava_callback - ERROR - Error processing callback for node 69dc3bbd5dbfa74e32f97022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:50,737 - lava_callback - INFO - Received callback for node 69dc3bbe5dbfa74e32f97025 INFO: 172.21.0.1:48048 - "POST /node/69dc3bbe5dbfa74e32f97025 HTTP/1.0" 202 Accepted 2026-04-15 00:41:50,743 - lava_callback - INFO - Starting async job submit for node 69dc3bbe5dbfa74e32f97025 2026-04-15 00:41:50,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,759 - lava_callback - DEBUG - Processing node 69dc3bbe5dbfa74e32f97025: baseline-arm-clabbe 2026-04-15 00:41:50,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbe5dbfa74e32f97025 2026-04-15 00:41:50,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:50,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:50,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbe5dbfa74e32f97025 HTTP/1.1" 200 None 2026-04-15 00:41:50,809 - lava_callback - ERROR - Error processing callback for node 69dc3bbe5dbfa74e32f97025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:51,432 - lava_callback - INFO - Received callback for node 69dc3bbf5dbfa74e32f9702c INFO: 172.21.0.1:48054 - "POST /node/69dc3bbf5dbfa74e32f9702c HTTP/1.0" 202 Accepted 2026-04-15 00:41:51,438 - lava_callback - INFO - Starting async job submit for node 69dc3bbf5dbfa74e32f9702c 2026-04-15 00:41:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,455 - lava_callback - DEBUG - Processing node 69dc3bbf5dbfa74e32f9702c: baseline-arm-clabbe 2026-04-15 00:41:51,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bbf5dbfa74e32f9702c 2026-04-15 00:41:51,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:51,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bbf5dbfa74e32f9702c HTTP/1.1" 200 None 2026-04-15 00:41:51,506 - lava_callback - ERROR - Error processing callback for node 69dc3bbf5dbfa74e32f9702c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:52,099 - lava_callback - INFO - Received callback for node 69dc3bc05dbfa74e32f9702f INFO: 172.21.0.1:48066 - "POST /node/69dc3bc05dbfa74e32f9702f HTTP/1.0" 202 Accepted 2026-04-15 00:41:52,105 - lava_callback - INFO - Starting async job submit for node 69dc3bc05dbfa74e32f9702f 2026-04-15 00:41:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,125 - lava_callback - DEBUG - Processing node 69dc3bc05dbfa74e32f9702f: baseline-arm-clabbe 2026-04-15 00:41:52,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bc05dbfa74e32f9702f 2026-04-15 00:41:52,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:52,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bc05dbfa74e32f9702f HTTP/1.1" 200 None 2026-04-15 00:41:52,186 - lava_callback - ERROR - Error processing callback for node 69dc3bc05dbfa74e32f9702f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:52,786 - lava_callback - INFO - Received callback for node 69dc3bc15dbfa74e32f97032 INFO: 172.21.0.1:48074 - "POST /node/69dc3bc15dbfa74e32f97032 HTTP/1.0" 202 Accepted 2026-04-15 00:41:52,792 - lava_callback - INFO - Starting async job submit for node 69dc3bc15dbfa74e32f97032 2026-04-15 00:41:52,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,817 - lava_callback - DEBUG - Processing node 69dc3bc15dbfa74e32f97032: baseline-arm-clabbe 2026-04-15 00:41:52,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bc15dbfa74e32f97032 2026-04-15 00:41:52,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 00:41:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:52,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bc15dbfa74e32f97032 HTTP/1.1" 200 None 2026-04-15 00:41:52,872 - lava_callback - ERROR - Error processing callback for node 69dc3bc15dbfa74e32f97032: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:41:54,911 - lava_callback - INFO - Received callback for node 69dedeaef490930782fb71a7 INFO: 172.21.0.1:48084 - "POST /node/69dedeaef490930782fb71a7 HTTP/1.0" 202 Accepted 2026-04-15 00:41:54,958 - lava_callback - INFO - Starting async job submit for node 69dedeaef490930782fb71a7 2026-04-15 00:41:54,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:54,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:54,990 - lava_callback - DEBUG - Processing node 69dedeaef490930782fb71a7: baseline-arm 2026-04-15 00:41:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/log.txt.gz 2026-04-15 00:41:55,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/lava-logs.yaml 2026-04-15 00:41:55,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:41:55,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:41:55,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaef490930782fb71a7/lava_callback.json.gz 2026-04-15 00:41:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:41:55,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:41:55,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeaef490930782fb71a7 HTTP/1.1" 200 None 2026-04-15 00:41:55,656 - lava_callback - INFO - Completed processing callback for node 69dedeaef490930782fb71a7 INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:00,107 - lava_callback - INFO - Received callback for node 69dedeabf490930782fb719e INFO: 172.21.0.1:48238 - "POST /node/69dedeabf490930782fb719e HTTP/1.0" 202 Accepted 2026-04-15 00:42:00,154 - lava_callback - INFO - Starting async job submit for node 69dedeabf490930782fb719e 2026-04-15 00:42:00,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,198 - lava_callback - DEBUG - Processing node 69dedeabf490930782fb719e: baseline-arm 2026-04-15 00:42:00,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/log.txt.gz 2026-04-15 00:42:00,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/lava-logs.yaml 2026-04-15 00:42:00,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:00,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:00,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeabf490930782fb719e/lava_callback.json.gz 2026-04-15 00:42:00,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:00,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:00,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeabf490930782fb719e HTTP/1.1" 200 None 2026-04-15 00:42:00,938 - lava_callback - INFO - Completed processing callback for node 69dedeabf490930782fb719e 2026-04-15 00:42:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:06,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:07,127 - lava_callback - INFO - Received callback for node 69dc3bd45dbfa74e32f97083 INFO: 172.21.0.1:48276 - "POST /node/69dc3bd45dbfa74e32f97083 HTTP/1.0" 202 Accepted 2026-04-15 00:42:07,132 - lava_callback - INFO - Starting async job submit for node 69dc3bd45dbfa74e32f97083 2026-04-15 00:42:07,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,152 - lava_callback - DEBUG - Processing node 69dc3bd45dbfa74e32f97083: baseline-arm-clabbe 2026-04-15 00:42:07,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bd45dbfa74e32f97083 2026-04-15 00:42:07,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:42:07,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:07,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bd45dbfa74e32f97083 HTTP/1.1" 200 None 2026-04-15 00:42:07,220 - lava_callback - ERROR - Error processing callback for node 69dc3bd45dbfa74e32f97083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:34,684 - lava_callback - INFO - Received callback for node 69dedeadf490930782fb71a4 INFO: 172.21.0.1:35188 - "POST /node/69dedeadf490930782fb71a4 HTTP/1.0" 202 Accepted 2026-04-15 00:42:34,690 - lava_callback - INFO - Starting async job submit for node 69dedeadf490930782fb71a4 2026-04-15 00:42:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:34,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:34,727 - lava_callback - DEBUG - Processing node 69dedeadf490930782fb71a4: baseline-arm 2026-04-15 00:42:35,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/log.txt.gz 2026-04-15 00:42:35,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/lava-logs.yaml 2026-04-15 00:42:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:35,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:35,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeadf490930782fb71a4/lava_callback.json.gz 2026-04-15 00:42:35,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:35,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:35,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:35,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeadf490930782fb71a4 HTTP/1.1" 200 None 2026-04-15 00:42:35,753 - lava_callback - INFO - Completed processing callback for node 69dedeadf490930782fb71a4 2026-04-15 00:42:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:36,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:37,883 - lava_callback - INFO - Received callback for node 69dedeaaf490930782fb7198 INFO: 172.21.0.1:35216 - "POST /node/69dedeaaf490930782fb7198 HTTP/1.0" 202 Accepted 2026-04-15 00:42:37,889 - lava_callback - INFO - Starting async job submit for node 69dedeaaf490930782fb7198 2026-04-15 00:42:37,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:37,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:37,943 - lava_callback - DEBUG - Processing node 69dedeaaf490930782fb7198: baseline-arm 2026-04-15 00:42:38,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/log.txt.gz 2026-04-15 00:42:38,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/lava-logs.yaml 2026-04-15 00:42:38,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:38,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:38,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeaaf490930782fb7198/lava_callback.json.gz 2026-04-15 00:42:38,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:38,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:38,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeaaf490930782fb7198 HTTP/1.1" 200 None 2026-04-15 00:42:38,845 - lava_callback - INFO - Completed processing callback for node 69dedeaaf490930782fb7198 2026-04-15 00:42:44,973 - lava_callback - INFO - Received callback for node 69dedecff490930782fb722d INFO: 172.21.0.1:44206 - "POST /node/69dedecff490930782fb722d HTTP/1.0" 202 Accepted 2026-04-15 00:42:44,979 - lava_callback - INFO - Starting async job submit for node 69dedecff490930782fb722d 2026-04-15 00:42:44,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,012 - lava_callback - DEBUG - Processing node 69dedecff490930782fb722d: baseline-arm-pengutronix 2026-04-15 00:42:45,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/log.txt.gz 2026-04-15 00:42:45,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/lava-logs.yaml 2026-04-15 00:42:45,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:45,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:45,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dedecff490930782fb722d/lava_callback.json.gz 2026-04-15 00:42:45,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedecff490930782fb722d HTTP/1.1" 200 None 2026-04-15 00:42:45,760 - lava_callback - INFO - Completed processing callback for node 69dedecff490930782fb722d 2026-04-15 00:42:46,282 - lava_callback - INFO - Received callback for node 69dedebdf490930782fb71db INFO: 172.21.0.1:44222 - "POST /node/69dedebdf490930782fb71db HTTP/1.0" 202 Accepted 2026-04-15 00:42:46,290 - lava_callback - INFO - Starting async job submit for node 69dedebdf490930782fb71db 2026-04-15 00:42:46,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:46,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:46,328 - lava_callback - DEBUG - Processing node 69dedebdf490930782fb71db: baseline-arm-broonie INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:42:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:46,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:46,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/log.txt.gz 2026-04-15 00:42:46,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:46,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:46,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/lava-logs.yaml 2026-04-15 00:42:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:47,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:47,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebdf490930782fb71db/lava_callback.json.gz 2026-04-15 00:42:47,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:47,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:47,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebdf490930782fb71db HTTP/1.1" 200 None 2026-04-15 00:42:47,216 - lava_callback - INFO - Completed processing callback for node 69dedebdf490930782fb71db 2026-04-15 00:42:47,225 - lava_callback - INFO - Received callback for node 69dc3bfa5dbfa74e32f97109 INFO: 172.21.0.1:44228 - "POST /node/69dc3bfa5dbfa74e32f97109 HTTP/1.0" 202 Accepted 2026-04-15 00:42:47,246 - lava_callback - INFO - Starting async job submit for node 69dc3bfa5dbfa74e32f97109 2026-04-15 00:42:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,281 - lava_callback - DEBUG - Processing node 69dc3bfa5dbfa74e32f97109: baseline-arm-clabbe 2026-04-15 00:42:47,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3bfa5dbfa74e32f97109 2026-04-15 00:42:47,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:42:47,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:47,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3bfa5dbfa74e32f97109 HTTP/1.1" 200 None 2026-04-15 00:42:47,363 - lava_callback - ERROR - Error processing callback for node 69dc3bfa5dbfa74e32f97109: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:42:54,943 - lava_callback - INFO - Received callback for node 69deded0f490930782fb7234 INFO: 172.21.0.1:59574 - "POST /node/69deded0f490930782fb7234 HTTP/1.0" 202 Accepted 2026-04-15 00:42:54,989 - lava_callback - INFO - Starting async job submit for node 69deded0f490930782fb7234 2026-04-15 00:42:55,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,053 - lava_callback - DEBUG - Processing node 69deded0f490930782fb7234: baseline-arm-pengutronix 2026-04-15 00:42:55,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/log.txt.gz 2026-04-15 00:42:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/lava-logs.yaml 2026-04-15 00:42:55,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:42:55,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:42:55,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69deded0f490930782fb7234/lava_callback.json.gz 2026-04-15 00:42:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:42:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:42:55,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deded0f490930782fb7234 HTTP/1.1" 200 None 2026-04-15 00:42:55,719 - lava_callback - INFO - Completed processing callback for node 69deded0f490930782fb7234 INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:05,580 - lava_callback - INFO - Received callback for node 69dedebef490930782fb71de INFO: 172.21.0.1:60344 - "POST /node/69dedebef490930782fb71de HTTP/1.0" 202 Accepted 2026-04-15 00:43:05,586 - lava_callback - INFO - Starting async job submit for node 69dedebef490930782fb71de 2026-04-15 00:43:05,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:05,631 - lava_callback - DEBUG - Processing node 69dedebef490930782fb71de: baseline-arm-broonie 2026-04-15 00:43:05,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:05,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:05,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/log.txt.gz 2026-04-15 00:43:06,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:06,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:06,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/lava-logs.yaml 2026-04-15 00:43:06,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 00:43:06,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:06,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebef490930782fb71de/lava_callback.json.gz 2026-04-15 00:43:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:06,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:06,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebef490930782fb71de HTTP/1.1" 200 None 2026-04-15 00:43:06,570 - lava_callback - INFO - Completed processing callback for node 69dedebef490930782fb71de INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:07,226 - lava_callback - INFO - Received callback for node 69dedebcf490930782fb71d8 INFO: 172.21.0.1:60378 - "POST /node/69dedebcf490930782fb71d8 HTTP/1.0" 202 Accepted 2026-04-15 00:43:07,232 - lava_callback - INFO - Starting async job submit for node 69dedebcf490930782fb71d8 2026-04-15 00:43:07,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:07,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:07,270 - lava_callback - DEBUG - Processing node 69dedebcf490930782fb71d8: baseline-arm-broonie 2026-04-15 00:43:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:07,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:07,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/log.txt.gz 2026-04-15 00:43:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:07,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:07,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/lava-logs.yaml 2026-04-15 00:43:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:08,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:08,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebcf490930782fb71d8/lava_callback.json.gz 2026-04-15 00:43:08,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:08,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:08,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:08,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebcf490930782fb71d8 HTTP/1.1" 200 None 2026-04-15 00:43:08,151 - lava_callback - INFO - Completed processing callback for node 69dedebcf490930782fb71d8 INFO: 172.21.0.1:48724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:25,710 - lava_callback - INFO - Received callback for node 69dedebaf490930782fb71d5 INFO: 172.21.0.1:37334 - "POST /node/69dedebaf490930782fb71d5 HTTP/1.0" 202 Accepted 2026-04-15 00:43:25,716 - lava_callback - INFO - Starting async job submit for node 69dedebaf490930782fb71d5 2026-04-15 00:43:25,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:25,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:25,779 - lava_callback - DEBUG - Processing node 69dedebaf490930782fb71d5: baseline-arm-broonie 2026-04-15 00:43:25,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:26,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,288 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/log.txt.gz 2026-04-15 00:43:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:43:26,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/lava-logs.yaml 2026-04-15 00:43:26,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:26,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:26,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dedebaf490930782fb71d5/lava_callback.json.gz 2026-04-15 00:43:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:26,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedebaf490930782fb71d5 HTTP/1.1" 200 None 2026-04-15 00:43:26,827 - lava_callback - INFO - Completed processing callback for node 69dedebaf490930782fb71d5 2026-04-15 00:43:27,249 - lava_callback - INFO - Received callback for node 69dc3c1e5dbfa74e32f97163 INFO: 172.21.0.1:37348 - "POST /node/69dc3c1e5dbfa74e32f97163 HTTP/1.0" 202 Accepted 2026-04-15 00:43:27,255 - lava_callback - INFO - Starting async job submit for node 69dc3c1e5dbfa74e32f97163 2026-04-15 00:43:27,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,270 - lava_callback - DEBUG - Processing node 69dc3c1e5dbfa74e32f97163: baseline-arm-clabbe 2026-04-15 00:43:27,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c1e5dbfa74e32f97163 2026-04-15 00:43:27,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:43:27,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c1e5dbfa74e32f97163 HTTP/1.1" 200 None 2026-04-15 00:43:27,318 - lava_callback - ERROR - Error processing callback for node 69dc3c1e5dbfa74e32f97163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:43:27,348 - lava_callback - INFO - Received callback for node 69dedec9f490930782fb7213 INFO: 172.21.0.1:37358 - "POST /node/69dedec9f490930782fb7213 HTTP/1.0" 202 Accepted 2026-04-15 00:43:27,364 - lava_callback - INFO - Starting async job submit for node 69dedec9f490930782fb7213 2026-04-15 00:43:27,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:27,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:27,427 - lava_callback - DEBUG - Processing node 69dedec9f490930782fb7213: baseline-arm-kontron 2026-04-15 00:43:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:27,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:27,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/log.txt.gz 2026-04-15 00:43:27,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/lava-logs.yaml 2026-04-15 00:43:28,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedec9f490930782fb7213/lava_callback.json.gz 2026-04-15 00:43:28,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:28,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:28,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedec9f490930782fb7213 HTTP/1.1" 200 None 2026-04-15 00:43:28,327 - lava_callback - INFO - Completed processing callback for node 69dedec9f490930782fb7213 2026-04-15 00:43:28,554 - lava_callback - INFO - Received callback for node 69dedecbf490930782fb7216 INFO: 172.21.0.1:37362 - "POST /node/69dedecbf490930782fb7216 HTTP/1.0" 202 Accepted 2026-04-15 00:43:28,564 - lava_callback - INFO - Starting async job submit for node 69dedecbf490930782fb7216 2026-04-15 00:43:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:28,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:28,615 - lava_callback - DEBUG - Processing node 69dedecbf490930782fb7216: baseline-arm-kontron 2026-04-15 00:43:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:28,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:28,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/log.txt.gz 2026-04-15 00:43:29,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:29,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:29,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/lava-logs.yaml 2026-04-15 00:43:29,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:43:29,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:43:29,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dedecbf490930782fb7216/lava_callback.json.gz 2026-04-15 00:43:29,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:29,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:43:29,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:29,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedecbf490930782fb7216 HTTP/1.1" 200 None 2026-04-15 00:43:29,503 - lava_callback - INFO - Completed processing callback for node 69dedecbf490930782fb7216 2026-04-15 00:43:36,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:43:36,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:44:07,143 - lava_callback - INFO - Received callback for node 69dedee1f490930782fb7288 INFO: 172.21.0.1:33040 - "POST /node/69dedee1f490930782fb7288 HTTP/1.0" 202 Accepted 2026-04-15 00:44:07,150 - lava_callback - INFO - Starting async job submit for node 69dedee1f490930782fb7288 2026-04-15 00:44:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:07,188 - lava_callback - DEBUG - Processing node 69dedee1f490930782fb7288: ltp-dio 2026-04-15 00:44:07,262 - lava_callback - INFO - Received callback for node 69dc3c435dbfa74e32f97191 INFO: 172.21.0.1:33048 - "POST /node/69dc3c435dbfa74e32f97191 HTTP/1.0" 202 Accepted 2026-04-15 00:44:07,283 - lava_callback - INFO - Starting async job submit for node 69dc3c435dbfa74e32f97191 2026-04-15 00:44:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,383 - lava_callback - DEBUG - Processing node 69dc3c435dbfa74e32f97191: baseline-arm-clabbe 2026-04-15 00:44:07,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c435dbfa74e32f97191 2026-04-15 00:44:07,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:07,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:44:07,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:07,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c435dbfa74e32f97191 HTTP/1.1" 200 None 2026-04-15 00:44:07,611 - lava_callback - ERROR - Error processing callback for node 69dc3c435dbfa74e32f97191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:44:07,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:07,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/log.txt.gz 2026-04-15 00:44:08,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:08,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:08,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/lava-logs.yaml 2026-04-15 00:44:08,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:44:08,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:44:08,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69dedee1f490930782fb7288/lava_callback.json.gz 2026-04-15 00:44:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:44:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:08,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee1f490930782fb7288 HTTP/1.1" 200 None 2026-04-15 00:44:08,550 - lava_callback - INFO - Completed processing callback for node 69dedee1f490930782fb7288 INFO: 172.21.0.1:46322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:44:27,220 - lava_callback - INFO - Received callback for node 69dc3c655dbfa74e32f971c4 INFO: 172.21.0.1:47734 - "POST /node/69dc3c655dbfa74e32f971c4 HTTP/1.0" 202 Accepted 2026-04-15 00:44:27,226 - lava_callback - INFO - Starting async job submit for node 69dc3c655dbfa74e32f971c4 2026-04-15 00:44:27,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,247 - lava_callback - DEBUG - Processing node 69dc3c655dbfa74e32f971c4: baseline-arm-clabbe 2026-04-15 00:44:27,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c655dbfa74e32f971c4 2026-04-15 00:44:27,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:44:27,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:27,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c655dbfa74e32f971c4 HTTP/1.1" 200 None 2026-04-15 00:44:27,295 - lava_callback - ERROR - Error processing callback for node 69dc3c655dbfa74e32f971c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:44:36,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:44:36,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:45:07,313 - lava_callback - INFO - Received callback for node 69dc3c885dbfa74e32f971eb INFO: 172.21.0.1:43518 - "POST /node/69dc3c885dbfa74e32f971eb HTTP/1.0" 202 Accepted 2026-04-15 00:45:07,319 - lava_callback - INFO - Starting async job submit for node 69dc3c885dbfa74e32f971eb 2026-04-15 00:45:07,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,336 - lava_callback - DEBUG - Processing node 69dc3c885dbfa74e32f971eb: baseline-arm-clabbe 2026-04-15 00:45:07,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3c885dbfa74e32f971eb 2026-04-15 00:45:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:45:07,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:07,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3c885dbfa74e32f971eb HTTP/1.1" 200 None 2026-04-15 00:45:07,400 - lava_callback - ERROR - Error processing callback for node 69dc3c885dbfa74e32f971eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:45:47,313 - lava_callback - INFO - Received callback for node 69dc3caa5dbfa74e32f9720c INFO: 172.21.0.1:60248 - "POST /node/69dc3caa5dbfa74e32f9720c HTTP/1.0" 202 Accepted 2026-04-15 00:45:47,319 - lava_callback - INFO - Starting async job submit for node 69dc3caa5dbfa74e32f9720c 2026-04-15 00:45:47,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,334 - lava_callback - DEBUG - Processing node 69dc3caa5dbfa74e32f9720c: baseline-arm-clabbe 2026-04-15 00:45:47,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3caa5dbfa74e32f9720c 2026-04-15 00:45:47,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 00:45:47,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:45:47,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3caa5dbfa74e32f9720c HTTP/1.1" 200 None 2026-04-15 00:45:47,394 - lava_callback - ERROR - Error processing callback for node 69dc3caa5dbfa74e32f9720c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:46:25,812 - lava_callback - INFO - Received callback for node 69dedeebf490930782fb72d5 INFO: 172.21.0.1:55816 - "POST /node/69dedeebf490930782fb72d5 HTTP/1.0" 202 Accepted 2026-04-15 00:46:25,820 - lava_callback - INFO - Starting async job submit for node 69dedeebf490930782fb72d5 2026-04-15 00:46:25,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:25,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:25,886 - lava_callback - DEBUG - Processing node 69dedeebf490930782fb72d5: ltp-syscalls INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:46:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:27,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:27,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/log.txt.gz 2026-04-15 00:46:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:28,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:28,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/lava-logs.yaml 2026-04-15 00:46:28,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:46:28,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:46:28,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dedeebf490930782fb72d5/lava_callback.json.gz 2026-04-15 00:46:28,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:46:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeebf490930782fb72d5 HTTP/1.1" 200 None 2026-04-15 00:46:28,421 - lava_callback - INFO - Completed processing callback for node 69dedeebf490930782fb72d5 2026-04-15 00:46:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:46:36,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET /node/698ff16c76d4b6342e9db7c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:07,697 - lava_callback - INFO - Received callback for node 69dedfbef490930782fb73d2 INFO: 172.21.0.1:44104 - "POST /node/69dedfbef490930782fb73d2 HTTP/1.0" 202 Accepted 2026-04-15 00:48:07,705 - lava_callback - INFO - Starting async job submit for node 69dedfbef490930782fb73d2 2026-04-15 00:48:07,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:07,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:07,743 - lava_callback - DEBUG - Processing node 69dedfbef490930782fb73d2: baseline-x86 2026-04-15 00:48:08,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:08,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:08,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/log.txt.gz 2026-04-15 00:48:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:08,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:08,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/lava-logs.yaml 2026-04-15 00:48:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:09,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:09,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedfbef490930782fb73d2/lava_callback.json.gz 2026-04-15 00:48:09,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:48:09,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:09,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedfbef490930782fb73d2 HTTP/1.1" 200 None 2026-04-15 00:48:09,124 - lava_callback - INFO - Completed processing callback for node 69dedfbef490930782fb73d2 INFO: 172.21.0.1:60888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:25,862 - lava_callback - INFO - Received callback for node 69dedee0f490930782fb7285 INFO: 172.21.0.1:58348 - "POST /node/69dedee0f490930782fb7285 HTTP/1.0" 202 Accepted 2026-04-15 00:48:25,872 - lava_callback - INFO - Starting async job submit for node 69dedee0f490930782fb7285 2026-04-15 00:48:25,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:25,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:25,936 - lava_callback - DEBUG - Processing node 69dedee0f490930782fb7285: ltp-cve 2026-04-15 00:48:26,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:26,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:26,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/log.txt.gz 2026-04-15 00:48:27,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:27,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:27,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/lava-logs.yaml 2026-04-15 00:48:27,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:27,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:27,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69dedee0f490930782fb7285/lava_callback.json.gz 2026-04-15 00:48:27,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:27,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:48:27,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:27,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee0f490930782fb7285 HTTP/1.1" 200 None 2026-04-15 00:48:27,704 - lava_callback - INFO - Completed processing callback for node 69dedee0f490930782fb7285 2026-04-15 00:48:36,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET /node/6940ed54460bc8e265114cd6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:48:56,857 - lava_callback - INFO - Received callback for node 69dee063f490930782fb74b6 INFO: 172.21.0.1:41842 - "POST /node/69dee063f490930782fb74b6 HTTP/1.0" 202 Accepted 2026-04-15 00:48:56,864 - lava_callback - INFO - Starting async job submit for node 69dee063f490930782fb74b6 2026-04-15 00:48:56,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:56,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:56,885 - lava_callback - DEBUG - Processing node 69dee063f490930782fb74b6: baseline-arm 2026-04-15 00:48:56,891 - lava_callback - WARNING - Failed to upload log 2026-04-15 00:48:56,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:57,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:57,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee063f490930782fb74b6/lava-logs.yaml 2026-04-15 00:48:57,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:48:57,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:48:57,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee063f490930782fb74b6/lava_callback.json.gz 2026-04-15 00:48:57,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:57,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:48:57,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:48:57,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee063f490930782fb74b6 HTTP/1.1" 200 None 2026-04-15 00:48:57,383 - lava_callback - INFO - Completed processing callback for node 69dee063f490930782fb74b6 2026-04-15 00:49:06,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:49:06,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET /node/69903b53985e4efca431ddd1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57168 - "GET /node/693b7a1c41fb4c9509762807%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 00:50:45,916 - lava_callback - INFO - Received callback for node 69dededef490930782fb7280 INFO: 172.21.0.1:57182 - "POST /node/69dededef490930782fb7280 HTTP/1.0" 202 Accepted 2026-04-15 00:50:45,924 - lava_callback - INFO - Starting async job submit for node 69dededef490930782fb7280 2026-04-15 00:50:45,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:45,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:45,982 - lava_callback - DEBUG - Processing node 69dededef490930782fb7280: ltp-controllers INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:50:46,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:46,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:46,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/log.txt.gz 2026-04-15 00:50:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:47,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:47,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/lava-logs.yaml 2026-04-15 00:50:47,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:50:47,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:50:47,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69dededef490930782fb7280/lava_callback.json.gz 2026-04-15 00:50:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:47,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:50:47,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:50:47,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dededef490930782fb7280 HTTP/1.1" 200 None 2026-04-15 00:50:47,808 - lava_callback - INFO - Completed processing callback for node 69dededef490930782fb7280 INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:06,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:06,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET /node/698ef62af0e3ffbba67d2ef6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:45,948 - lava_callback - INFO - Received callback for node 69dedee3f490930782fb728b INFO: 172.21.0.1:52050 - "POST /node/69dedee3f490930782fb728b HTTP/1.0" 202 Accepted 2026-04-15 00:51:45,955 - lava_callback - INFO - Starting async job submit for node 69dedee3f490930782fb728b 2026-04-15 00:51:45,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:46,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:46,008 - lava_callback - DEBUG - Processing node 69dedee3f490930782fb728b: ltp-fs_bind 2026-04-15 00:51:46,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:51:46,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:46,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/log.txt.gz 2026-04-15 00:51:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:51:47,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:47,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/lava-logs.yaml 2026-04-15 00:51:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:51:47,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:51:47,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dedee3f490930782fb728b/lava_callback.json.gz 2026-04-15 00:51:47,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:47,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:51:47,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:51:47,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee3f490930782fb728b HTTP/1.1" 200 None 2026-04-15 00:51:47,513 - lava_callback - INFO - Completed processing callback for node 69dedee3f490930782fb728b INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:06,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /node/69836944409235c29c0e0e5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:46,408 - lava_callback - INFO - Received callback for node 69dedee4f490930782fb72c0 INFO: 172.21.0.1:53598 - "POST /node/69dedee4f490930782fb72c0 HTTP/1.0" 202 Accepted 2026-04-15 00:52:46,415 - lava_callback - INFO - Starting async job submit for node 69dedee4f490930782fb72c0 2026-04-15 00:52:46,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:46,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:46,458 - lava_callback - DEBUG - Processing node 69dedee4f490930782fb72c0: ltp-fsx INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:52:46,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/log.txt.gz 2026-04-15 00:52:47,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/lava-logs.yaml 2026-04-15 00:52:47,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:52:47,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:52:47,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69dedee4f490930782fb72c0/lava_callback.json.gz 2026-04-15 00:52:47,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:47,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:52:47,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:52:47,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee4f490930782fb72c0 HTTP/1.1" 200 None 2026-04-15 00:52:47,963 - lava_callback - INFO - Completed processing callback for node 69dedee4f490930782fb72c0 INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:53:06,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:53:06,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET /node/6991865210b45da7d7d0fd3c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 00:54:46,145 - lava_callback - INFO - Received callback for node 69dedee6f490930782fb72c7 INFO: 172.21.0.1:36508 - "POST /node/69dedee6f490930782fb72c7 HTTP/1.0" 202 Accepted 2026-04-15 00:54:46,153 - lava_callback - INFO - Starting async job submit for node 69dedee6f490930782fb72c7 2026-04-15 00:54:46,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:46,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:46,196 - lava_callback - DEBUG - Processing node 69dedee6f490930782fb72c7: ltp-ipc INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:54:46,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:46,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:46,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/log.txt.gz 2026-04-15 00:54:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:47,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:47,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/lava-logs.yaml 2026-04-15 00:54:47,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:54:47,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:54:47,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69dedee6f490930782fb72c7/lava_callback.json.gz 2026-04-15 00:54:47,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:47,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:54:47,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:54:47,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee6f490930782fb72c7 HTTP/1.1" 200 None 2026-04-15 00:54:47,644 - lava_callback - INFO - Completed processing callback for node 69dedee6f490930782fb72c7 INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:06,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:46,112 - lava_callback - INFO - Received callback for node 69dedee8f490930782fb72ce INFO: 172.21.0.1:42006 - "POST /node/69dedee8f490930782fb72ce HTTP/1.0" 202 Accepted 2026-04-15 00:55:46,122 - lava_callback - INFO - Starting async job submit for node 69dedee8f490930782fb72ce 2026-04-15 00:55:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:46,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:46,180 - lava_callback - DEBUG - Processing node 69dedee8f490930782fb72ce: ltp-sched INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:55:46,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:47,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:47,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/log.txt.gz 2026-04-15 00:55:47,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:47,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:47,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/lava-logs.yaml 2026-04-15 00:55:47,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:55:48,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:55:48,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69dedee8f490930782fb72ce/lava_callback.json.gz 2026-04-15 00:55:48,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:48,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:55:48,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:55:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedee8f490930782fb72ce HTTP/1.1" 200 None 2026-04-15 00:55:48,808 - lava_callback - INFO - Completed processing callback for node 69dedee8f490930782fb72ce INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET /node/694bd8bac19e09af58d498fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:56:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:56:06,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:14,384 - lava_callback - INFO - Received callback for node 69dedd85f490930782fb700a INFO: 172.21.0.1:41788 - "POST /node/69dedd85f490930782fb700a HTTP/1.0" 202 Accepted 2026-04-15 00:57:14,391 - lava_callback - INFO - Starting async job submit for node 69dedd85f490930782fb700a 2026-04-15 00:57:14,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:14,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:14,446 - lava_callback - DEBUG - Processing node 69dedd85f490930782fb700a: baseline-x86 INFO: 172.21.0.1:41798 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 00:57:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:15,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:15,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/log.txt.gz 2026-04-15 00:57:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:16,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:16,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/lava-logs.yaml 2026-04-15 00:57:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:16,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:16,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd85f490930782fb700a/lava_callback.json.gz DEBUG: Setup failed for 69dedd85f490930782fb700a. Transitting job node result: incomplete -> fail 2026-04-15 00:57:16,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:16,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 00:57:16,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:16,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd85f490930782fb700a HTTP/1.1" 200 None 2026-04-15 00:57:17,039 - lava_callback - INFO - Completed processing callback for node 69dedd85f490930782fb700a 2026-04-15 00:57:26,221 - lava_callback - INFO - Received callback for node 69dedeedf490930782fb72d8 INFO: 172.21.0.1:48956 - "POST /node/69dedeedf490930782fb72d8 HTTP/1.0" 202 Accepted 2026-04-15 00:57:26,228 - lava_callback - INFO - Starting async job submit for node 69dedeedf490930782fb72d8 2026-04-15 00:57:26,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:26,282 - lava_callback - DEBUG - Processing node 69dedeedf490930782fb72d8: ltp-syscalls-ipc INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:26,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:26,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:26,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/log.txt.gz 2026-04-15 00:57:27,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:27,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:27,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/lava-logs.yaml 2026-04-15 00:57:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:27,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:27,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dedeedf490930782fb72d8/lava_callback.json.gz 2026-04-15 00:57:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:27,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:57:27,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:27,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeedf490930782fb72d8 HTTP/1.1" 200 None 2026-04-15 00:57:27,694 - lava_callback - INFO - Completed processing callback for node 69dedeedf490930782fb72d8 INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:36,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:36,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55478 - "GET /node/69866314177ca0f097bd480e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:57:50,229 - lava_callback - INFO - Received callback for node 69dedeacf490930782fb71a1 INFO: 172.21.0.1:41902 - "POST /node/69dedeacf490930782fb71a1 HTTP/1.0" 202 Accepted 2026-04-15 00:57:50,236 - lava_callback - INFO - Starting async job submit for node 69dedeacf490930782fb71a1 2026-04-15 00:57:50,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:50,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:50,306 - lava_callback - DEBUG - Processing node 69dedeacf490930782fb71a1: baseline-arm 2026-04-15 00:57:50,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/log.txt.gz 2026-04-15 00:57:51,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/lava-logs.yaml 2026-04-15 00:57:51,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:57:51,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:57:51,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dedeacf490930782fb71a1/lava_callback.json.gz DEBUG: Setup failed for 69dedeacf490930782fb71a1. Transitting job node result: incomplete -> fail 2026-04-15 00:57:51,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:51,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:57:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:57:51,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeacf490930782fb71a1 HTTP/1.1" 200 None 2026-04-15 00:57:52,076 - lava_callback - INFO - Completed processing callback for node 69dedeacf490930782fb71a1 INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:06,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET /node/6986fc196e077e4126a7d4e0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:46,244 - lava_callback - INFO - Received callback for node 69dedeeff490930782fb72df INFO: 172.21.0.1:48082 - "POST /node/69dedeeff490930782fb72df HTTP/1.0" 202 Accepted 2026-04-15 00:58:46,251 - lava_callback - INFO - Starting async job submit for node 69dedeeff490930782fb72df 2026-04-15 00:58:46,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:46,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:46,292 - lava_callback - DEBUG - Processing node 69dedeeff490930782fb72df: ltp-watchqueue INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:46,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:46,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:46,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/log.txt.gz 2026-04-15 00:58:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:47,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:47,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/lava-logs.yaml 2026-04-15 00:58:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:58:47,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:58:47,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dedeeff490930782fb72df/lava_callback.json.gz 2026-04-15 00:58:47,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:47,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 00:58:47,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:47,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedeeff490930782fb72df HTTP/1.1" 200 None 2026-04-15 00:58:47,656 - lava_callback - INFO - Completed processing callback for node 69dedeeff490930782fb72df 2026-04-15 00:58:55,396 - lava_callback - INFO - Received callback for node 69dc3fc15dbfa74e32f975fe INFO: 172.21.0.1:43988 - "POST /node/69dc3fc15dbfa74e32f975fe HTTP/1.0" 202 Accepted 2026-04-15 00:58:55,403 - lava_callback - INFO - Starting async job submit for node 69dc3fc15dbfa74e32f975fe 2026-04-15 00:58:55,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,424 - lava_callback - DEBUG - Processing node 69dc3fc15dbfa74e32f975fe: baseline-arm64-baylibre 2026-04-15 00:58:55,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc15dbfa74e32f975fe 2026-04-15 00:58:55,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:55,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc15dbfa74e32f975fe HTTP/1.1" 200 None 2026-04-15 00:58:55,516 - lava_callback - ERROR - Error processing callback for node 69dc3fc15dbfa74e32f975fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:56,074 - lava_callback - INFO - Received callback for node 69dc3fc25dbfa74e32f97601 INFO: 172.21.0.1:43996 - "POST /node/69dc3fc25dbfa74e32f97601 HTTP/1.0" 202 Accepted 2026-04-15 00:58:56,081 - lava_callback - INFO - Starting async job submit for node 69dc3fc25dbfa74e32f97601 2026-04-15 00:58:56,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,098 - lava_callback - DEBUG - Processing node 69dc3fc25dbfa74e32f97601: baseline-arm64-baylibre 2026-04-15 00:58:56,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc25dbfa74e32f97601 2026-04-15 00:58:56,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:56,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc25dbfa74e32f97601 HTTP/1.1" 200 None 2026-04-15 00:58:56,148 - lava_callback - ERROR - Error processing callback for node 69dc3fc25dbfa74e32f97601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:58:56,724 - lava_callback - INFO - Received callback for node 69dc3fc85dbfa74e32f9762c INFO: 172.21.0.1:44002 - "POST /node/69dc3fc85dbfa74e32f9762c HTTP/1.0" 202 Accepted 2026-04-15 00:58:56,730 - lava_callback - INFO - Starting async job submit for node 69dc3fc85dbfa74e32f9762c 2026-04-15 00:58:56,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,747 - lava_callback - DEBUG - Processing node 69dc3fc85dbfa74e32f9762c: baseline-arm64-baylibre 2026-04-15 00:58:56,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc85dbfa74e32f9762c 2026-04-15 00:58:56,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:56,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:56,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc85dbfa74e32f9762c HTTP/1.1" 200 None 2026-04-15 00:58:56,801 - lava_callback - ERROR - Error processing callback for node 69dc3fc85dbfa74e32f9762c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:57,399 - lava_callback - INFO - Received callback for node 69dc3fbf5dbfa74e32f975fb INFO: 172.21.0.1:44012 - "POST /node/69dc3fbf5dbfa74e32f975fb HTTP/1.0" 202 Accepted 2026-04-15 00:58:57,405 - lava_callback - INFO - Starting async job submit for node 69dc3fbf5dbfa74e32f975fb 2026-04-15 00:58:57,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,421 - lava_callback - DEBUG - Processing node 69dc3fbf5dbfa74e32f975fb: baseline-arm64-baylibre 2026-04-15 00:58:57,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fbf5dbfa74e32f975fb 2026-04-15 00:58:57,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:57,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fbf5dbfa74e32f975fb HTTP/1.1" 200 None 2026-04-15 00:58:57,483 - lava_callback - ERROR - Error processing callback for node 69dc3fbf5dbfa74e32f975fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:58,047 - lava_callback - INFO - Received callback for node 69dc3fc55dbfa74e32f97608 INFO: 172.21.0.1:44020 - "POST /node/69dc3fc55dbfa74e32f97608 HTTP/1.0" 202 Accepted 2026-04-15 00:58:58,053 - lava_callback - INFO - Starting async job submit for node 69dc3fc55dbfa74e32f97608 2026-04-15 00:58:58,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,069 - lava_callback - DEBUG - Processing node 69dc3fc55dbfa74e32f97608: baseline-arm64-baylibre 2026-04-15 00:58:58,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc55dbfa74e32f97608 2026-04-15 00:58:58,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:58,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc55dbfa74e32f97608 HTTP/1.1" 200 None 2026-04-15 00:58:58,117 - lava_callback - ERROR - Error processing callback for node 69dc3fc55dbfa74e32f97608: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:58,695 - lava_callback - INFO - Received callback for node 69dc3fc75dbfa74e32f97629 INFO: 172.21.0.1:44026 - "POST /node/69dc3fc75dbfa74e32f97629 HTTP/1.0" 202 Accepted 2026-04-15 00:58:58,700 - lava_callback - INFO - Starting async job submit for node 69dc3fc75dbfa74e32f97629 2026-04-15 00:58:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,716 - lava_callback - DEBUG - Processing node 69dc3fc75dbfa74e32f97629: baseline-arm64-baylibre 2026-04-15 00:58:58,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fc75dbfa74e32f97629 2026-04-15 00:58:58,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:58:58,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:58,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fc75dbfa74e32f97629 HTTP/1.1" 200 None 2026-04-15 00:58:58,764 - lava_callback - ERROR - Error processing callback for node 69dc3fc75dbfa74e32f97629: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:58:59,361 - lava_callback - INFO - Received callback for node 69dc3fcc5dbfa74e32f97637 INFO: 172.21.0.1:44032 - "POST /node/69dc3fcc5dbfa74e32f97637 HTTP/1.0" 202 Accepted 2026-04-15 00:58:59,367 - lava_callback - INFO - Starting async job submit for node 69dc3fcc5dbfa74e32f97637 2026-04-15 00:58:59,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,383 - lava_callback - DEBUG - Processing node 69dc3fcc5dbfa74e32f97637: baseline-arm64-baylibre 2026-04-15 00:58:59,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fcc5dbfa74e32f97637 2026-04-15 00:58:59,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 00:58:59,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:58:59,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fcc5dbfa74e32f97637 HTTP/1.1" 200 None 2026-04-15 00:58:59,430 - lava_callback - ERROR - Error processing callback for node 69dc3fcc5dbfa74e32f97637: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:06,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:06,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:07,909 - lava_callback - INFO - Received callback for node 69dc3fd85dbfa74e32f97658 INFO: 172.21.0.1:42570 - "POST /node/69dc3fd85dbfa74e32f97658 HTTP/1.0" 202 Accepted 2026-04-15 00:59:07,915 - lava_callback - INFO - Starting async job submit for node 69dc3fd85dbfa74e32f97658 2026-04-15 00:59:07,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,933 - lava_callback - DEBUG - Processing node 69dc3fd85dbfa74e32f97658: baseline-arm64-clabbe 2026-04-15 00:59:07,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fd85dbfa74e32f97658 2026-04-15 00:59:07,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:07,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fd85dbfa74e32f97658 HTTP/1.1" 200 None 2026-04-15 00:59:07,983 - lava_callback - ERROR - Error processing callback for node 69dc3fd85dbfa74e32f97658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:27,881 - lava_callback - INFO - Received callback for node 69dc3fda5dbfa74e32f9765f INFO: 172.21.0.1:35842 - "POST /node/69dc3fda5dbfa74e32f9765f HTTP/1.0" 202 Accepted 2026-04-15 00:59:27,887 - lava_callback - INFO - Starting async job submit for node 69dc3fda5dbfa74e32f9765f 2026-04-15 00:59:27,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,903 - lava_callback - DEBUG - Processing node 69dc3fda5dbfa74e32f9765f: baseline-arm64-clabbe 2026-04-15 00:59:27,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fda5dbfa74e32f9765f 2026-04-15 00:59:27,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:27,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:27,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fda5dbfa74e32f9765f HTTP/1.1" 200 None 2026-04-15 00:59:27,951 - lava_callback - ERROR - Error processing callback for node 69dc3fda5dbfa74e32f9765f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:28,570 - lava_callback - INFO - Received callback for node 69dc3fdb5dbfa74e32f97662 INFO: 172.21.0.1:35854 - "POST /node/69dc3fdb5dbfa74e32f97662 HTTP/1.0" 202 Accepted 2026-04-15 00:59:28,576 - lava_callback - INFO - Starting async job submit for node 69dc3fdb5dbfa74e32f97662 2026-04-15 00:59:28,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,592 - lava_callback - DEBUG - Processing node 69dc3fdb5dbfa74e32f97662: baseline-arm64-clabbe 2026-04-15 00:59:28,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdb5dbfa74e32f97662 2026-04-15 00:59:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:28,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdb5dbfa74e32f97662 HTTP/1.1" 200 None 2026-04-15 00:59:28,642 - lava_callback - ERROR - Error processing callback for node 69dc3fdb5dbfa74e32f97662: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:29,230 - lava_callback - INFO - Received callback for node 69dc3fdc5dbfa74e32f97665 INFO: 172.21.0.1:35870 - "POST /node/69dc3fdc5dbfa74e32f97665 HTTP/1.0" 202 Accepted 2026-04-15 00:59:29,237 - lava_callback - INFO - Starting async job submit for node 69dc3fdc5dbfa74e32f97665 2026-04-15 00:59:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,252 - lava_callback - DEBUG - Processing node 69dc3fdc5dbfa74e32f97665: baseline-arm64-clabbe 2026-04-15 00:59:29,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdc5dbfa74e32f97665 2026-04-15 00:59:29,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:29,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdc5dbfa74e32f97665 HTTP/1.1" 200 None 2026-04-15 00:59:29,308 - lava_callback - ERROR - Error processing callback for node 69dc3fdc5dbfa74e32f97665: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:29,918 - lava_callback - INFO - Received callback for node 69dc3fdd5dbfa74e32f97668 INFO: 172.21.0.1:42224 - "POST /node/69dc3fdd5dbfa74e32f97668 HTTP/1.0" 202 Accepted 2026-04-15 00:59:29,924 - lava_callback - INFO - Starting async job submit for node 69dc3fdd5dbfa74e32f97668 2026-04-15 00:59:29,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,940 - lava_callback - DEBUG - Processing node 69dc3fdd5dbfa74e32f97668: baseline-arm64-clabbe 2026-04-15 00:59:29,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdd5dbfa74e32f97668 2026-04-15 00:59:29,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdd5dbfa74e32f97668 HTTP/1.1" 200 None 2026-04-15 00:59:29,989 - lava_callback - ERROR - Error processing callback for node 69dc3fdd5dbfa74e32f97668: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:30,599 - lava_callback - INFO - Received callback for node 69dc3fdf5dbfa74e32f9766e INFO: 172.21.0.1:42234 - "POST /node/69dc3fdf5dbfa74e32f9766e HTTP/1.0" 202 Accepted 2026-04-15 00:59:30,605 - lava_callback - INFO - Starting async job submit for node 69dc3fdf5dbfa74e32f9766e 2026-04-15 00:59:30,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,621 - lava_callback - DEBUG - Processing node 69dc3fdf5dbfa74e32f9766e: baseline-arm64-clabbe 2026-04-15 00:59:30,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fdf5dbfa74e32f9766e 2026-04-15 00:59:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:30,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:30,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fdf5dbfa74e32f9766e HTTP/1.1" 200 None 2026-04-15 00:59:30,671 - lava_callback - ERROR - Error processing callback for node 69dc3fdf5dbfa74e32f9766e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 00:59:31,261 - lava_callback - INFO - Received callback for node 69dc3fde5dbfa74e32f9766b INFO: 172.21.0.1:42236 - "POST /node/69dc3fde5dbfa74e32f9766b HTTP/1.0" 202 Accepted 2026-04-15 00:59:31,270 - lava_callback - INFO - Starting async job submit for node 69dc3fde5dbfa74e32f9766b 2026-04-15 00:59:31,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,294 - lava_callback - DEBUG - Processing node 69dc3fde5dbfa74e32f9766b: baseline-arm64-clabbe 2026-04-15 00:59:31,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc3fde5dbfa74e32f9766b 2026-04-15 00:59:31,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 00:59:31,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:31,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc3fde5dbfa74e32f9766b HTTP/1.1" 200 None 2026-04-15 00:59:31,350 - lava_callback - ERROR - Error processing callback for node 69dc3fde5dbfa74e32f9766b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK 2026-04-15 00:59:46,841 - lava_callback - INFO - Received callback for node 69dedc0af490930782fb6e65 INFO: 172.21.0.1:33576 - "POST /node/69dedc0af490930782fb6e65 HTTP/1.0" 202 Accepted 2026-04-15 00:59:46,848 - lava_callback - INFO - Starting async job submit for node 69dedc0af490930782fb6e65 2026-04-15 00:59:46,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:46,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:46,927 - lava_callback - DEBUG - Processing node 69dedc0af490930782fb6e65: ltp-smoke 2026-04-15 00:59:47,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:47,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:47,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/log.txt.gz 2026-04-15 00:59:47,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:48,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:48,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/lava-logs.yaml 2026-04-15 00:59:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 00:59:48,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 00:59:48,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69dedc0af490930782fb6e65/lava_callback.json.gz 2026-04-15 00:59:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:48,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 00:59:48,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 00:59:48,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedc0af490930782fb6e65 HTTP/1.1" 200 None 2026-04-15 00:59:48,538 - lava_callback - INFO - Completed processing callback for node 69dedc0af490930782fb6e65 INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:00:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:06,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:00:15,397 - lava_callback - INFO - Received callback for node 69dc400f5dbfa74e32f97780 INFO: 172.21.0.1:47286 - "POST /node/69dc400f5dbfa74e32f97780 HTTP/1.0" 202 Accepted 2026-04-15 01:00:15,402 - lava_callback - INFO - Starting async job submit for node 69dc400f5dbfa74e32f97780 2026-04-15 01:00:15,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,421 - lava_callback - DEBUG - Processing node 69dc400f5dbfa74e32f97780: baseline-arm64-baylibre 2026-04-15 01:00:15,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc400f5dbfa74e32f97780 2026-04-15 01:00:15,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:00:15,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:00:15,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc400f5dbfa74e32f97780 HTTP/1.1" 200 None 2026-04-15 01:00:15,476 - lava_callback - ERROR - Error processing callback for node 69dc400f5dbfa74e32f97780: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /node/693b870441fb4c9509766844%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:01:35,434 - lava_callback - INFO - Received callback for node 69dc40615dbfa74e32f9783c INFO: 172.21.0.1:46550 - "POST /node/69dc40615dbfa74e32f9783c HTTP/1.0" 202 Accepted 2026-04-15 01:01:35,440 - lava_callback - INFO - Starting async job submit for node 69dc40615dbfa74e32f9783c 2026-04-15 01:01:35,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,457 - lava_callback - DEBUG - Processing node 69dc40615dbfa74e32f9783c: baseline-arm64-baylibre 2026-04-15 01:01:35,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40615dbfa74e32f9783c 2026-04-15 01:01:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:01:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:01:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40615dbfa74e32f9783c HTTP/1.1" 200 None 2026-04-15 01:01:35,505 - lava_callback - ERROR - Error processing callback for node 69dc40615dbfa74e32f9783c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /node/6988c58d9fc35f969e1eead6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:02:55,548 - lava_callback - INFO - Received callback for node 69dc40ae5dbfa74e32f97871 INFO: 172.21.0.1:44592 - "POST /node/69dc40ae5dbfa74e32f97871 HTTP/1.0" 202 Accepted 2026-04-15 01:02:55,554 - lava_callback - INFO - Starting async job submit for node 69dc40ae5dbfa74e32f97871 2026-04-15 01:02:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,570 - lava_callback - DEBUG - Processing node 69dc40ae5dbfa74e32f97871: baseline-arm64-baylibre 2026-04-15 01:02:55,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40ae5dbfa74e32f97871 2026-04-15 01:02:55,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:02:55,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:02:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40ae5dbfa74e32f97871 HTTP/1.1" 200 None 2026-04-15 01:02:55,620 - lava_callback - ERROR - Error processing callback for node 69dc40ae5dbfa74e32f97871: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET /node/695405a99c6929bd9fb6f540%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:04:08,117 - lava_callback - INFO - Received callback for node 69dc40fc5dbfa74e32f978bd INFO: 172.21.0.1:60612 - "POST /node/69dc40fc5dbfa74e32f978bd HTTP/1.0" 202 Accepted 2026-04-15 01:04:08,123 - lava_callback - INFO - Starting async job submit for node 69dc40fc5dbfa74e32f978bd 2026-04-15 01:04:08,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,139 - lava_callback - DEBUG - Processing node 69dc40fc5dbfa74e32f978bd: baseline-arm64-clabbe 2026-04-15 01:04:08,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc40fc5dbfa74e32f978bd 2026-04-15 01:04:08,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:04:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc40fc5dbfa74e32f978bd HTTP/1.1" 200 None 2026-04-15 01:04:08,188 - lava_callback - ERROR - Error processing callback for node 69dc40fc5dbfa74e32f978bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:04:47,184 - lava_callback - INFO - Received callback for node 69dee344f490930782fb9e37 INFO: 172.21.0.1:48954 - "POST /node/69dee344f490930782fb9e37 HTTP/1.0" 202 Accepted 2026-04-15 01:04:47,190 - lava_callback - INFO - Starting async job submit for node 69dee344f490930782fb9e37 2026-04-15 01:04:47,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:47,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:47,231 - lava_callback - DEBUG - Processing node 69dee344f490930782fb9e37: ltp-cap_bounds 2026-04-15 01:04:47,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:47,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:47,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/log.txt.gz 2026-04-15 01:04:47,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:48,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:48,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/lava-logs.yaml 2026-04-15 01:04:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:04:48,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:04:48,324 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dee344f490930782fb9e37/lava_callback.json.gz 2026-04-15 01:04:48,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:48,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:04:48,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:04:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee344f490930782fb9e37 HTTP/1.1" 200 None 2026-04-15 01:04:48,415 - lava_callback - INFO - Completed processing callback for node 69dee344f490930782fb9e37 INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:06,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:06,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:08,126 - lava_callback - INFO - Received callback for node 69dc41415dbfa74e32f9790c INFO: 172.21.0.1:60640 - "POST /node/69dc41415dbfa74e32f9790c HTTP/1.0" 202 Accepted 2026-04-15 01:05:08,132 - lava_callback - INFO - Starting async job submit for node 69dc41415dbfa74e32f9790c 2026-04-15 01:05:08,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,148 - lava_callback - DEBUG - Processing node 69dc41415dbfa74e32f9790c: baseline-arm64-clabbe 2026-04-15 01:05:08,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41415dbfa74e32f9790c 2026-04-15 01:05:08,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:05:08,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:08,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41415dbfa74e32f9790c HTTP/1.1" 200 None 2026-04-15 01:05:08,197 - lava_callback - ERROR - Error processing callback for node 69dc41415dbfa74e32f9790c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET /node/698638c2177ca0f097bd2c2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:26,510 - lava_callback - INFO - Received callback for node 69dee361f490930782fb9e49 INFO: 172.21.0.1:53012 - "POST /node/69dee361f490930782fb9e49 HTTP/1.0" 202 Accepted 2026-04-15 01:05:26,516 - lava_callback - INFO - Starting async job submit for node 69dee361f490930782fb9e49 2026-04-15 01:05:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:26,557 - lava_callback - DEBUG - Processing node 69dee361f490930782fb9e49: ltp-containers INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:26,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/log.txt.gz 2026-04-15 01:05:27,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/lava-logs.yaml 2026-04-15 01:05:27,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:05:27,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:05:27,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69dee361f490930782fb9e49/lava_callback.json.gz 2026-04-15 01:05:27,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:27,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:27,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:27,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:05:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:28,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee361f490930782fb9e49 HTTP/1.1" 200 None 2026-04-15 01:05:28,017 - lava_callback - INFO - Completed processing callback for node 69dee361f490930782fb9e49 INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:05:36,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:05:36,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32906 - "GET /node/698bd97c1e517752bab8b685%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:26,543 - lava_callback - INFO - Received callback for node 69dee3aaf490930782fb9eaa INFO: 172.21.0.1:52346 - "POST /node/69dee3aaf490930782fb9eaa HTTP/1.0" 202 Accepted 2026-04-15 01:06:26,550 - lava_callback - INFO - Starting async job submit for node 69dee3aaf490930782fb9eaa INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:26,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:26,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:26,596 - lava_callback - DEBUG - Processing node 69dee3aaf490930782fb9eaa: ltp-input 2026-04-15 01:06:26,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/log.txt.gz 2026-04-15 01:06:27,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/lava-logs.yaml 2026-04-15 01:06:27,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:06:27,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:06:27,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69dee3aaf490930782fb9eaa/lava_callback.json.gz 2026-04-15 01:06:27,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:06:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee3aaf490930782fb9eaa HTTP/1.1" 200 None 2026-04-15 01:06:27,797 - lava_callback - INFO - Completed processing callback for node 69dee3aaf490930782fb9eaa 2026-04-15 01:06:28,398 - lava_callback - INFO - Received callback for node 69dc41885dbfa74e32f97963 INFO: 172.21.0.1:52370 - "POST /node/69dc41885dbfa74e32f97963 HTTP/1.0" 202 Accepted 2026-04-15 01:06:28,404 - lava_callback - INFO - Starting async job submit for node 69dc41885dbfa74e32f97963 2026-04-15 01:06:28,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,420 - lava_callback - DEBUG - Processing node 69dc41885dbfa74e32f97963: baseline-arm64-clabbe 2026-04-15 01:06:28,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41885dbfa74e32f97963 2026-04-15 01:06:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:06:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41885dbfa74e32f97963 HTTP/1.1" 200 None 2026-04-15 01:06:28,477 - lava_callback - ERROR - Error processing callback for node 69dc41885dbfa74e32f97963: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:06:36,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:06:36,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:07:28,233 - lava_callback - INFO - Received callback for node 69dc41c65dbfa74e32f979c6 INFO: 172.21.0.1:37242 - "POST /node/69dc41c65dbfa74e32f979c6 HTTP/1.0" 202 Accepted 2026-04-15 01:07:28,239 - lava_callback - INFO - Starting async job submit for node 69dc41c65dbfa74e32f979c6 2026-04-15 01:07:28,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,255 - lava_callback - DEBUG - Processing node 69dc41c65dbfa74e32f979c6: baseline-arm64-clabbe 2026-04-15 01:07:28,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc41c65dbfa74e32f979c6 2026-04-15 01:07:28,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:07:28,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:28,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc41c65dbfa74e32f979c6 HTTP/1.1" 200 None 2026-04-15 01:07:28,329 - lava_callback - ERROR - Error processing callback for node 69dc41c65dbfa74e32f979c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:07:46,629 - lava_callback - INFO - Received callback for node 69dee3cff490930782fb9ec0 INFO: 172.21.0.1:59680 - "POST /node/69dee3cff490930782fb9ec0 HTTP/1.0" 202 Accepted 2026-04-15 01:07:46,635 - lava_callback - INFO - Starting async job submit for node 69dee3cff490930782fb9ec0 2026-04-15 01:07:46,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:46,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:46,676 - lava_callback - DEBUG - Processing node 69dee3cff490930782fb9ec0: ltp-pty 2026-04-15 01:07:47,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/log.txt.gz 2026-04-15 01:07:47,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/lava-logs.yaml 2026-04-15 01:07:47,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:07:47,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:07:47,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69dee3cff490930782fb9ec0/lava_callback.json.gz 2026-04-15 01:07:47,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:47,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:07:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:07:47,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee3cff490930782fb9ec0 HTTP/1.1" 200 None 2026-04-15 01:07:47,922 - lava_callback - INFO - Completed processing callback for node 69dee3cff490930782fb9ec0 INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:08:06,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET /node/698fe75876d4b6342e9d9eb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:08:48,366 - lava_callback - INFO - Received callback for node 69dc420b5dbfa74e32f97a0f INFO: 172.21.0.1:39062 - "POST /node/69dc420b5dbfa74e32f97a0f HTTP/1.0" 202 Accepted 2026-04-15 01:08:48,372 - lava_callback - INFO - Starting async job submit for node 69dc420b5dbfa74e32f97a0f 2026-04-15 01:08:48,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,388 - lava_callback - DEBUG - Processing node 69dc420b5dbfa74e32f97a0f: baseline-arm64-clabbe 2026-04-15 01:08:48,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc420b5dbfa74e32f97a0f 2026-04-15 01:08:48,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:08:48,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc420b5dbfa74e32f97a0f HTTP/1.1" 200 None 2026-04-15 01:08:48,437 - lava_callback - ERROR - Error processing callback for node 69dc420b5dbfa74e32f97a0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 01:08:50,225 - lava_callback - INFO - Received callback for node 69dee51af490930782fba040 INFO: 172.21.0.1:53710 - "POST /node/69dee51af490930782fba040 HTTP/1.0" 202 Accepted 2026-04-15 01:08:50,231 - lava_callback - INFO - Starting async job submit for node 69dee51af490930782fba040 2026-04-15 01:08:50,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,249 - lava_callback - DEBUG - Processing node 69dee51af490930782fba040: baseline-arm 2026-04-15 01:08:50,254 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:08:50,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:08:50,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:08:50,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee51af490930782fba040/lava-logs.yaml 2026-04-15 01:08:50,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:08:50,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:08:50,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee51af490930782fba040/lava_callback.json.gz 2026-04-15 01:08:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:08:50,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:08:50,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee51af490930782fba040 HTTP/1.1" 200 None 2026-04-15 01:08:50,645 - lava_callback - INFO - Completed processing callback for node 69dee51af490930782fba040 INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:09:06,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:06,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:09:48,323 - lava_callback - INFO - Received callback for node 69dc42565dbfa74e32f97a3d INFO: 172.21.0.1:37956 - "POST /node/69dc42565dbfa74e32f97a3d HTTP/1.0" 202 Accepted 2026-04-15 01:09:48,329 - lava_callback - INFO - Starting async job submit for node 69dc42565dbfa74e32f97a3d 2026-04-15 01:09:48,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,345 - lava_callback - DEBUG - Processing node 69dc42565dbfa74e32f97a3d: baseline-arm64-clabbe 2026-04-15 01:09:48,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc42565dbfa74e32f97a3d 2026-04-15 01:09:48,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:09:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:09:48,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc42565dbfa74e32f97a3d HTTP/1.1" 200 None 2026-04-15 01:09:48,401 - lava_callback - ERROR - Error processing callback for node 69dc42565dbfa74e32f97a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /node/6986171c177ca0f097bd099e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:11:08,383 - lava_callback - INFO - Received callback for node 69dc42a05dbfa74e32f97a73 INFO: 172.21.0.1:32958 - "POST /node/69dc42a05dbfa74e32f97a73 HTTP/1.0" 202 Accepted 2026-04-15 01:11:08,389 - lava_callback - INFO - Starting async job submit for node 69dc42a05dbfa74e32f97a73 2026-04-15 01:11:08,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,405 - lava_callback - DEBUG - Processing node 69dc42a05dbfa74e32f97a73: baseline-arm64-clabbe 2026-04-15 01:11:08,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc42a05dbfa74e32f97a73 2026-04-15 01:11:08,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 01:11:08,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:11:08,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc42a05dbfa74e32f97a73 HTTP/1.1" 200 None 2026-04-15 01:11:08,454 - lava_callback - ERROR - Error processing callback for node 69dc42a05dbfa74e32f97a73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET /node/698b677b0a16aea5a0dc75a2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET /node/6987d593e31b58f834f1d3eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET /node/68535c9ad1c4bfd0940eefcf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:22:51,848 - lava_callback - INFO - Received callback for node 69dee83df490930782fba363 INFO: 172.21.0.1:43080 - "POST /node/69dee83df490930782fba363 HTTP/1.0" 202 Accepted 2026-04-15 01:22:51,855 - lava_callback - INFO - Starting async job submit for node 69dee83df490930782fba363 2026-04-15 01:22:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:51,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:51,891 - lava_callback - DEBUG - Processing node 69dee83df490930782fba363: baseline-arm64 2026-04-15 01:22:52,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/log.txt.gz 2026-04-15 01:22:52,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/lava-logs.yaml 2026-04-15 01:22:52,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:52,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:52,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83df490930782fba363/lava_callback.json.gz 2026-04-15 01:22:52,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:52,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:52,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:52,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee83df490930782fba363 HTTP/1.1" 200 None 2026-04-15 01:22:52,854 - lava_callback - INFO - Completed processing callback for node 69dee83df490930782fba363 2026-04-15 01:22:54,198 - lava_callback - INFO - Received callback for node 69dee84bf490930782fba384 INFO: 172.21.0.1:43096 - "POST /node/69dee84bf490930782fba384 HTTP/1.0" 202 Accepted 2026-04-15 01:22:54,210 - lava_callback - INFO - Starting async job submit for node 69dee84bf490930782fba384 2026-04-15 01:22:54,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:54,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:54,268 - lava_callback - DEBUG - Processing node 69dee84bf490930782fba384: baseline-arm64 2026-04-15 01:22:54,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:54,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:54,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/log.txt.gz 2026-04-15 01:22:54,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:54,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:54,818 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/lava-logs.yaml 2026-04-15 01:22:54,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:55,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:55,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84bf490930782fba384/lava_callback.json.gz 2026-04-15 01:22:55,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:55,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:55,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84bf490930782fba384 HTTP/1.1" 200 None 2026-04-15 01:22:55,106 - lava_callback - INFO - Completed processing callback for node 69dee84bf490930782fba384 INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:22:58,027 - lava_callback - INFO - Received callback for node 69dee85bf490930782fba3c1 INFO: 172.21.0.1:43108 - "POST /node/69dee85bf490930782fba3c1 HTTP/1.0" 202 Accepted 2026-04-15 01:22:58,033 - lava_callback - INFO - Starting async job submit for node 69dee85bf490930782fba3c1 2026-04-15 01:22:58,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,052 - lava_callback - DEBUG - Processing node 69dee85bf490930782fba3c1: baseline-nfs-arm64 2026-04-15 01:22:58,054 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:22:58,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:58,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:58,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85bf490930782fba3c1/lava-logs.yaml 2026-04-15 01:22:58,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:22:58,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:22:58,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85bf490930782fba3c1/lava_callback.json.gz 2026-04-15 01:22:58,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:22:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:22:58,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85bf490930782fba3c1 HTTP/1.1" 200 None 2026-04-15 01:22:58,424 - lava_callback - INFO - Completed processing callback for node 69dee85bf490930782fba3c1 INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:06,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:06,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:23:15,519 - lava_callback - INFO - Received callback for node 69dee840f490930782fba369 INFO: 172.21.0.1:53454 - "POST /node/69dee840f490930782fba369 HTTP/1.0" 202 Accepted 2026-04-15 01:23:15,525 - lava_callback - INFO - Starting async job submit for node 69dee840f490930782fba369 2026-04-15 01:23:15,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:15,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:15,568 - lava_callback - DEBUG - Processing node 69dee840f490930782fba369: baseline-arm64 2026-04-15 01:23:15,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/log.txt.gz 2026-04-15 01:23:16,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/lava-logs.yaml 2026-04-15 01:23:16,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:16,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:16,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee840f490930782fba369/lava_callback.json.gz INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:16,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:16,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee840f490930782fba369 HTTP/1.1" 200 None 2026-04-15 01:23:16,616 - lava_callback - INFO - Completed processing callback for node 69dee840f490930782fba369 INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:28,348 - lava_callback - INFO - Received callback for node 69dee84ff490930782fba38d INFO: 172.21.0.1:57344 - "POST /node/69dee84ff490930782fba38d HTTP/1.0" 202 Accepted 2026-04-15 01:23:28,354 - lava_callback - INFO - Starting async job submit for node 69dee84ff490930782fba38d 2026-04-15 01:23:28,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:28,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:28,392 - lava_callback - DEBUG - Processing node 69dee84ff490930782fba38d: baseline-arm64 2026-04-15 01:23:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:28,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:28,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/log.txt.gz 2026-04-15 01:23:29,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:29,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:29,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/lava-logs.yaml 2026-04-15 01:23:29,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:29,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:29,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ff490930782fba38d/lava_callback.json.gz 2026-04-15 01:23:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:29,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84ff490930782fba38d HTTP/1.1" 200 None 2026-04-15 01:23:29,523 - lava_callback - INFO - Completed processing callback for node 69dee84ff490930782fba38d 2026-04-15 01:23:31,050 - lava_callback - INFO - Received callback for node 69dee842f490930782fba36f INFO: 172.21.0.1:56302 - "POST /node/69dee842f490930782fba36f HTTP/1.0" 202 Accepted 2026-04-15 01:23:31,061 - lava_callback - INFO - Starting async job submit for node 69dee842f490930782fba36f 2026-04-15 01:23:31,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,137 - lava_callback - DEBUG - Processing node 69dee842f490930782fba36f: baseline-arm64 2026-04-15 01:23:31,301 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:23:31,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:31,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:31,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee842f490930782fba36f/lava-logs.yaml 2026-04-15 01:23:31,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:31,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:31,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee842f490930782fba36f/lava_callback.json.gz 2026-04-15 01:23:31,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:31,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:31,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee842f490930782fba36f HTTP/1.1" 200 None 2026-04-15 01:23:31,879 - lava_callback - INFO - Completed processing callback for node 69dee842f490930782fba36f 2026-04-15 01:23:35,047 - lava_callback - INFO - Received callback for node 69dee849f490930782fba37e INFO: 172.21.0.1:56304 - "POST /node/69dee849f490930782fba37e HTTP/1.0" 202 Accepted 2026-04-15 01:23:35,055 - lava_callback - INFO - Starting async job submit for node 69dee849f490930782fba37e 2026-04-15 01:23:35,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:35,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:35,108 - lava_callback - DEBUG - Processing node 69dee849f490930782fba37e: baseline-arm64 2026-04-15 01:23:35,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:35,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:35,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/log.txt.gz 2026-04-15 01:23:35,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:36,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:36,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/lava-logs.yaml 2026-04-15 01:23:36,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:36,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:36,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee849f490930782fba37e/lava_callback.json.gz 2026-04-15 01:23:36,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:36,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee849f490930782fba37e HTTP/1.1" 200 None 2026-04-15 01:23:36,279 - lava_callback - INFO - Completed processing callback for node 69dee849f490930782fba37e INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:36,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:36,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:23:38,989 - lava_callback - INFO - Received callback for node 69dee851f490930782fba390 INFO: 172.21.0.1:56328 - "POST /node/69dee851f490930782fba390 HTTP/1.0" 202 Accepted 2026-04-15 01:23:38,996 - lava_callback - INFO - Starting async job submit for node 69dee851f490930782fba390 2026-04-15 01:23:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:39,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:39,049 - lava_callback - DEBUG - Processing node 69dee851f490930782fba390: baseline-arm64 2026-04-15 01:23:39,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:39,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:39,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/log.txt.gz 2026-04-15 01:23:39,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:39,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:39,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/lava-logs.yaml 2026-04-15 01:23:39,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:40,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:40,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee851f490930782fba390/lava_callback.json.gz 2026-04-15 01:23:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:40,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:40,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee851f490930782fba390 HTTP/1.1" 200 None 2026-04-15 01:23:40,133 - lava_callback - INFO - Completed processing callback for node 69dee851f490930782fba390 2026-04-15 01:23:41,416 - lava_callback - INFO - Received callback for node 69dee83ff490930782fba366 INFO: 172.21.0.1:47518 - "POST /node/69dee83ff490930782fba366 HTTP/1.0" 202 Accepted 2026-04-15 01:23:41,422 - lava_callback - INFO - Starting async job submit for node 69dee83ff490930782fba366 2026-04-15 01:23:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:41,459 - lava_callback - DEBUG - Processing node 69dee83ff490930782fba366: baseline-arm64 2026-04-15 01:23:41,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:41,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:41,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/log.txt.gz 2026-04-15 01:23:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:42,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:42,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/lava-logs.yaml 2026-04-15 01:23:42,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:42,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:42,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee83ff490930782fba366/lava_callback.json.gz 2026-04-15 01:23:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:42,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:42,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee83ff490930782fba366 HTTP/1.1" 200 None 2026-04-15 01:23:42,319 - lava_callback - INFO - Completed processing callback for node 69dee83ff490930782fba366 INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:47,758 - lava_callback - INFO - Received callback for node 69dee84cf490930782fba387 INFO: 172.21.0.1:47526 - "POST /node/69dee84cf490930782fba387 HTTP/1.0" 202 Accepted 2026-04-15 01:23:47,764 - lava_callback - INFO - Starting async job submit for node 69dee84cf490930782fba387 2026-04-15 01:23:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:47,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:47,823 - lava_callback - DEBUG - Processing node 69dee84cf490930782fba387: baseline-arm64 2026-04-15 01:23:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/log.txt.gz 2026-04-15 01:23:48,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/lava-logs.yaml 2026-04-15 01:23:48,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:48,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:48,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84cf490930782fba387/lava_callback.json.gz 2026-04-15 01:23:48,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:48,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84cf490930782fba387 HTTP/1.1" 200 None 2026-04-15 01:23:48,939 - lava_callback - INFO - Completed processing callback for node 69dee84cf490930782fba387 2026-04-15 01:23:55,885 - lava_callback - INFO - Received callback for node 69dee848f490930782fba37b INFO: 172.21.0.1:51806 - "POST /node/69dee848f490930782fba37b HTTP/1.0" 202 Accepted 2026-04-15 01:23:55,891 - lava_callback - INFO - Starting async job submit for node 69dee848f490930782fba37b 2026-04-15 01:23:55,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:55,928 - lava_callback - DEBUG - Processing node 69dee848f490930782fba37b: baseline-arm64 2026-04-15 01:23:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:56,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:56,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/log.txt.gz INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:23:56,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:56,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:56,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/lava-logs.yaml 2026-04-15 01:23:56,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:23:57,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:23:57,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee848f490930782fba37b/lava_callback.json.gz 2026-04-15 01:23:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:23:57,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:23:57,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee848f490930782fba37b HTTP/1.1" 200 None 2026-04-15 01:23:57,097 - lava_callback - INFO - Completed processing callback for node 69dee848f490930782fba37b 2026-04-15 01:24:05,586 - lava_callback - INFO - Received callback for node 69dee85af490930782fba3be INFO: 172.21.0.1:58732 - "POST /node/69dee85af490930782fba3be HTTP/1.0" 202 Accepted 2026-04-15 01:24:05,598 - lava_callback - INFO - Starting async job submit for node 69dee85af490930782fba3be 2026-04-15 01:24:05,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:05,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:05,667 - lava_callback - DEBUG - Processing node 69dee85af490930782fba3be: baseline-nfs-arm64 2026-04-15 01:24:06,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:06,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:06,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/log.txt.gz INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:06,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:06,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:06,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:24:06,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:06,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/lava-logs.yaml 2026-04-15 01:24:06,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:07,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:07,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85af490930782fba3be/lava_callback.json.gz 2026-04-15 01:24:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:07,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:07,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85af490930782fba3be HTTP/1.1" 200 None 2026-04-15 01:24:07,086 - lava_callback - INFO - Completed processing callback for node 69dee85af490930782fba3be INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:08,657 - lava_callback - INFO - Received callback for node 69dee858f490930782fba3bb INFO: 172.21.0.1:58764 - "POST /node/69dee858f490930782fba3bb HTTP/1.0" 202 Accepted 2026-04-15 01:24:08,664 - lava_callback - INFO - Starting async job submit for node 69dee858f490930782fba3bb 2026-04-15 01:24:08,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:08,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:08,704 - lava_callback - DEBUG - Processing node 69dee858f490930782fba3bb: baseline-nfs-arm64 2026-04-15 01:24:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:09,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:09,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/log.txt.gz 2026-04-15 01:24:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:09,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:09,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/lava-logs.yaml 2026-04-15 01:24:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:10,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:10,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee858f490930782fba3bb/lava_callback.json.gz 2026-04-15 01:24:10,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:10,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee858f490930782fba3bb HTTP/1.1" 200 None 2026-04-15 01:24:10,165 - lava_callback - INFO - Completed processing callback for node 69dee858f490930782fba3bb 2026-04-15 01:24:10,713 - lava_callback - INFO - Received callback for node 69dee846f490930782fba378 INFO: 172.21.0.1:33088 - "POST /node/69dee846f490930782fba378 HTTP/1.0" 202 Accepted 2026-04-15 01:24:10,722 - lava_callback - INFO - Starting async job submit for node 69dee846f490930782fba378 2026-04-15 01:24:10,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:10,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:10,759 - lava_callback - DEBUG - Processing node 69dee846f490930782fba378: baseline-arm64 2026-04-15 01:24:11,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/log.txt.gz 2026-04-15 01:24:11,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/lava-logs.yaml 2026-04-15 01:24:11,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:11,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:11,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee846f490930782fba378/lava_callback.json.gz 2026-04-15 01:24:11,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:11,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:11,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:11,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee846f490930782fba378 HTTP/1.1" 200 None 2026-04-15 01:24:11,744 - lava_callback - INFO - Completed processing callback for node 69dee846f490930782fba378 INFO: 172.21.0.1:33090 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 01:24:15,589 - lava_callback - INFO - Received callback for node 69dee84af490930782fba381 INFO: 172.21.0.1:33094 - "POST /node/69dee84af490930782fba381 HTTP/1.0" 202 Accepted 2026-04-15 01:24:15,601 - lava_callback - INFO - Starting async job submit for node 69dee84af490930782fba381 2026-04-15 01:24:15,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:15,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:15,654 - lava_callback - DEBUG - Processing node 69dee84af490930782fba381: baseline-arm64 2026-04-15 01:24:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:16,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:16,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/log.txt.gz 2026-04-15 01:24:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:17,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:17,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/lava-logs.yaml 2026-04-15 01:24:17,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:17,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:17,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84af490930782fba381/lava_callback.json.gz 2026-04-15 01:24:17,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:17,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:17,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84af490930782fba381 HTTP/1.1" 200 None 2026-04-15 01:24:17,637 - lava_callback - INFO - Completed processing callback for node 69dee84af490930782fba381 INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:27,634 - lava_callback - INFO - Received callback for node 69dee85ff490930782fba3ca INFO: 172.21.0.1:58792 - "POST /node/69dee85ff490930782fba3ca HTTP/1.0" 202 Accepted 2026-04-15 01:24:27,645 - lava_callback - INFO - Starting async job submit for node 69dee85ff490930782fba3ca 2026-04-15 01:24:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:27,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:27,717 - lava_callback - DEBUG - Processing node 69dee85ff490930782fba3ca: baseline-nfs-arm64 2026-04-15 01:24:28,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:28,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:28,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/log.txt.gz 2026-04-15 01:24:29,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:29,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:29,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/lava-logs.yaml 2026-04-15 01:24:29,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:29,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:29,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85ff490930782fba3ca/lava_callback.json.gz 2026-04-15 01:24:29,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:29,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:29,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85ff490930782fba3ca HTTP/1.1" 200 None 2026-04-15 01:24:29,830 - lava_callback - INFO - Completed processing callback for node 69dee85ff490930782fba3ca INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:36,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:24:45,085 - lava_callback - INFO - Received callback for node 69dee860f490930782fba3cd INFO: 172.21.0.1:51796 - "POST /node/69dee860f490930782fba3cd HTTP/1.0" 202 Accepted 2026-04-15 01:24:45,096 - lava_callback - INFO - Starting async job submit for node 69dee860f490930782fba3cd 2026-04-15 01:24:45,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:45,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:45,146 - lava_callback - DEBUG - Processing node 69dee860f490930782fba3cd: baseline-nfs-arm64 2026-04-15 01:24:45,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:46,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:46,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/log.txt.gz 2026-04-15 01:24:46,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:24:46,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:46,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/lava-logs.yaml 2026-04-15 01:24:46,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:47,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:47,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee860f490930782fba3cd/lava_callback.json.gz 2026-04-15 01:24:47,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:47,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,122 - lava_callback - INFO - Received callback for node 69dee870f490930782fba423 INFO: 172.21.0.1:51806 - "POST /node/69dee870f490930782fba423 HTTP/1.0" 202 Accepted 2026-04-15 01:24:47,131 - lava_callback - INFO - Starting async job submit for node 69dee870f490930782fba423 2026-04-15 01:24:47,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee860f490930782fba3cd HTTP/1.1" 200 None 2026-04-15 01:24:47,177 - lava_callback - INFO - Completed processing callback for node 69dee860f490930782fba3cd 2026-04-15 01:24:47,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:47,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:47,255 - lava_callback - DEBUG - Processing node 69dee870f490930782fba423: baseline-arm64-broonie 2026-04-15 01:24:47,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:47,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:47,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/log.txt.gz 2026-04-15 01:24:48,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,198 - lava_callback - INFO - Received callback for node 69dee874f490930782fba42e INFO: 172.21.0.1:51820 - "POST /node/69dee874f490930782fba42e HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,213 - lava_callback - INFO - Starting async job submit for node 69dee874f490930782fba42e 2026-04-15 01:24:48,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:48,314 - lava_callback - DEBUG - Processing node 69dee874f490930782fba42e: baseline-arm64-broonie 2026-04-15 01:24:48,548 - lava_callback - INFO - Received callback for node 69dee8abf490930782fba49a 2026-04-15 01:24:48,570 - lava_callback - INFO - Starting async job submit for node 69dee8abf490930782fba49a INFO: 172.21.0.1:51828 - "POST /node/69dee8abf490930782fba49a HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,608 - lava_callback - INFO - Received callback for node 69dee872f490930782fba426 2026-04-15 01:24:48,630 - lava_callback - INFO - Starting async job submit for node 69dee872f490930782fba426 INFO: 172.21.0.1:51830 - "POST /node/69dee872f490930782fba426 HTTP/1.0" 202 Accepted 2026-04-15 01:24:48,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:48,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:48,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/lava-logs.yaml 2026-04-15 01:24:48,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:48,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:48,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:48,812 - lava_callback - DEBUG - Processing node 69dee872f490930782fba426: baseline-arm64-broonie 2026-04-15 01:24:48,818 - lava_callback - DEBUG - Processing node 69dee8abf490930782fba49a: baseline-arm64-kontron 2026-04-15 01:24:49,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:49,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/log.txt.gz 2026-04-15 01:24:49,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:49,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee870f490930782fba423/lava_callback.json.gz 2026-04-15 01:24:49,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:49,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:49,803 - lava_callback - INFO - Received callback for node 69dee8acf490930782fba4c0 2026-04-15 01:24:49,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,851 - lava_callback - INFO - Starting async job submit for node 69dee8acf490930782fba4c0 INFO: 172.21.0.1:44600 - "POST /node/69dee8acf490930782fba4c0 HTTP/1.0" 202 Accepted 2026-04-15 01:24:49,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:49,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee870f490930782fba423 HTTP/1.1" 200 None 2026-04-15 01:24:49,962 - lava_callback - INFO - Completed processing callback for node 69dee870f490930782fba423 2026-04-15 01:24:49,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:49,970 - lava_callback - DEBUG - Processing node 69dee8acf490930782fba4c0: baseline-arm64-kontron 2026-04-15 01:24:50,103 - lava_callback - INFO - Received callback for node 69dee878f490930782fba434 INFO: 172.21.0.1:44608 - "POST /node/69dee878f490930782fba434 HTTP/1.0" 202 Accepted 2026-04-15 01:24:50,145 - lava_callback - INFO - Starting async job submit for node 69dee878f490930782fba434 2026-04-15 01:24:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:50,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:50,269 - lava_callback - DEBUG - Processing node 69dee878f490930782fba434: baseline-arm64-broonie 2026-04-15 01:24:50,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/log.txt.gz 2026-04-15 01:24:50,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/log.txt.gz 2026-04-15 01:24:50,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:50,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/lava-logs.yaml 2026-04-15 01:24:51,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:51,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee874f490930782fba42e/lava_callback.json.gz 2026-04-15 01:24:51,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:51,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:51,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/log.txt.gz 2026-04-15 01:24:51,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:51,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:51,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:52,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:52,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee874f490930782fba42e HTTP/1.1" 200 None 2026-04-15 01:24:52,095 - lava_callback - INFO - Completed processing callback for node 69dee874f490930782fba42e 2026-04-15 01:24:52,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/lava-logs.yaml 2026-04-15 01:24:52,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/log.txt.gz 2026-04-15 01:24:52,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/lava-logs.yaml 2026-04-15 01:24:52,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:52,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:52,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/lava-logs.yaml 2026-04-15 01:24:53,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee872f490930782fba426/lava_callback.json.gz 2026-04-15 01:24:53,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:53,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee872f490930782fba426 HTTP/1.1" 200 None 2026-04-15 01:24:53,212 - lava_callback - INFO - Completed processing callback for node 69dee872f490930782fba426 2026-04-15 01:24:53,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8abf490930782fba49a/lava_callback.json.gz 2026-04-15 01:24:53,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:53,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dee8acf490930782fba4c0/lava_callback.json.gz 2026-04-15 01:24:53,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:53,796 - lava_callback - INFO - Received callback for node 69dee844f490930782fba372 2026-04-15 01:24:53,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44612 - "POST /node/69dee844f490930782fba372 HTTP/1.0" 202 Accepted 2026-04-15 01:24:53,833 - lava_callback - INFO - Starting async job submit for node 69dee844f490930782fba372 2026-04-15 01:24:53,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:53,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/lava-logs.yaml 2026-04-15 01:24:53,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:53,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8abf490930782fba49a HTTP/1.1" 200 None 2026-04-15 01:24:53,920 - lava_callback - INFO - Completed processing callback for node 69dee8abf490930782fba49a 2026-04-15 01:24:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:53,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:53,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:53,971 - lava_callback - DEBUG - Processing node 69dee844f490930782fba372: baseline-arm64 2026-04-15 01:24:54,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:54,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8acf490930782fba4c0 HTTP/1.1" 200 None 2026-04-15 01:24:54,143 - lava_callback - INFO - Completed processing callback for node 69dee8acf490930782fba4c0 2026-04-15 01:24:54,536 - lava_callback - WARNING - Failed to upload log 2026-04-15 01:24:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:54,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:54,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee878f490930782fba434/lava_callback.json.gz 2026-04-15 01:24:54,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:54,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee878f490930782fba434 HTTP/1.1" 200 None 2026-04-15 01:24:54,888 - lava_callback - INFO - Completed processing callback for node 69dee878f490930782fba434 2026-04-15 01:24:55,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:55,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee844f490930782fba372/lava-logs.yaml 2026-04-15 01:24:55,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:24:55,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:24:55,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee844f490930782fba372/lava_callback.json.gz 2026-04-15 01:24:55,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:24:55,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:24:55,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee844f490930782fba372 HTTP/1.1" 200 None 2026-04-15 01:24:55,429 - lava_callback - INFO - Completed processing callback for node 69dee844f490930782fba372 INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:01,001 - lava_callback - INFO - Received callback for node 69dee8adf490930782fba4c7 INFO: 172.21.0.1:49866 - "POST /node/69dee8adf490930782fba4c7 HTTP/1.0" 202 Accepted 2026-04-15 01:25:01,007 - lava_callback - INFO - Starting async job submit for node 69dee8adf490930782fba4c7 2026-04-15 01:25:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:01,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:01,044 - lava_callback - DEBUG - Processing node 69dee8adf490930782fba4c7: baseline-arm64-pengutronix 2026-04-15 01:25:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:01,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:01,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/log.txt.gz 2026-04-15 01:25:01,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:02,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:02,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/lava-logs.yaml 2026-04-15 01:25:02,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:02,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:02,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8adf490930782fba4c7/lava_callback.json.gz 2026-04-15 01:25:02,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:02,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:02,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:02,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8adf490930782fba4c7 HTTP/1.1" 200 None 2026-04-15 01:25:02,414 - lava_callback - INFO - Completed processing callback for node 69dee8adf490930782fba4c7 INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:06,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:25:07,117 - lava_callback - INFO - Received callback for node 69dee876f490930782fba431 INFO: 172.21.0.1:49894 - "POST /node/69dee876f490930782fba431 HTTP/1.0" 202 Accepted 2026-04-15 01:25:07,124 - lava_callback - INFO - Starting async job submit for node 69dee876f490930782fba431 2026-04-15 01:25:07,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:07,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:07,169 - lava_callback - DEBUG - Processing node 69dee876f490930782fba431: baseline-arm64-broonie 2026-04-15 01:25:07,321 - lava_callback - INFO - Received callback for node 69dee879f490930782fba437 INFO: 172.21.0.1:49898 - "POST /node/69dee879f490930782fba437 HTTP/1.0" 202 Accepted 2026-04-15 01:25:07,336 - lava_callback - INFO - Starting async job submit for node 69dee879f490930782fba437 2026-04-15 01:25:07,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:07,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:07,491 - lava_callback - DEBUG - Processing node 69dee879f490930782fba437: baseline-arm64-broonie 2026-04-15 01:25:07,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:08,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/log.txt.gz 2026-04-15 01:25:08,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:08,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/log.txt.gz 2026-04-15 01:25:08,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:08,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/lava-logs.yaml 2026-04-15 01:25:09,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/lava-logs.yaml 2026-04-15 01:25:09,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:09,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee876f490930782fba431/lava_callback.json.gz 2026-04-15 01:25:09,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:09,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee879f490930782fba437/lava_callback.json.gz 2026-04-15 01:25:09,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:09,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:09,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:09,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee876f490930782fba431 HTTP/1.1" 200 None 2026-04-15 01:25:09,513 - lava_callback - INFO - Completed processing callback for node 69dee876f490930782fba431 2026-04-15 01:25:09,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee879f490930782fba437 HTTP/1.1" 200 None 2026-04-15 01:25:09,557 - lava_callback - INFO - Completed processing callback for node 69dee879f490930782fba437 2026-04-15 01:25:09,859 - lava_callback - INFO - Received callback for node 69dee8b1f490930782fba4d0 INFO: 172.21.0.1:47550 - "POST /node/69dee8b1f490930782fba4d0 HTTP/1.0" 202 Accepted 2026-04-15 01:25:09,872 - lava_callback - INFO - Starting async job submit for node 69dee8b1f490930782fba4d0 2026-04-15 01:25:09,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:09,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:09,958 - lava_callback - DEBUG - Processing node 69dee8b1f490930782fba4d0: baseline-arm64-foundriesio 2026-04-15 01:25:10,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:10,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:10,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/log.txt.gz 2026-04-15 01:25:10,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:10,653 - lava_callback - INFO - Received callback for node 69dee8aef490930782fba4ca INFO: 172.21.0.1:47558 - "POST /node/69dee8aef490930782fba4ca HTTP/1.0" 202 Accepted 2026-04-15 01:25:10,670 - lava_callback - INFO - Starting async job submit for node 69dee8aef490930782fba4ca 2026-04-15 01:25:10,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:10,739 - lava_callback - DEBUG - Processing node 69dee8aef490930782fba4ca: baseline-arm64-pengutronix 2026-04-15 01:25:11,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/lava-logs.yaml 2026-04-15 01:25:11,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/log.txt.gz 2026-04-15 01:25:11,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:11,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d0/lava_callback.json.gz 2026-04-15 01:25:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:11,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:11,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:11,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b1f490930782fba4d0 HTTP/1.1" 200 None 2026-04-15 01:25:11,953 - lava_callback - INFO - Completed processing callback for node 69dee8b1f490930782fba4d0 2026-04-15 01:25:12,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:12,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/lava-logs.yaml 2026-04-15 01:25:12,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:12,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:12,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8aef490930782fba4ca/lava_callback.json.gz 2026-04-15 01:25:12,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:12,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:12,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8aef490930782fba4ca HTTP/1.1" 200 None 2026-04-15 01:25:12,585 - lava_callback - INFO - Completed processing callback for node 69dee8aef490930782fba4ca INFO: 172.21.0.1:47570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:18,492 - lava_callback - INFO - Received callback for node 69dee84ef490930782fba38a INFO: 172.21.0.1:47580 - "POST /node/69dee84ef490930782fba38a HTTP/1.0" 202 Accepted 2026-04-15 01:25:18,504 - lava_callback - INFO - Starting async job submit for node 69dee84ef490930782fba38a 2026-04-15 01:25:18,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:18,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:18,577 - lava_callback - DEBUG - Processing node 69dee84ef490930782fba38a: baseline-arm64 2026-04-15 01:25:18,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:18,998 - lava_callback - INFO - Received callback for node 69dee8b0f490930782fba4cd INFO: 172.21.0.1:47594 - "POST /node/69dee8b0f490930782fba4cd HTTP/1.0" 202 Accepted 2026-04-15 01:25:19,008 - lava_callback - INFO - Starting async job submit for node 69dee8b0f490930782fba4cd 2026-04-15 01:25:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:19,046 - lava_callback - DEBUG - Processing node 69dee8b0f490930782fba4cd: baseline-arm64-pengutronix 2026-04-15 01:25:19,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/log.txt.gz 2026-04-15 01:25:19,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/log.txt.gz 2026-04-15 01:25:19,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:19,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/lava-logs.yaml 2026-04-15 01:25:19,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:19,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:20,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee84ef490930782fba38a/lava_callback.json.gz 2026-04-15 01:25:20,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/lava-logs.yaml 2026-04-15 01:25:20,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:20,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee84ef490930782fba38a HTTP/1.1" 200 None 2026-04-15 01:25:20,495 - lava_callback - INFO - Completed processing callback for node 69dee84ef490930782fba38a 2026-04-15 01:25:20,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:20,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dee8b0f490930782fba4cd/lava_callback.json.gz 2026-04-15 01:25:20,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:20,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:20,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:20,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b0f490930782fba4cd HTTP/1.1" 200 None 2026-04-15 01:25:20,749 - lava_callback - INFO - Completed processing callback for node 69dee8b0f490930782fba4cd INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:29,038 - lava_callback - INFO - Received callback for node 69dee86ef490930782fba3ed INFO: 172.21.0.1:42606 - "POST /node/69dee86ef490930782fba3ed HTTP/1.0" 202 Accepted 2026-04-15 01:25:29,048 - lava_callback - INFO - Starting async job submit for node 69dee86ef490930782fba3ed 2026-04-15 01:25:29,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:29,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:29,146 - lava_callback - DEBUG - Processing node 69dee86ef490930782fba3ed: baseline-arm64-broonie 2026-04-15 01:25:29,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:29,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:29,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/log.txt.gz 2026-04-15 01:25:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:30,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:30,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/lava-logs.yaml 2026-04-15 01:25:30,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:30,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:30,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86ef490930782fba3ed/lava_callback.json.gz 2026-04-15 01:25:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:30,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:30,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:30,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee86ef490930782fba3ed HTTP/1.1" 200 None 2026-04-15 01:25:30,480 - lava_callback - INFO - Completed processing callback for node 69dee86ef490930782fba3ed INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:25:36,652 - lava_callback - INFO - Received callback for node 69dee85cf490930782fba3c4 INFO: 172.21.0.1:49682 - "POST /node/69dee85cf490930782fba3c4 HTTP/1.0" 202 Accepted 2026-04-15 01:25:36,659 - lava_callback - INFO - Starting async job submit for node 69dee85cf490930782fba3c4 2026-04-15 01:25:36,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:36,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:36,703 - lava_callback - DEBUG - Processing node 69dee85cf490930782fba3c4: baseline-nfs-arm64 2026-04-15 01:25:36,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 01:25:37,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:37,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:37,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/log.txt.gz 2026-04-15 01:25:37,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:38,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:38,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/lava-logs.yaml 2026-04-15 01:25:38,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:25:38,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:25:38,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85cf490930782fba3c4/lava_callback.json.gz 2026-04-15 01:25:38,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:25:38,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:25:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85cf490930782fba3c4 HTTP/1.1" 200 None 2026-04-15 01:25:38,251 - lava_callback - INFO - Completed processing callback for node 69dee85cf490930782fba3c4 INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:07,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:30,101 - lava_callback - INFO - Received callback for node 69dee856f490930782fba3b5 INFO: 172.21.0.1:35574 - "POST /node/69dee856f490930782fba3b5 HTTP/1.0" 202 Accepted 2026-04-15 01:26:30,107 - lava_callback - INFO - Starting async job submit for node 69dee856f490930782fba3b5 2026-04-15 01:26:30,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:30,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:30,150 - lava_callback - DEBUG - Processing node 69dee856f490930782fba3b5: baseline-nfs-arm64 2026-04-15 01:26:30,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:30,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:30,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/log.txt.gz 2026-04-15 01:26:30,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:31,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:31,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/lava-logs.yaml 2026-04-15 01:26:31,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:31,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:31,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee856f490930782fba3b5/lava_callback.json.gz 2026-04-15 01:26:31,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:26:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee856f490930782fba3b5 HTTP/1.1" 200 None 2026-04-15 01:26:31,521 - lava_callback - INFO - Completed processing callback for node 69dee856f490930782fba3b5 INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:37,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:37,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:26:49,601 - lava_callback - INFO - Received callback for node 69dee873f490930782fba42b INFO: 172.21.0.1:58270 - "POST /node/69dee873f490930782fba42b HTTP/1.0" 202 Accepted 2026-04-15 01:26:49,607 - lava_callback - INFO - Starting async job submit for node 69dee873f490930782fba42b 2026-04-15 01:26:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:49,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:49,656 - lava_callback - DEBUG - Processing node 69dee873f490930782fba42b: baseline-arm64-broonie 2026-04-15 01:26:49,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/log.txt.gz 2026-04-15 01:26:50,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/lava-logs.yaml 2026-04-15 01:26:50,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:26:50,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:26:50,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee873f490930782fba42b/lava_callback.json.gz 2026-04-15 01:26:50,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:50,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:26:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:26:50,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee873f490930782fba42b HTTP/1.1" 200 None 2026-04-15 01:26:50,654 - lava_callback - INFO - Completed processing callback for node 69dee873f490930782fba42b INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:07,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:09,593 - lava_callback - INFO - Received callback for node 69dee8b1f490930782fba4d3 INFO: 172.21.0.1:50492 - "POST /node/69dee8b1f490930782fba4d3 HTTP/1.0" 202 Accepted 2026-04-15 01:27:09,603 - lava_callback - INFO - Starting async job submit for node 69dee8b1f490930782fba4d3 2026-04-15 01:27:09,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:09,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:09,678 - lava_callback - DEBUG - Processing node 69dee8b1f490930782fba4d3: baseline-arm64-foundriesio 2026-04-15 01:27:10,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:10,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:10,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/log.txt.gz 2026-04-15 01:27:11,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:11,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:11,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/lava-logs.yaml 2026-04-15 01:27:11,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:27:11,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:27:11,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dee8b1f490930782fba4d3/lava_callback.json.gz DEBUG: 69dee8b1f490930782fba4d3 Transitting job node result: pass -> incomplete 2026-04-15 01:27:11,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:11,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:27:11,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:11,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee8b1f490930782fba4d3 HTTP/1.1" 200 None 2026-04-15 01:27:11,570 - lava_callback - INFO - Completed processing callback for node 69dee8b1f490930782fba4d3 INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:27:37,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:27:37,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:25,499 - lava_callback - INFO - Received callback for node 69dee5dcf490930782fba0f1 INFO: 172.21.0.1:52624 - "POST /node/69dee5dcf490930782fba0f1 HTTP/1.0" 202 Accepted 2026-04-15 01:29:25,506 - lava_callback - INFO - Starting async job submit for node 69dee5dcf490930782fba0f1 2026-04-15 01:29:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:25,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:25,576 - lava_callback - DEBUG - Processing node 69dee5dcf490930782fba0f1: baseline-arm 2026-04-15 01:29:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:26,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:26,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/log.txt.gz INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:26,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:26,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:26,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/lava-logs.yaml 2026-04-15 01:29:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:29:27,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:29:27,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dee5dcf490930782fba0f1/lava_callback.json.gz DEBUG: Setup failed for 69dee5dcf490930782fba0f1. Transitting job node result: incomplete -> fail 2026-04-15 01:29:27,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:27,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 01:29:27,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:27,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee5dcf490930782fba0f1 HTTP/1.1" 200 None 2026-04-15 01:29:27,468 - lava_callback - INFO - Completed processing callback for node 69dee5dcf490930782fba0f1 INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:29:37,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:29:37,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:30:02,332 - lava_callback - INFO - Received callback for node 69dee852f490930782fba3ac INFO: 172.21.0.1:53566 - "POST /node/69dee852f490930782fba3ac HTTP/1.0" 202 Accepted 2026-04-15 01:30:02,340 - lava_callback - INFO - Starting async job submit for node 69dee852f490930782fba3ac 2026-04-15 01:30:02,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:02,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:02,394 - lava_callback - DEBUG - Processing node 69dee852f490930782fba3ac: baseline-arm64 2026-04-15 01:30:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/log.txt.gz 2026-04-15 01:30:03,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/lava-logs.yaml 2026-04-15 01:30:03,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:30:03,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:30:03,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee852f490930782fba3ac/lava_callback.json.gz DEBUG: Setup failed for 69dee852f490930782fba3ac. Transitting job node result: incomplete -> fail 2026-04-15 01:30:03,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:03,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:30:03,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:03,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee852f490930782fba3ac HTTP/1.1" 200 None 2026-04-15 01:30:03,906 - lava_callback - INFO - Completed processing callback for node 69dee852f490930782fba3ac INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:30:07,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:30:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:32:12,222 - lava_callback - INFO - Received callback for node 69dee5d8f490930782fba0e8 INFO: 172.21.0.1:51644 - "POST /node/69dee5d8f490930782fba0e8 HTTP/1.0" 202 Accepted 2026-04-15 01:32:12,228 - lava_callback - INFO - Starting async job submit for node 69dee5d8f490930782fba0e8 2026-04-15 01:32:12,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:12,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:12,282 - lava_callback - DEBUG - Processing node 69dee5d8f490930782fba0e8: baseline-x86 2026-04-15 01:32:12,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/log.txt.gz 2026-04-15 01:32:13,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,560 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/lava-logs.yaml 2026-04-15 01:32:13,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:32:13,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:32:13,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dee5d8f490930782fba0e8/lava_callback.json.gz DEBUG: Setup failed for 69dee5d8f490930782fba0e8. Transitting job node result: incomplete -> fail 2026-04-15 01:32:13,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 01:32:13,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:13,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee5d8f490930782fba0e8 HTTP/1.1" 200 None 2026-04-15 01:32:13,930 - lava_callback - INFO - Completed processing callback for node 69dee5d8f490930782fba0e8 INFO: 172.21.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:32:37,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:32:37,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:33:28,567 - lava_callback - INFO - Received callback for node 69dee845f490930782fba375 INFO: 172.21.0.1:58756 - "POST /node/69dee845f490930782fba375 HTTP/1.0" 202 Accepted 2026-04-15 01:33:28,573 - lava_callback - INFO - Starting async job submit for node 69dee845f490930782fba375 2026-04-15 01:33:28,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:28,607 - lava_callback - DEBUG - Processing node 69dee845f490930782fba375: baseline-arm64 2026-04-15 01:33:28,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/log.txt.gz 2026-04-15 01:33:29,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/lava-logs.yaml 2026-04-15 01:33:29,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:33:29,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:33:29,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee845f490930782fba375/lava_callback.json.gz 2026-04-15 01:33:29,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:29,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:33:29,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:29,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee845f490930782fba375 HTTP/1.1" 200 None 2026-04-15 01:33:29,836 - lava_callback - INFO - Completed processing callback for node 69dee845f490930782fba375 INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:33:37,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 01:33:37,237 - lava_callback - INFO - Received callback for node 69dc47e25dbfa74e32f97ffc INFO: 172.21.0.1:36160 - "POST /node/69dc47e25dbfa74e32f97ffc HTTP/1.0" 202 Accepted 2026-04-15 01:33:37,242 - lava_callback - INFO - Starting async job submit for node 69dc47e25dbfa74e32f97ffc 2026-04-15 01:33:37,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,258 - lava_callback - DEBUG - Processing node 69dc47e25dbfa74e32f97ffc: baseline-arm-baylibre 2026-04-15 01:33:37,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc47e25dbfa74e32f97ffc 2026-04-15 01:33:37,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:33:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:33:37,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc47e25dbfa74e32f97ffc HTTP/1.1" 200 None 2026-04-15 01:33:37,309 - lava_callback - ERROR - Error processing callback for node 69dc47e25dbfa74e32f97ffc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:34:17,047 - lava_callback - INFO - Received callback for node 69dc48045dbfa74e32f98010 INFO: 172.21.0.1:43224 - "POST /node/69dc48045dbfa74e32f98010 HTTP/1.0" 202 Accepted 2026-04-15 01:34:17,052 - lava_callback - INFO - Starting async job submit for node 69dc48045dbfa74e32f98010 2026-04-15 01:34:17,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,068 - lava_callback - DEBUG - Processing node 69dc48045dbfa74e32f98010: baseline-arm-baylibre 2026-04-15 01:34:17,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48045dbfa74e32f98010 2026-04-15 01:34:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:34:17,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:17,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48045dbfa74e32f98010 HTTP/1.1" 200 None 2026-04-15 01:34:17,136 - lava_callback - ERROR - Error processing callback for node 69dc48045dbfa74e32f98010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:34:37,021 - lava_callback - INFO - Received callback for node 69dc48275dbfa74e32f9802b INFO: 172.21.0.1:55940 - "POST /node/69dc48275dbfa74e32f9802b HTTP/1.0" 202 Accepted 2026-04-15 01:34:37,027 - lava_callback - INFO - Starting async job submit for node 69dc48275dbfa74e32f9802b 2026-04-15 01:34:37,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,043 - lava_callback - DEBUG - Processing node 69dc48275dbfa74e32f9802b: baseline-arm-baylibre 2026-04-15 01:34:37,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48275dbfa74e32f9802b 2026-04-15 01:34:37,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:34:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:34:37,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48275dbfa74e32f9802b HTTP/1.1" 200 None 2026-04-15 01:34:37,092 - lava_callback - ERROR - Error processing callback for node 69dc48275dbfa74e32f9802b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:35:17,340 - lava_callback - INFO - Received callback for node 69dc484c5dbfa74e32f98041 INFO: 172.21.0.1:56332 - "POST /node/69dc484c5dbfa74e32f98041 HTTP/1.0" 202 Accepted 2026-04-15 01:35:17,346 - lava_callback - INFO - Starting async job submit for node 69dc484c5dbfa74e32f98041 2026-04-15 01:35:17,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,362 - lava_callback - DEBUG - Processing node 69dc484c5dbfa74e32f98041: baseline-arm-baylibre 2026-04-15 01:35:17,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc484c5dbfa74e32f98041 2026-04-15 01:35:17,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:35:17,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:35:17,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc484c5dbfa74e32f98041 HTTP/1.1" 200 None 2026-04-15 01:35:17,413 - lava_callback - ERROR - Error processing callback for node 69dc484c5dbfa74e32f98041: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:36:17,141 - lava_callback - INFO - Received callback for node 69dc48875dbfa74e32f98081 INFO: 172.21.0.1:39868 - "POST /node/69dc48875dbfa74e32f98081 HTTP/1.0" 202 Accepted 2026-04-15 01:36:17,147 - lava_callback - INFO - Starting async job submit for node 69dc48875dbfa74e32f98081 2026-04-15 01:36:17,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,163 - lava_callback - DEBUG - Processing node 69dc48875dbfa74e32f98081: baseline-arm-baylibre 2026-04-15 01:36:17,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48875dbfa74e32f98081 2026-04-15 01:36:17,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:36:17,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:17,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48875dbfa74e32f98081 HTTP/1.1" 200 None 2026-04-15 01:36:17,247 - lava_callback - ERROR - Error processing callback for node 69dc48875dbfa74e32f98081: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:36:57,228 - lava_callback - INFO - Received callback for node 69dc48a75dbfa74e32f980b4 INFO: 172.21.0.1:40192 - "POST /node/69dc48a75dbfa74e32f980b4 HTTP/1.0" 202 Accepted 2026-04-15 01:36:57,234 - lava_callback - INFO - Starting async job submit for node 69dc48a75dbfa74e32f980b4 2026-04-15 01:36:57,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,253 - lava_callback - DEBUG - Processing node 69dc48a75dbfa74e32f980b4: baseline-arm-baylibre 2026-04-15 01:36:57,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48a75dbfa74e32f980b4 2026-04-15 01:36:57,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:36:57,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:36:57,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48a75dbfa74e32f980b4 HTTP/1.1" 200 None 2026-04-15 01:36:57,305 - lava_callback - ERROR - Error processing callback for node 69dc48a75dbfa74e32f980b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:37:29,514 - lava_callback - INFO - Received callback for node 69dc48cc5dbfa74e32f980da INFO: 172.21.0.1:47280 - "POST /node/69dc48cc5dbfa74e32f980da HTTP/1.0" 202 Accepted 2026-04-15 01:37:29,520 - lava_callback - INFO - Starting async job submit for node 69dc48cc5dbfa74e32f980da 2026-04-15 01:37:29,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,535 - lava_callback - DEBUG - Processing node 69dc48cc5dbfa74e32f980da: baseline-arm-clabbe 2026-04-15 01:37:29,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48cc5dbfa74e32f980da 2026-04-15 01:37:29,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:37:29,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:29,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48cc5dbfa74e32f980da HTTP/1.1" 200 None 2026-04-15 01:37:29,602 - lava_callback - ERROR - Error processing callback for node 69dc48cc5dbfa74e32f980da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 01:37:30,747 - lava_callback - INFO - Received callback for node 69dee855f490930782fba3b2 INFO: 172.21.0.1:59816 - "POST /node/69dee855f490930782fba3b2 HTTP/1.0" 202 Accepted 2026-04-15 01:37:30,754 - lava_callback - INFO - Starting async job submit for node 69dee855f490930782fba3b2 2026-04-15 01:37:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:30,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:30,797 - lava_callback - DEBUG - Processing node 69dee855f490930782fba3b2: baseline-nfs-arm64 2026-04-15 01:37:31,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/log.txt.gz 2026-04-15 01:37:31,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/lava-logs.yaml 2026-04-15 01:37:31,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:37:31,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:37:31,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee855f490930782fba3b2/lava_callback.json.gz 2026-04-15 01:37:32,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:32,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:37:32,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:32,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee855f490930782fba3b2 HTTP/1.1" 200 None 2026-04-15 01:37:32,078 - lava_callback - INFO - Completed processing callback for node 69dee855f490930782fba3b2 INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:37:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:37:37,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:38:09,469 - lava_callback - INFO - Received callback for node 69dc48ec5dbfa74e32f98117 INFO: 172.21.0.1:35132 - "POST /node/69dc48ec5dbfa74e32f98117 HTTP/1.0" 202 Accepted 2026-04-15 01:38:09,478 - lava_callback - INFO - Starting async job submit for node 69dc48ec5dbfa74e32f98117 2026-04-15 01:38:09,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,504 - lava_callback - DEBUG - Processing node 69dc48ec5dbfa74e32f98117: baseline-arm-clabbe 2026-04-15 01:38:09,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc48ec5dbfa74e32f98117 2026-04-15 01:38:09,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:38:09,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:09,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc48ec5dbfa74e32f98117 HTTP/1.1" 200 None 2026-04-15 01:38:09,568 - lava_callback - ERROR - Error processing callback for node 69dc48ec5dbfa74e32f98117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:38:29,489 - lava_callback - INFO - Received callback for node 69dc490f5dbfa74e32f98130 INFO: 172.21.0.1:60350 - "POST /node/69dc490f5dbfa74e32f98130 HTTP/1.0" 202 Accepted 2026-04-15 01:38:29,494 - lava_callback - INFO - Starting async job submit for node 69dc490f5dbfa74e32f98130 2026-04-15 01:38:29,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,519 - lava_callback - DEBUG - Processing node 69dc490f5dbfa74e32f98130: baseline-arm-clabbe 2026-04-15 01:38:29,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc490f5dbfa74e32f98130 2026-04-15 01:38:29,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:38:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:38:29,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc490f5dbfa74e32f98130 HTTP/1.1" 200 None 2026-04-15 01:38:29,574 - lava_callback - ERROR - Error processing callback for node 69dc490f5dbfa74e32f98130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:39:09,504 - lava_callback - INFO - Received callback for node 69dc49345dbfa74e32f9813d INFO: 172.21.0.1:35680 - "POST /node/69dc49345dbfa74e32f9813d HTTP/1.0" 202 Accepted 2026-04-15 01:39:09,510 - lava_callback - INFO - Starting async job submit for node 69dc49345dbfa74e32f9813d 2026-04-15 01:39:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,528 - lava_callback - DEBUG - Processing node 69dc49345dbfa74e32f9813d: baseline-arm-clabbe 2026-04-15 01:39:09,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc49345dbfa74e32f9813d 2026-04-15 01:39:09,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:39:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:39:09,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc49345dbfa74e32f9813d HTTP/1.1" 200 None 2026-04-15 01:39:09,578 - lava_callback - ERROR - Error processing callback for node 69dc49345dbfa74e32f9813d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:40:49,651 - lava_callback - INFO - Received callback for node 69dc499a5dbfa74e32f981a0 INFO: 172.21.0.1:37930 - "POST /node/69dc499a5dbfa74e32f981a0 HTTP/1.0" 202 Accepted 2026-04-15 01:40:49,661 - lava_callback - INFO - Starting async job submit for node 69dc499a5dbfa74e32f981a0 2026-04-15 01:40:49,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,685 - lava_callback - DEBUG - Processing node 69dc499a5dbfa74e32f981a0: baseline-arm-clabbe 2026-04-15 01:40:49,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc499a5dbfa74e32f981a0 2026-04-15 01:40:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:40:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:40:49,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc499a5dbfa74e32f981a0 HTTP/1.1" 200 None 2026-04-15 01:40:49,789 - lava_callback - ERROR - Error processing callback for node 69dc499a5dbfa74e32f981a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:41:29,594 - lava_callback - INFO - Received callback for node 69dc49bd5dbfa74e32f981cd INFO: 172.21.0.1:47542 - "POST /node/69dc49bd5dbfa74e32f981cd HTTP/1.0" 202 Accepted 2026-04-15 01:41:29,601 - lava_callback - INFO - Starting async job submit for node 69dc49bd5dbfa74e32f981cd 2026-04-15 01:41:29,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,618 - lava_callback - DEBUG - Processing node 69dc49bd5dbfa74e32f981cd: baseline-arm-clabbe 2026-04-15 01:41:29,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc49bd5dbfa74e32f981cd 2026-04-15 01:41:29,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:41:29,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:41:29,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc49bd5dbfa74e32f981cd HTTP/1.1" 200 None 2026-04-15 01:41:29,677 - lava_callback - ERROR - Error processing callback for node 69dc49bd5dbfa74e32f981cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:42:52,779 - lava_callback - INFO - Received callback for node 69dee857f490930782fba3b8 INFO: 172.21.0.1:38146 - "POST /node/69dee857f490930782fba3b8 HTTP/1.0" 202 Accepted 2026-04-15 01:42:52,788 - lava_callback - INFO - Starting async job submit for node 69dee857f490930782fba3b8 2026-04-15 01:42:52,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:52,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:52,864 - lava_callback - DEBUG - Processing node 69dee857f490930782fba3b8: baseline-nfs-arm64 2026-04-15 01:42:54,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:54,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:54,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/log.txt.gz 2026-04-15 01:42:54,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:55,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:55,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/lava-logs.yaml 2026-04-15 01:42:55,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:42:55,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:42:55,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee857f490930782fba3b8/lava_callback.json.gz DEBUG: Setup failed for 69dee857f490930782fba3b8. Transitting job node result: incomplete -> fail 2026-04-15 01:42:55,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:55,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:42:55,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:42:55,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee857f490930782fba3b8 HTTP/1.1" 200 None 2026-04-15 01:42:55,641 - lava_callback - INFO - Completed processing callback for node 69dee857f490930782fba3b8 INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:43:07,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:43:07,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:44:29,839 - lava_callback - INFO - Received callback for node 69dc4a6e5dbfa74e32f9825a INFO: 172.21.0.1:38048 - "POST /node/69dc4a6e5dbfa74e32f9825a HTTP/1.0" 202 Accepted 2026-04-15 01:44:29,845 - lava_callback - INFO - Starting async job submit for node 69dc4a6e5dbfa74e32f9825a 2026-04-15 01:44:29,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,871 - lava_callback - DEBUG - Processing node 69dc4a6e5dbfa74e32f9825a: baseline-arm-clabbe 2026-04-15 01:44:29,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4a6e5dbfa74e32f9825a 2026-04-15 01:44:29,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:44:29,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:44:29,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4a6e5dbfa74e32f9825a HTTP/1.1" 200 None 2026-04-15 01:44:29,953 - lava_callback - ERROR - Error processing callback for node 69dc4a6e5dbfa74e32f9825a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:45:09,780 - lava_callback - INFO - Received callback for node 69dc4a915dbfa74e32f98295 INFO: 172.21.0.1:34996 - "POST /node/69dc4a915dbfa74e32f98295 HTTP/1.0" 202 Accepted 2026-04-15 01:45:09,786 - lava_callback - INFO - Starting async job submit for node 69dc4a915dbfa74e32f98295 2026-04-15 01:45:09,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,802 - lava_callback - DEBUG - Processing node 69dc4a915dbfa74e32f98295: baseline-arm-clabbe 2026-04-15 01:45:09,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4a915dbfa74e32f98295 2026-04-15 01:45:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:45:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:09,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4a915dbfa74e32f98295 HTTP/1.1" 200 None 2026-04-15 01:45:09,850 - lava_callback - ERROR - Error processing callback for node 69dc4a915dbfa74e32f98295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:45:58,308 - lava_callback - INFO - Received callback for node 69dee85df490930782fba3c7 INFO: 172.21.0.1:49632 - "POST /node/69dee85df490930782fba3c7 HTTP/1.0" 202 Accepted 2026-04-15 01:45:58,315 - lava_callback - INFO - Starting async job submit for node 69dee85df490930782fba3c7 2026-04-15 01:45:58,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:45:58,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:45:58,376 - lava_callback - DEBUG - Processing node 69dee85df490930782fba3c7: baseline-nfs-arm64 2026-04-15 01:45:59,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:45:59,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:45:59,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/log.txt.gz 2026-04-15 01:45:59,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:45:59,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:45:59,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/lava-logs.yaml 2026-04-15 01:46:00,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:46:00,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:46:00,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee85df490930782fba3c7/lava_callback.json.gz DEBUG: Setup failed for 69dee85df490930782fba3c7. Transitting job node result: incomplete -> fail 2026-04-15 01:46:00,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:46:00,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 01:46:00,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:00,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee85df490930782fba3c7 HTTP/1.1" 200 None 2026-04-15 01:46:00,508 - lava_callback - INFO - Completed processing callback for node 69dee85df490930782fba3c7 INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:46:07,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:46:49,879 - lava_callback - INFO - Received callback for node 69dc4afa5dbfa74e32f982e6 INFO: 172.21.0.1:34802 - "POST /node/69dc4afa5dbfa74e32f982e6 HTTP/1.0" 202 Accepted 2026-04-15 01:46:49,885 - lava_callback - INFO - Starting async job submit for node 69dc4afa5dbfa74e32f982e6 2026-04-15 01:46:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,900 - lava_callback - DEBUG - Processing node 69dc4afa5dbfa74e32f982e6: baseline-arm-clabbe 2026-04-15 01:46:49,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4afa5dbfa74e32f982e6 2026-04-15 01:46:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 01:46:49,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:46:49,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4afa5dbfa74e32f982e6 HTTP/1.1" 200 None 2026-04-15 01:46:49,961 - lava_callback - ERROR - Error processing callback for node 69dc4afa5dbfa74e32f982e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:48:34,053 - lava_callback - INFO - Received callback for node 69deea3ff490930782fba7ab INFO: 172.21.0.1:58354 - "POST /node/69deea3ff490930782fba7ab HTTP/1.0" 202 Accepted 2026-04-15 01:48:34,061 - lava_callback - INFO - Starting async job submit for node 69deea3ff490930782fba7ab 2026-04-15 01:48:34,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:34,148 - lava_callback - DEBUG - Processing node 69deea3ff490930782fba7ab: ltp-smoke 2026-04-15 01:48:34,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:34,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:34,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/log.txt.gz 2026-04-15 01:48:35,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:35,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:35,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/lava-logs.yaml 2026-04-15 01:48:35,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 01:48:35,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 01:48:35,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69deea3ff490930782fba7ab/lava_callback.json.gz 2026-04-15 01:48:35,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:35,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 01:48:35,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deea3ff490930782fba7ab HTTP/1.1" 200 None 2026-04-15 01:48:35,978 - lava_callback - INFO - Completed processing callback for node 69deea3ff490930782fba7ab INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:48:37,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:48:37,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:53:18,383 - lava_callback - INFO - Received callback for node 69dc4c865dbfa74e32f98447 INFO: 172.21.0.1:53110 - "POST /node/69dc4c865dbfa74e32f98447 HTTP/1.0" 202 Accepted 2026-04-15 01:53:18,389 - lava_callback - INFO - Starting async job submit for node 69dc4c865dbfa74e32f98447 2026-04-15 01:53:18,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,405 - lava_callback - DEBUG - Processing node 69dc4c865dbfa74e32f98447: baseline-arm64-baylibre 2026-04-15 01:53:18,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4c865dbfa74e32f98447 2026-04-15 01:53:18,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:53:18,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:53:18,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4c865dbfa74e32f98447 HTTP/1.1" 200 None 2026-04-15 01:53:18,484 - lava_callback - ERROR - Error processing callback for node 69dc4c865dbfa74e32f98447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:54:38,121 - lava_callback - INFO - Received callback for node 69dc4ccb5dbfa74e32f9849f INFO: 172.21.0.1:50024 - "POST /node/69dc4ccb5dbfa74e32f9849f HTTP/1.0" 202 Accepted 2026-04-15 01:54:38,127 - lava_callback - INFO - Starting async job submit for node 69dc4ccb5dbfa74e32f9849f 2026-04-15 01:54:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,143 - lava_callback - DEBUG - Processing node 69dc4ccb5dbfa74e32f9849f: baseline-arm64-baylibre 2026-04-15 01:54:38,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ccb5dbfa74e32f9849f 2026-04-15 01:54:38,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:54:38,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:54:38,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ccb5dbfa74e32f9849f HTTP/1.1" 200 None 2026-04-15 01:54:38,198 - lava_callback - ERROR - Error processing callback for node 69dc4ccb5dbfa74e32f9849f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:56:38,238 - lava_callback - INFO - Received callback for node 69dc4d505dbfa74e32f98548 INFO: 172.21.0.1:55222 - "POST /node/69dc4d505dbfa74e32f98548 HTTP/1.0" 202 Accepted 2026-04-15 01:56:38,244 - lava_callback - INFO - Starting async job submit for node 69dc4d505dbfa74e32f98548 2026-04-15 01:56:38,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,260 - lava_callback - DEBUG - Processing node 69dc4d505dbfa74e32f98548: baseline-arm64-baylibre 2026-04-15 01:56:38,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4d505dbfa74e32f98548 2026-04-15 01:56:38,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:56:38,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:56:38,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4d505dbfa74e32f98548 HTTP/1.1" 200 None 2026-04-15 01:56:38,310 - lava_callback - ERROR - Error processing callback for node 69dc4d505dbfa74e32f98548: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:58:18,408 - lava_callback - INFO - Received callback for node 69dc4db25dbfa74e32f985d4 INFO: 172.21.0.1:33324 - "POST /node/69dc4db25dbfa74e32f985d4 HTTP/1.0" 202 Accepted 2026-04-15 01:58:18,414 - lava_callback - INFO - Starting async job submit for node 69dc4db25dbfa74e32f985d4 2026-04-15 01:58:18,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,431 - lava_callback - DEBUG - Processing node 69dc4db25dbfa74e32f985d4: baseline-arm64-baylibre 2026-04-15 01:58:18,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4db25dbfa74e32f985d4 2026-04-15 01:58:18,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:58:18,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:58:18,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4db25dbfa74e32f985d4 HTTP/1.1" 200 None 2026-04-15 01:58:18,486 - lava_callback - ERROR - Error processing callback for node 69dc4db25dbfa74e32f985d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK 2026-04-15 01:59:38,433 - lava_callback - INFO - Received callback for node 69dc4df85dbfa74e32f98623 INFO: 172.21.0.1:56560 - "POST /node/69dc4df85dbfa74e32f98623 HTTP/1.0" 202 Accepted 2026-04-15 01:59:38,438 - lava_callback - INFO - Starting async job submit for node 69dc4df85dbfa74e32f98623 2026-04-15 01:59:38,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,463 - lava_callback - DEBUG - Processing node 69dc4df85dbfa74e32f98623: baseline-arm64-baylibre 2026-04-15 01:59:38,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4df85dbfa74e32f98623 2026-04-15 01:59:38,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 01:59:38,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 01:59:38,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4df85dbfa74e32f98623 HTTP/1.1" 200 None 2026-04-15 01:59:38,522 - lava_callback - ERROR - Error processing callback for node 69dc4df85dbfa74e32f98623: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:01:18,458 - lava_callback - INFO - Received callback for node 69dc4e5a5dbfa74e32f986b0 INFO: 172.21.0.1:51138 - "POST /node/69dc4e5a5dbfa74e32f986b0 HTTP/1.0" 202 Accepted 2026-04-15 02:01:18,464 - lava_callback - INFO - Starting async job submit for node 69dc4e5a5dbfa74e32f986b0 2026-04-15 02:01:18,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,480 - lava_callback - DEBUG - Processing node 69dc4e5a5dbfa74e32f986b0: baseline-arm64-baylibre 2026-04-15 02:01:18,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4e5a5dbfa74e32f986b0 2026-04-15 02:01:18,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:01:18,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:01:18,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4e5a5dbfa74e32f986b0 HTTP/1.1" 200 None 2026-04-15 02:01:18,544 - lava_callback - ERROR - Error processing callback for node 69dc4e5a5dbfa74e32f986b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:02:30,534 - lava_callback - INFO - Received callback for node 69dc4ea75dbfa74e32f986e1 INFO: 172.21.0.1:39332 - "POST /node/69dc4ea75dbfa74e32f986e1 HTTP/1.0" 202 Accepted 2026-04-15 02:02:30,540 - lava_callback - INFO - Starting async job submit for node 69dc4ea75dbfa74e32f986e1 2026-04-15 02:02:30,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,556 - lava_callback - DEBUG - Processing node 69dc4ea75dbfa74e32f986e1: baseline-arm64-clabbe 2026-04-15 02:02:30,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ea75dbfa74e32f986e1 2026-04-15 02:02:30,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:02:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:02:30,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ea75dbfa74e32f986e1 HTTP/1.1" 200 None 2026-04-15 02:02:30,660 - lava_callback - ERROR - Error processing callback for node 69dc4ea75dbfa74e32f986e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:04:50,672 - lava_callback - INFO - Received callback for node 69dc4f335dbfa74e32f98780 INFO: 172.21.0.1:37602 - "POST /node/69dc4f335dbfa74e32f98780 HTTP/1.0" 202 Accepted 2026-04-15 02:04:50,678 - lava_callback - INFO - Starting async job submit for node 69dc4f335dbfa74e32f98780 2026-04-15 02:04:50,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,693 - lava_callback - DEBUG - Processing node 69dc4f335dbfa74e32f98780: baseline-arm64-clabbe 2026-04-15 02:04:50,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4f335dbfa74e32f98780 2026-04-15 02:04:50,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:04:50,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:04:50,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4f335dbfa74e32f98780 HTTP/1.1" 200 None 2026-04-15 02:04:50,745 - lava_callback - ERROR - Error processing callback for node 69dc4f335dbfa74e32f98780: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:05:30,043 - lava_callback - INFO - Received callback for node 69def106f490930782fbae15 INFO: 172.21.0.1:56046 - "POST /node/69def106f490930782fbae15 HTTP/1.0" 202 Accepted 2026-04-15 02:05:30,050 - lava_callback - INFO - Starting async job submit for node 69def106f490930782fbae15 2026-04-15 02:05:30,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:30,091 - lava_callback - DEBUG - Processing node 69def106f490930782fbae15: ltp-timers 2026-04-15 02:05:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:30,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:30,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/log.txt.gz 2026-04-15 02:05:30,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:30,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:30,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/lava-logs.yaml 2026-04-15 02:05:30,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:05:31,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:05:31,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69def106f490930782fbae15/lava_callback.json.gz 2026-04-15 02:05:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:31,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:05:31,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:31,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def106f490930782fbae15 HTTP/1.1" 200 None 2026-04-15 02:05:31,237 - lava_callback - INFO - Completed processing callback for node 69def106f490930782fbae15 INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:05:37,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:05:37,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:06:50,712 - lava_callback - INFO - Received callback for node 69dc4fb35dbfa74e32f9882d INFO: 172.21.0.1:48664 - "POST /node/69dc4fb35dbfa74e32f9882d HTTP/1.0" 202 Accepted 2026-04-15 02:06:50,718 - lava_callback - INFO - Starting async job submit for node 69dc4fb35dbfa74e32f9882d 2026-04-15 02:06:50,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,735 - lava_callback - DEBUG - Processing node 69dc4fb35dbfa74e32f9882d: baseline-arm64-clabbe 2026-04-15 02:06:50,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4fb35dbfa74e32f9882d 2026-04-15 02:06:50,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:06:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:06:50,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4fb35dbfa74e32f9882d HTTP/1.1" 200 None 2026-04-15 02:06:50,808 - lava_callback - ERROR - Error processing callback for node 69dc4fb35dbfa74e32f9882d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:12,775 - lava_callback - INFO - Received callback for node 69def2bff490930782fbafbb INFO: 172.21.0.1:37912 - "POST /node/69def2bff490930782fbafbb HTTP/1.0" 202 Accepted 2026-04-15 02:07:12,781 - lava_callback - INFO - Starting async job submit for node 69def2bff490930782fbafbb 2026-04-15 02:07:12,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:12,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:12,805 - lava_callback - DEBUG - Processing node 69def2bff490930782fbafbb: baseline-arm 2026-04-15 02:07:12,810 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:07:12,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:07:12,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:07:12,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69def2bff490930782fbafbb/lava-logs.yaml 2026-04-15 02:07:12,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:07:13,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:07:13,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69def2bff490930782fbafbb/lava_callback.json.gz 2026-04-15 02:07:13,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:07:13,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:13,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def2bff490930782fbafbb HTTP/1.1" 200 None 2026-04-15 02:07:13,182 - lava_callback - INFO - Completed processing callback for node 69def2bff490930782fbafbb INFO: 172.21.0.1:37916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:37,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:37,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:07:50,761 - lava_callback - INFO - Received callback for node 69dc4ff25dbfa74e32f98899 INFO: 172.21.0.1:41088 - "POST /node/69dc4ff25dbfa74e32f98899 HTTP/1.0" 202 Accepted 2026-04-15 02:07:50,766 - lava_callback - INFO - Starting async job submit for node 69dc4ff25dbfa74e32f98899 2026-04-15 02:07:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,788 - lava_callback - DEBUG - Processing node 69dc4ff25dbfa74e32f98899: baseline-arm64-clabbe 2026-04-15 02:07:50,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc4ff25dbfa74e32f98899 2026-04-15 02:07:50,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:07:50,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:07:50,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc4ff25dbfa74e32f98899 HTTP/1.1" 200 None 2026-04-15 02:07:50,849 - lava_callback - ERROR - Error processing callback for node 69dc4ff25dbfa74e32f98899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:09:10,796 - lava_callback - INFO - Received callback for node 69dc50365dbfa74e32f988f5 INFO: 172.21.0.1:51944 - "POST /node/69dc50365dbfa74e32f988f5 HTTP/1.0" 202 Accepted 2026-04-15 02:09:10,802 - lava_callback - INFO - Starting async job submit for node 69dc50365dbfa74e32f988f5 2026-04-15 02:09:10,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,818 - lava_callback - DEBUG - Processing node 69dc50365dbfa74e32f988f5: baseline-arm64-clabbe 2026-04-15 02:09:10,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc50365dbfa74e32f988f5 2026-04-15 02:09:10,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:09:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:09:10,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc50365dbfa74e32f988f5 HTTP/1.1" 200 None 2026-04-15 02:09:10,867 - lava_callback - ERROR - Error processing callback for node 69dc50365dbfa74e32f988f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:10:30,847 - lava_callback - INFO - Received callback for node 69dc50825dbfa74e32f98932 INFO: 172.21.0.1:46690 - "POST /node/69dc50825dbfa74e32f98932 HTTP/1.0" 202 Accepted 2026-04-15 02:10:30,853 - lava_callback - INFO - Starting async job submit for node 69dc50825dbfa74e32f98932 2026-04-15 02:10:30,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,870 - lava_callback - DEBUG - Processing node 69dc50825dbfa74e32f98932: baseline-arm64-clabbe 2026-04-15 02:10:30,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc50825dbfa74e32f98932 2026-04-15 02:10:30,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:10:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:10:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc50825dbfa74e32f98932 HTTP/1.1" 200 None 2026-04-15 02:10:30,918 - lava_callback - ERROR - Error processing callback for node 69dc50825dbfa74e32f98932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:12:30,945 - lava_callback - INFO - Received callback for node 69dc51055dbfa74e32f989e2 INFO: 172.21.0.1:33920 - "POST /node/69dc51055dbfa74e32f989e2 HTTP/1.0" 202 Accepted 2026-04-15 02:12:30,951 - lava_callback - INFO - Starting async job submit for node 69dc51055dbfa74e32f989e2 2026-04-15 02:12:30,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:30,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:30,979 - lava_callback - DEBUG - Processing node 69dc51055dbfa74e32f989e2: baseline-arm64-clabbe 2026-04-15 02:12:30,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc51055dbfa74e32f989e2 2026-04-15 02:12:30,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:30,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:30,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:31,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 02:12:31,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:12:31,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc51055dbfa74e32f989e2 HTTP/1.1" 200 None 2026-04-15 02:12:31,027 - lava_callback - ERROR - Error processing callback for node 69dc51055dbfa74e32f989e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:14:34,957 - lava_callback - INFO - Received callback for node 69def483f490930782fbb1c2 INFO: 172.21.0.1:50544 - "POST /node/69def483f490930782fbb1c2 HTTP/1.0" 202 Accepted 2026-04-15 02:14:34,963 - lava_callback - INFO - Starting async job submit for node 69def483f490930782fbb1c2 2026-04-15 02:14:34,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:34,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:34,980 - lava_callback - DEBUG - Processing node 69def483f490930782fbb1c2: baseline-nfs-arm64 2026-04-15 02:14:34,982 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:14:34,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:14:35,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:14:35,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def483f490930782fbb1c2/lava-logs.yaml 2026-04-15 02:14:35,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:14:35,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:14:35,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def483f490930782fbb1c2/lava_callback.json.gz 2026-04-15 02:14:35,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:35,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:14:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def483f490930782fbb1c2 HTTP/1.1" 200 None 2026-04-15 02:14:35,507 - lava_callback - INFO - Completed processing callback for node 69def483f490930782fbb1c2 INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:14:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:14:37,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:10,806 - lava_callback - INFO - Received callback for node 69def4bff490930782fbb200 INFO: 172.21.0.1:33856 - "POST /node/69def4bff490930782fbb200 HTTP/1.0" 202 Accepted 2026-04-15 02:16:10,812 - lava_callback - INFO - Starting async job submit for node 69def4bff490930782fbb200 2026-04-15 02:16:10,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:10,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:10,857 - lava_callback - DEBUG - Processing node 69def4bff490930782fbb200: baseline-arm64 2026-04-15 02:16:10,992 - lava_callback - WARNING - Failed to upload log 2026-04-15 02:16:11,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:16:11,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:16:11,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def4bff490930782fbb200/lava-logs.yaml 2026-04-15 02:16:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:16:11,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:16:11,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def4bff490930782fbb200/lava_callback.json.gz 2026-04-15 02:16:11,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:11,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:16:11,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:11,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def4bff490930782fbb200 HTTP/1.1" 200 None 2026-04-15 02:16:11,568 - lava_callback - INFO - Completed processing callback for node 69def4bff490930782fbb200 INFO: 172.21.0.1:33864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:37,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:16:59,490 - lava_callback - INFO - Received callback for node 69dc52085dbfa74e32f98af0 INFO: 172.21.0.1:53230 - "POST /node/69dc52085dbfa74e32f98af0 HTTP/1.0" 202 Accepted 2026-04-15 02:16:59,496 - lava_callback - INFO - Starting async job submit for node 69dc52085dbfa74e32f98af0 2026-04-15 02:16:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,512 - lava_callback - DEBUG - Processing node 69dc52085dbfa74e32f98af0: baseline-arm-baylibre 2026-04-15 02:16:59,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52085dbfa74e32f98af0 2026-04-15 02:16:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:16:59,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:16:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52085dbfa74e32f98af0 HTTP/1.1" 200 None 2026-04-15 02:16:59,566 - lava_callback - ERROR - Error processing callback for node 69dc52085dbfa74e32f98af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:17:19,283 - lava_callback - INFO - Received callback for node 69dc52245dbfa74e32f98b05 INFO: 172.21.0.1:58288 - "POST /node/69dc52245dbfa74e32f98b05 HTTP/1.0" 202 Accepted 2026-04-15 02:17:19,288 - lava_callback - INFO - Starting async job submit for node 69dc52245dbfa74e32f98b05 2026-04-15 02:17:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,329 - lava_callback - DEBUG - Processing node 69dc52245dbfa74e32f98b05: baseline-arm-baylibre 2026-04-15 02:17:19,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52245dbfa74e32f98b05 2026-04-15 02:17:19,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:17:19,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:17:19,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52245dbfa74e32f98b05 HTTP/1.1" 200 None 2026-04-15 02:17:19,377 - lava_callback - ERROR - Error processing callback for node 69dc52245dbfa74e32f98b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:18:59,490 - lava_callback - INFO - Received callback for node 69dc528b5dbfa74e32f98b9b INFO: 172.21.0.1:43710 - "POST /node/69dc528b5dbfa74e32f98b9b HTTP/1.0" 202 Accepted 2026-04-15 02:18:59,496 - lava_callback - INFO - Starting async job submit for node 69dc528b5dbfa74e32f98b9b 2026-04-15 02:18:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,511 - lava_callback - DEBUG - Processing node 69dc528b5dbfa74e32f98b9b: baseline-arm-baylibre 2026-04-15 02:18:59,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc528b5dbfa74e32f98b9b 2026-04-15 02:18:59,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:18:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:18:59,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc528b5dbfa74e32f98b9b HTTP/1.1" 200 None 2026-04-15 02:18:59,559 - lava_callback - ERROR - Error processing callback for node 69dc528b5dbfa74e32f98b9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:19:39,404 - lava_callback - INFO - Received callback for node 69dc52ac5dbfa74e32f98bbd INFO: 172.21.0.1:41866 - "POST /node/69dc52ac5dbfa74e32f98bbd HTTP/1.0" 202 Accepted 2026-04-15 02:19:39,410 - lava_callback - INFO - Starting async job submit for node 69dc52ac5dbfa74e32f98bbd 2026-04-15 02:19:39,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,425 - lava_callback - DEBUG - Processing node 69dc52ac5dbfa74e32f98bbd: baseline-arm-baylibre 2026-04-15 02:19:39,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52ac5dbfa74e32f98bbd 2026-04-15 02:19:39,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:19:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:39,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52ac5dbfa74e32f98bbd HTTP/1.1" 200 None 2026-04-15 02:19:39,507 - lava_callback - ERROR - Error processing callback for node 69dc52ac5dbfa74e32f98bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:19:44,065 - lava_callback - INFO - Received callback for node 69def54cf490930782fbb2c1 INFO: 172.21.0.1:47494 - "POST /node/69def54cf490930782fbb2c1 HTTP/1.0" 202 Accepted 2026-04-15 02:19:44,072 - lava_callback - INFO - Starting async job submit for node 69def54cf490930782fbb2c1 2026-04-15 02:19:44,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:44,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:44,112 - lava_callback - DEBUG - Processing node 69def54cf490930782fbb2c1: baseline-arm64 2026-04-15 02:19:44,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:44,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:44,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/log.txt.gz 2026-04-15 02:19:45,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:45,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:45,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/lava-logs.yaml 2026-04-15 02:19:45,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:19:45,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:19:45,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def54cf490930782fbb2c1/lava_callback.json.gz 2026-04-15 02:19:45,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:45,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:19:45,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:45,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def54cf490930782fbb2c1 HTTP/1.1" 200 None 2026-04-15 02:19:45,616 - lava_callback - INFO - Completed processing callback for node 69def54cf490930782fbb2c1 INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:19:59,469 - lava_callback - INFO - Received callback for node 69dc52cd5dbfa74e32f98bd3 INFO: 172.21.0.1:35492 - "POST /node/69dc52cd5dbfa74e32f98bd3 HTTP/1.0" 202 Accepted 2026-04-15 02:19:59,475 - lava_callback - INFO - Starting async job submit for node 69dc52cd5dbfa74e32f98bd3 2026-04-15 02:19:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,508 - lava_callback - DEBUG - Processing node 69dc52cd5dbfa74e32f98bd3: baseline-arm-baylibre 2026-04-15 02:19:59,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc52cd5dbfa74e32f98bd3 2026-04-15 02:19:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:19:59,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:19:59,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc52cd5dbfa74e32f98bd3 HTTP/1.1" 200 None 2026-04-15 02:19:59,557 - lava_callback - ERROR - Error processing callback for node 69dc52cd5dbfa74e32f98bd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:20:03,982 - lava_callback - INFO - Received callback for node 69def597f490930782fbb348 INFO: 172.21.0.1:36952 - "POST /node/69def597f490930782fbb348 HTTP/1.0" 202 Accepted 2026-04-15 02:20:03,989 - lava_callback - INFO - Starting async job submit for node 69def597f490930782fbb348 2026-04-15 02:20:04,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,038 - lava_callback - DEBUG - Processing node 69def597f490930782fbb348: baseline-arm64 2026-04-15 02:20:04,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/log.txt.gz 2026-04-15 02:20:04,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/lava-logs.yaml 2026-04-15 02:20:04,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:04,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:04,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def597f490930782fbb348/lava_callback.json.gz 2026-04-15 02:20:04,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:04,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:04,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def597f490930782fbb348 HTTP/1.1" 200 None 2026-04-15 02:20:04,834 - lava_callback - INFO - Completed processing callback for node 69def597f490930782fbb348 INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:07,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:07,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:11,995 - lava_callback - INFO - Received callback for node 69dee841f490930782fba36c INFO: 172.21.0.1:50772 - "POST /node/69dee841f490930782fba36c HTTP/1.0" 202 Accepted 2026-04-15 02:20:12,001 - lava_callback - INFO - Starting async job submit for node 69dee841f490930782fba36c 2026-04-15 02:20:12,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,041 - lava_callback - DEBUG - Processing node 69dee841f490930782fba36c: baseline-arm64 2026-04-15 02:20:12,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/log.txt.gz 2026-04-15 02:20:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/lava-logs.yaml 2026-04-15 02:20:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:12,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:12,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dee841f490930782fba36c/lava_callback.json.gz 2026-04-15 02:20:12,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:12,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:12,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee841f490930782fba36c HTTP/1.1" 200 None 2026-04-15 02:20:12,990 - lava_callback - INFO - Completed processing callback for node 69dee841f490930782fba36c INFO: 172.21.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:37,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:37,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:20:55,040 - lava_callback - INFO - Received callback for node 69dee853f490930782fba3af INFO: 172.21.0.1:45288 - "POST /node/69dee853f490930782fba3af HTTP/1.0" 202 Accepted 2026-04-15 02:20:55,047 - lava_callback - INFO - Starting async job submit for node 69dee853f490930782fba3af 2026-04-15 02:20:55,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:55,087 - lava_callback - DEBUG - Processing node 69dee853f490930782fba3af: baseline-nfs-arm64 2026-04-15 02:20:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:55,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:55,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/log.txt.gz 2026-04-15 02:20:55,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:55,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:55,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/lava-logs.yaml 2026-04-15 02:20:55,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:20:56,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:20:56,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dee853f490930782fba3af/lava_callback.json.gz 2026-04-15 02:20:56,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:56,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:20:56,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:20:56,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee853f490930782fba3af HTTP/1.1" 200 None 2026-04-15 02:20:56,184 - lava_callback - INFO - Completed processing callback for node 69dee853f490930782fba3af INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:07,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:07,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:25,061 - lava_callback - INFO - Received callback for node 69def5f4f490930782fbb3c3 INFO: 172.21.0.1:32976 - "POST /node/69def5f4f490930782fbb3c3 HTTP/1.0" 202 Accepted 2026-04-15 02:21:25,067 - lava_callback - INFO - Starting async job submit for node 69def5f4f490930782fbb3c3 2026-04-15 02:21:25,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:25,105 - lava_callback - DEBUG - Processing node 69def5f4f490930782fbb3c3: baseline-arm64-foundriesio 2026-04-15 02:21:25,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/log.txt.gz 2026-04-15 02:21:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/lava-logs.yaml 2026-04-15 02:21:25,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:21:25,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:21:25,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def5f4f490930782fbb3c3/lava_callback.json.gz 2026-04-15 02:21:25,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:25,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:25,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:21:25,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:26,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def5f4f490930782fbb3c3 HTTP/1.1" 200 None 2026-04-15 02:21:26,008 - lava_callback - INFO - Completed processing callback for node 69def5f4f490930782fbb3c3 INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:21:37,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:37,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 02:21:39,815 - lava_callback - INFO - Received callback for node 69dc532f5dbfa74e32f98c4c INFO: 172.21.0.1:43290 - "POST /node/69dc532f5dbfa74e32f98c4c HTTP/1.0" 202 Accepted 2026-04-15 02:21:39,821 - lava_callback - INFO - Starting async job submit for node 69dc532f5dbfa74e32f98c4c 2026-04-15 02:21:39,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,836 - lava_callback - DEBUG - Processing node 69dc532f5dbfa74e32f98c4c: baseline-arm-baylibre 2026-04-15 02:21:39,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc532f5dbfa74e32f98c4c 2026-04-15 02:21:39,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:21:39,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:21:39,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc532f5dbfa74e32f98c4c HTTP/1.1" 200 None 2026-04-15 02:21:39,885 - lava_callback - ERROR - Error processing callback for node 69dc532f5dbfa74e32f98c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:22:11,316 - lava_callback - INFO - Received callback for node 69dc534d5dbfa74e32f98c83 INFO: 172.21.0.1:44678 - "POST /node/69dc534d5dbfa74e32f98c83 HTTP/1.0" 202 Accepted 2026-04-15 02:22:11,326 - lava_callback - INFO - Starting async job submit for node 69dc534d5dbfa74e32f98c83 2026-04-15 02:22:11,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,342 - lava_callback - DEBUG - Processing node 69dc534d5dbfa74e32f98c83: baseline-arm-clabbe 2026-04-15 02:22:11,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc534d5dbfa74e32f98c83 2026-04-15 02:22:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:22:11,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:11,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc534d5dbfa74e32f98c83 HTTP/1.1" 200 None 2026-04-15 02:22:11,394 - lava_callback - ERROR - Error processing callback for node 69dc534d5dbfa74e32f98c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:22:51,257 - lava_callback - INFO - Received callback for node 69dc536c5dbfa74e32f98cbe INFO: 172.21.0.1:48590 - "POST /node/69dc536c5dbfa74e32f98cbe HTTP/1.0" 202 Accepted 2026-04-15 02:22:51,265 - lava_callback - INFO - Starting async job submit for node 69dc536c5dbfa74e32f98cbe 2026-04-15 02:22:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,282 - lava_callback - DEBUG - Processing node 69dc536c5dbfa74e32f98cbe: baseline-arm-clabbe 2026-04-15 02:22:51,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc536c5dbfa74e32f98cbe 2026-04-15 02:22:51,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:22:51,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:22:51,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc536c5dbfa74e32f98cbe HTTP/1.1" 200 None 2026-04-15 02:22:51,358 - lava_callback - ERROR - Error processing callback for node 69dc536c5dbfa74e32f98cbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:23:11,301 - lava_callback - INFO - Received callback for node 69dc538c5dbfa74e32f98ce8 INFO: 172.21.0.1:47232 - "POST /node/69dc538c5dbfa74e32f98ce8 HTTP/1.0" 202 Accepted 2026-04-15 02:23:11,306 - lava_callback - INFO - Starting async job submit for node 69dc538c5dbfa74e32f98ce8 2026-04-15 02:23:11,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,323 - lava_callback - DEBUG - Processing node 69dc538c5dbfa74e32f98ce8: baseline-arm-clabbe 2026-04-15 02:23:11,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc538c5dbfa74e32f98ce8 2026-04-15 02:23:11,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:23:11,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc538c5dbfa74e32f98ce8 HTTP/1.1" 200 None 2026-04-15 02:23:11,371 - lava_callback - ERROR - Error processing callback for node 69dc538c5dbfa74e32f98ce8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:23:51,306 - lava_callback - INFO - Received callback for node 69dc53a95dbfa74e32f98d15 INFO: 172.21.0.1:53354 - "POST /node/69dc53a95dbfa74e32f98d15 HTTP/1.0" 202 Accepted 2026-04-15 02:23:51,313 - lava_callback - INFO - Starting async job submit for node 69dc53a95dbfa74e32f98d15 2026-04-15 02:23:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,346 - lava_callback - DEBUG - Processing node 69dc53a95dbfa74e32f98d15: baseline-arm-clabbe 2026-04-15 02:23:51,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53a95dbfa74e32f98d15 2026-04-15 02:23:51,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:23:51,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:23:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53a95dbfa74e32f98d15 HTTP/1.1" 200 None 2026-04-15 02:23:51,402 - lava_callback - ERROR - Error processing callback for node 69dc53a95dbfa74e32f98d15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:24:31,328 - lava_callback - INFO - Received callback for node 69dc53cc5dbfa74e32f98d44 INFO: 172.21.0.1:44852 - "POST /node/69dc53cc5dbfa74e32f98d44 HTTP/1.0" 202 Accepted 2026-04-15 02:24:31,334 - lava_callback - INFO - Starting async job submit for node 69dc53cc5dbfa74e32f98d44 2026-04-15 02:24:31,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,350 - lava_callback - DEBUG - Processing node 69dc53cc5dbfa74e32f98d44: baseline-arm-clabbe 2026-04-15 02:24:31,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53cc5dbfa74e32f98d44 2026-04-15 02:24:31,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:24:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:31,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53cc5dbfa74e32f98d44 HTTP/1.1" 200 None 2026-04-15 02:24:31,401 - lava_callback - ERROR - Error processing callback for node 69dc53cc5dbfa74e32f98d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:24:51,353 - lava_callback - INFO - Received callback for node 69dc53f05dbfa74e32f98d52 INFO: 172.21.0.1:35848 - "POST /node/69dc53f05dbfa74e32f98d52 HTTP/1.0" 202 Accepted 2026-04-15 02:24:51,359 - lava_callback - INFO - Starting async job submit for node 69dc53f05dbfa74e32f98d52 2026-04-15 02:24:51,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,376 - lava_callback - DEBUG - Processing node 69dc53f05dbfa74e32f98d52: baseline-arm-clabbe 2026-04-15 02:24:51,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc53f05dbfa74e32f98d52 2026-04-15 02:24:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:24:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:24:51,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc53f05dbfa74e32f98d52 HTTP/1.1" 200 None 2026-04-15 02:24:51,440 - lava_callback - ERROR - Error processing callback for node 69dc53f05dbfa74e32f98d52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:25:31,490 - lava_callback - INFO - Received callback for node 69dc540f5dbfa74e32f98d84 INFO: 172.21.0.1:35030 - "POST /node/69dc540f5dbfa74e32f98d84 HTTP/1.0" 202 Accepted 2026-04-15 02:25:31,495 - lava_callback - INFO - Starting async job submit for node 69dc540f5dbfa74e32f98d84 2026-04-15 02:25:31,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,511 - lava_callback - DEBUG - Processing node 69dc540f5dbfa74e32f98d84: baseline-arm-clabbe 2026-04-15 02:25:31,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc540f5dbfa74e32f98d84 2026-04-15 02:25:31,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:25:31,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:25:31,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc540f5dbfa74e32f98d84 HTTP/1.1" 200 None 2026-04-15 02:25:31,578 - lava_callback - ERROR - Error processing callback for node 69dc540f5dbfa74e32f98d84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:26:11,403 - lava_callback - INFO - Received callback for node 69dc542f5dbfa74e32f98dad INFO: 172.21.0.1:51312 - "POST /node/69dc542f5dbfa74e32f98dad HTTP/1.0" 202 Accepted 2026-04-15 02:26:11,408 - lava_callback - INFO - Starting async job submit for node 69dc542f5dbfa74e32f98dad 2026-04-15 02:26:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,424 - lava_callback - DEBUG - Processing node 69dc542f5dbfa74e32f98dad: baseline-arm-clabbe 2026-04-15 02:26:11,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc542f5dbfa74e32f98dad 2026-04-15 02:26:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:26:11,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:11,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc542f5dbfa74e32f98dad HTTP/1.1" 200 None 2026-04-15 02:26:11,475 - lava_callback - ERROR - Error processing callback for node 69dc542f5dbfa74e32f98dad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:26:31,419 - lava_callback - INFO - Received callback for node 69dc54515dbfa74e32f98dcb INFO: 172.21.0.1:43416 - "POST /node/69dc54515dbfa74e32f98dcb HTTP/1.0" 202 Accepted 2026-04-15 02:26:31,425 - lava_callback - INFO - Starting async job submit for node 69dc54515dbfa74e32f98dcb 2026-04-15 02:26:31,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,443 - lava_callback - DEBUG - Processing node 69dc54515dbfa74e32f98dcb: baseline-arm-clabbe 2026-04-15 02:26:31,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54515dbfa74e32f98dcb 2026-04-15 02:26:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 02:26:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:26:31,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54515dbfa74e32f98dcb HTTP/1.1" 200 None 2026-04-15 02:26:31,518 - lava_callback - ERROR - Error processing callback for node 69dc54515dbfa74e32f98dcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:19,956 - lava_callback - INFO - Received callback for node 69dc54755dbfa74e32f98df0 INFO: 172.21.0.1:52250 - "POST /node/69dc54755dbfa74e32f98df0 HTTP/1.0" 202 Accepted 2026-04-15 02:27:19,961 - lava_callback - INFO - Starting async job submit for node 69dc54755dbfa74e32f98df0 2026-04-15 02:27:19,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:19,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:19,983 - lava_callback - DEBUG - Processing node 69dc54755dbfa74e32f98df0: baseline-arm64-baylibre 2026-04-15 02:27:19,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54755dbfa74e32f98df0 2026-04-15 02:27:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:20,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:27:20,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:20,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54755dbfa74e32f98df0 HTTP/1.1" 200 None 2026-04-15 02:27:20,035 - lava_callback - ERROR - Error processing callback for node 69dc54755dbfa74e32f98df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:28,190 - lava_callback - INFO - Received callback for node 69def63cf490930782fbb417 INFO: 172.21.0.1:52258 - "POST /node/69def63cf490930782fbb417 HTTP/1.0" 202 Accepted 2026-04-15 02:27:28,203 - lava_callback - INFO - Starting async job submit for node 69def63cf490930782fbb417 2026-04-15 02:27:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:28,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:28,281 - lava_callback - DEBUG - Processing node 69def63cf490930782fbb417: baseline-arm64-foundriesio 2026-04-15 02:27:29,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:29,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:29,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/log.txt.gz 2026-04-15 02:27:30,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:30,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:30,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/lava-logs.yaml 2026-04-15 02:27:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:27:30,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:27:30,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69def63cf490930782fbb417/lava_callback.json.gz DEBUG: Setup failed for 69def63cf490930782fbb417. Transitting job node result: incomplete -> fail 2026-04-15 02:27:30,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:30,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:27:30,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:30,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def63cf490930782fbb417 HTTP/1.1" 200 None 2026-04-15 02:27:31,044 - lava_callback - INFO - Completed processing callback for node 69def63cf490930782fbb417 INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:27:37,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:27:37,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:28:19,922 - lava_callback - INFO - Received callback for node 69dc54bb5dbfa74e32f98e32 INFO: 172.21.0.1:36686 - "POST /node/69dc54bb5dbfa74e32f98e32 HTTP/1.0" 202 Accepted 2026-04-15 02:28:19,927 - lava_callback - INFO - Starting async job submit for node 69dc54bb5dbfa74e32f98e32 2026-04-15 02:28:19,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,943 - lava_callback - DEBUG - Processing node 69dc54bb5dbfa74e32f98e32: baseline-arm64-baylibre 2026-04-15 02:28:19,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc54bb5dbfa74e32f98e32 2026-04-15 02:28:19,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:28:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:28:19,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc54bb5dbfa74e32f98e32 HTTP/1.1" 200 None 2026-04-15 02:28:19,996 - lava_callback - ERROR - Error processing callback for node 69dc54bb5dbfa74e32f98e32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:28,919 - lava_callback - INFO - Received callback for node 69def763f490930782fbb53c INFO: 172.21.0.1:57930 - "POST /node/69def763f490930782fbb53c HTTP/1.0" 202 Accepted 2026-04-15 02:30:28,925 - lava_callback - INFO - Starting async job submit for node 69def763f490930782fbb53c 2026-04-15 02:30:28,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:28,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:28,957 - lava_callback - DEBUG - Processing node 69def763f490930782fbb53c: baseline-arm64 2026-04-15 02:30:29,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:29,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:29,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/log.txt.gz 2026-04-15 02:30:29,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:29,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:29,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/lava-logs.yaml 2026-04-15 02:30:29,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:30,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:30,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def763f490930782fbb53c/lava_callback.json.gz 2026-04-15 02:30:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:30:30,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:30,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def763f490930782fbb53c HTTP/1.1" 200 None 2026-04-15 02:30:30,207 - lava_callback - INFO - Completed processing callback for node 69def763f490930782fbb53c INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:37,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:37,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 02:30:40,084 - lava_callback - INFO - Received callback for node 69dc554a5dbfa74e32f98eb4 INFO: 172.21.0.1:37156 - "POST /node/69dc554a5dbfa74e32f98eb4 HTTP/1.0" 202 Accepted 2026-04-15 02:30:40,090 - lava_callback - INFO - Starting async job submit for node 69dc554a5dbfa74e32f98eb4 2026-04-15 02:30:40,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,113 - lava_callback - DEBUG - Processing node 69dc554a5dbfa74e32f98eb4: baseline-arm64-baylibre 2026-04-15 02:30:40,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc554a5dbfa74e32f98eb4 2026-04-15 02:30:40,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:30:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:40,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc554a5dbfa74e32f98eb4 HTTP/1.1" 200 None 2026-04-15 02:30:40,167 - lava_callback - ERROR - Error processing callback for node 69dc554a5dbfa74e32f98eb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:30:52,863 - lava_callback - INFO - Received callback for node 69def698f490930782fbb484 INFO: 172.21.0.1:50010 - "POST /node/69def698f490930782fbb484 HTTP/1.0" 202 Accepted 2026-04-15 02:30:52,870 - lava_callback - INFO - Starting async job submit for node 69def698f490930782fbb484 2026-04-15 02:30:52,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:52,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:52,924 - lava_callback - DEBUG - Processing node 69def698f490930782fbb484: baseline-arm64 2026-04-15 02:30:53,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/log.txt.gz 2026-04-15 02:30:53,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/lava-logs.yaml 2026-04-15 02:30:53,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:30:53,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:30:53,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69def698f490930782fbb484/lava_callback.json.gz DEBUG: Setup failed for 69def698f490930782fbb484. Transitting job node result: incomplete -> fail 2026-04-15 02:30:54,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:30:54,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:30:54,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def698f490930782fbb484 HTTP/1.1" 200 None 2026-04-15 02:30:54,239 - lava_callback - INFO - Completed processing callback for node 69def698f490930782fbb484 INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:31:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:31:07,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:32:00,175 - lava_callback - INFO - Received callback for node 69dc55905dbfa74e32f98ef3 INFO: 172.21.0.1:50340 - "POST /node/69dc55905dbfa74e32f98ef3 HTTP/1.0" 202 Accepted 2026-04-15 02:32:00,181 - lava_callback - INFO - Starting async job submit for node 69dc55905dbfa74e32f98ef3 2026-04-15 02:32:00,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,206 - lava_callback - DEBUG - Processing node 69dc55905dbfa74e32f98ef3: baseline-arm64-baylibre 2026-04-15 02:32:00,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc55905dbfa74e32f98ef3 2026-04-15 02:32:00,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:32:00,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:32:00,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc55905dbfa74e32f98ef3 HTTP/1.1" 200 None 2026-04-15 02:32:00,264 - lava_callback - ERROR - Error processing callback for node 69dc55905dbfa74e32f98ef3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:33:00,367 - lava_callback - INFO - Received callback for node 69dc55d95dbfa74e32f98f46 INFO: 172.21.0.1:52162 - "POST /node/69dc55d95dbfa74e32f98f46 HTTP/1.0" 202 Accepted 2026-04-15 02:33:00,373 - lava_callback - INFO - Starting async job submit for node 69dc55d95dbfa74e32f98f46 2026-04-15 02:33:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,388 - lava_callback - DEBUG - Processing node 69dc55d95dbfa74e32f98f46: baseline-arm64-baylibre 2026-04-15 02:33:00,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc55d95dbfa74e32f98f46 2026-04-15 02:33:00,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:33:00,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:33:00,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc55d95dbfa74e32f98f46 HTTP/1.1" 200 None 2026-04-15 02:33:00,448 - lava_callback - ERROR - Error processing callback for node 69dc55d95dbfa74e32f98f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:34:20,294 - lava_callback - INFO - Received callback for node 69dc561e5dbfa74e32f98f87 INFO: 172.21.0.1:38838 - "POST /node/69dc561e5dbfa74e32f98f87 HTTP/1.0" 202 Accepted 2026-04-15 02:34:20,299 - lava_callback - INFO - Starting async job submit for node 69dc561e5dbfa74e32f98f87 2026-04-15 02:34:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,315 - lava_callback - DEBUG - Processing node 69dc561e5dbfa74e32f98f87: baseline-arm64-baylibre 2026-04-15 02:34:20,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc561e5dbfa74e32f98f87 2026-04-15 02:34:20,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:34:20,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:34:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc561e5dbfa74e32f98f87 HTTP/1.1" 200 None 2026-04-15 02:34:20,363 - lava_callback - ERROR - Error processing callback for node 69dc561e5dbfa74e32f98f87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:35:31,922 - lava_callback - INFO - Received callback for node 69dc565f5dbfa74e32f98ff5 INFO: 172.21.0.1:39024 - "POST /node/69dc565f5dbfa74e32f98ff5 HTTP/1.0" 202 Accepted 2026-04-15 02:35:31,928 - lava_callback - INFO - Starting async job submit for node 69dc565f5dbfa74e32f98ff5 2026-04-15 02:35:31,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,947 - lava_callback - DEBUG - Processing node 69dc565f5dbfa74e32f98ff5: baseline-arm64-clabbe 2026-04-15 02:35:31,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc565f5dbfa74e32f98ff5 2026-04-15 02:35:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:35:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:35:31,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc565f5dbfa74e32f98ff5 HTTP/1.1" 200 None 2026-04-15 02:35:31,997 - lava_callback - ERROR - Error processing callback for node 69dc565f5dbfa74e32f98ff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:36:31,935 - lava_callback - INFO - Received callback for node 69dc56a85dbfa74e32f9903a INFO: 172.21.0.1:39706 - "POST /node/69dc56a85dbfa74e32f9903a HTTP/1.0" 202 Accepted 2026-04-15 02:36:31,940 - lava_callback - INFO - Starting async job submit for node 69dc56a85dbfa74e32f9903a 2026-04-15 02:36:31,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:31,957 - lava_callback - DEBUG - Processing node 69dc56a85dbfa74e32f9903a: baseline-arm64-clabbe 2026-04-15 02:36:31,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc56a85dbfa74e32f9903a 2026-04-15 02:36:31,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:31,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:31,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:36:31,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:36:32,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc56a85dbfa74e32f9903a HTTP/1.1" 200 None 2026-04-15 02:36:32,006 - lava_callback - ERROR - Error processing callback for node 69dc56a85dbfa74e32f9903a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:37:31,967 - lava_callback - INFO - Received callback for node 69dc56e75dbfa74e32f9909e INFO: 172.21.0.1:35782 - "POST /node/69dc56e75dbfa74e32f9909e HTTP/1.0" 202 Accepted 2026-04-15 02:37:31,973 - lava_callback - INFO - Starting async job submit for node 69dc56e75dbfa74e32f9909e 2026-04-15 02:37:31,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:31,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:31,988 - lava_callback - DEBUG - Processing node 69dc56e75dbfa74e32f9909e: baseline-arm64-clabbe 2026-04-15 02:37:31,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc56e75dbfa74e32f9909e 2026-04-15 02:37:31,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:37:32,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:37:32,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc56e75dbfa74e32f9909e HTTP/1.1" 200 None 2026-04-15 02:37:32,041 - lava_callback - ERROR - Error processing callback for node 69dc56e75dbfa74e32f9909e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:40:10,695 - lava_callback - INFO - Received callback for node 69def670f490930782fbb45e INFO: 172.21.0.1:38854 - "POST /node/69def670f490930782fbb45e HTTP/1.0" 202 Accepted 2026-04-15 02:40:10,703 - lava_callback - INFO - Starting async job submit for node 69def670f490930782fbb45e 2026-04-15 02:40:10,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:10,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:10,778 - lava_callback - DEBUG - Processing node 69def670f490930782fbb45e: baseline-arm 2026-04-15 02:40:11,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:11,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:11,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/log.txt.gz 2026-04-15 02:40:11,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:12,096 - lava_callback - INFO - Received callback for node 69dc57765dbfa74e32f99114 INFO: 172.21.0.1:38862 - "POST /node/69dc57765dbfa74e32f99114 HTTP/1.0" 202 Accepted 2026-04-15 02:40:12,102 - lava_callback - INFO - Starting async job submit for node 69dc57765dbfa74e32f99114 2026-04-15 02:40:12,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,124 - lava_callback - DEBUG - Processing node 69dc57765dbfa74e32f99114: baseline-arm64-clabbe 2026-04-15 02:40:12,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57765dbfa74e32f99114 2026-04-15 02:40:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:12,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/lava-logs.yaml 2026-04-15 02:40:12,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:40:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:40:12,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57765dbfa74e32f99114 HTTP/1.1" 200 None 2026-04-15 02:40:12,196 - lava_callback - ERROR - Error processing callback for node 69dc57765dbfa74e32f99114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:40:12,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:40:12,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69def670f490930782fbb45e/lava_callback.json.gz DEBUG: Setup failed for 69def670f490930782fbb45e. Transitting job node result: incomplete -> fail 2026-04-15 02:40:12,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:40:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:12,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def670f490930782fbb45e HTTP/1.1" 200 None 2026-04-15 02:40:12,789 - lava_callback - INFO - Completed processing callback for node 69def670f490930782fbb45e INFO: 172.21.0.1:38870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:40:37,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:40:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:41:12,130 - lava_callback - INFO - Received callback for node 69dc57b95dbfa74e32f9915e INFO: 172.21.0.1:37664 - "POST /node/69dc57b95dbfa74e32f9915e HTTP/1.0" 202 Accepted 2026-04-15 02:41:12,136 - lava_callback - INFO - Starting async job submit for node 69dc57b95dbfa74e32f9915e 2026-04-15 02:41:12,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,153 - lava_callback - DEBUG - Processing node 69dc57b95dbfa74e32f9915e: baseline-arm64-clabbe 2026-04-15 02:41:12,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57b95dbfa74e32f9915e 2026-04-15 02:41:12,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:41:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:41:12,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57b95dbfa74e32f9915e HTTP/1.1" 200 None 2026-04-15 02:41:12,208 - lava_callback - ERROR - Error processing callback for node 69dc57b95dbfa74e32f9915e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:42:12,188 - lava_callback - INFO - Received callback for node 69dc57f95dbfa74e32f991c2 INFO: 172.21.0.1:34388 - "POST /node/69dc57f95dbfa74e32f991c2 HTTP/1.0" 202 Accepted 2026-04-15 02:42:12,194 - lava_callback - INFO - Starting async job submit for node 69dc57f95dbfa74e32f991c2 2026-04-15 02:42:12,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,210 - lava_callback - DEBUG - Processing node 69dc57f95dbfa74e32f991c2: baseline-arm64-clabbe 2026-04-15 02:42:12,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc57f95dbfa74e32f991c2 2026-04-15 02:42:12,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:42:12,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:42:12,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc57f95dbfa74e32f991c2 HTTP/1.1" 200 None 2026-04-15 02:42:12,260 - lava_callback - ERROR - Error processing callback for node 69dc57f95dbfa74e32f991c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:43:32,220 - lava_callback - INFO - Received callback for node 69dc58415dbfa74e32f991f3 INFO: 172.21.0.1:59022 - "POST /node/69dc58415dbfa74e32f991f3 HTTP/1.0" 202 Accepted 2026-04-15 02:43:32,226 - lava_callback - INFO - Starting async job submit for node 69dc58415dbfa74e32f991f3 2026-04-15 02:43:32,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,244 - lava_callback - DEBUG - Processing node 69dc58415dbfa74e32f991f3: baseline-arm64-clabbe 2026-04-15 02:43:32,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58415dbfa74e32f991f3 2026-04-15 02:43:32,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 02:43:32,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:43:32,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58415dbfa74e32f991f3 HTTP/1.1" 200 None 2026-04-15 02:43:32,293 - lava_callback - ERROR - Error processing callback for node 69dc58415dbfa74e32f991f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:44:40,929 - lava_callback - INFO - Received callback for node 69dc58945dbfa74e32f99246 INFO: 172.21.0.1:39016 - "POST /node/69dc58945dbfa74e32f99246 HTTP/1.0" 202 Accepted 2026-04-15 02:44:40,935 - lava_callback - INFO - Starting async job submit for node 69dc58945dbfa74e32f99246 2026-04-15 02:44:40,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:40,953 - lava_callback - DEBUG - Processing node 69dc58945dbfa74e32f99246: baseline-arm-baylibre 2026-04-15 02:44:40,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58945dbfa74e32f99246 2026-04-15 02:44:40,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:40,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:40,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:44:40,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:44:41,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58945dbfa74e32f99246 HTTP/1.1" 200 None 2026-04-15 02:44:41,017 - lava_callback - ERROR - Error processing callback for node 69dc58945dbfa74e32f99246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:45:20,800 - lava_callback - INFO - Received callback for node 69dc58b05dbfa74e32f9927a INFO: 172.21.0.1:59290 - "POST /node/69dc58b05dbfa74e32f9927a HTTP/1.0" 202 Accepted 2026-04-15 02:45:20,806 - lava_callback - INFO - Starting async job submit for node 69dc58b05dbfa74e32f9927a 2026-04-15 02:45:20,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,827 - lava_callback - DEBUG - Processing node 69dc58b05dbfa74e32f9927a: baseline-arm-baylibre 2026-04-15 02:45:20,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58b05dbfa74e32f9927a 2026-04-15 02:45:20,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:45:20,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:20,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58b05dbfa74e32f9927a HTTP/1.1" 200 None 2026-04-15 02:45:20,880 - lava_callback - ERROR - Error processing callback for node 69dc58b05dbfa74e32f9927a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:45:40,782 - lava_callback - INFO - Received callback for node 69dc58d35dbfa74e32f992af INFO: 172.21.0.1:60708 - "POST /node/69dc58d35dbfa74e32f992af HTTP/1.0" 202 Accepted 2026-04-15 02:45:40,788 - lava_callback - INFO - Starting async job submit for node 69dc58d35dbfa74e32f992af 2026-04-15 02:45:40,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,804 - lava_callback - DEBUG - Processing node 69dc58d35dbfa74e32f992af: baseline-arm-baylibre 2026-04-15 02:45:40,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58d35dbfa74e32f992af 2026-04-15 02:45:40,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:45:40,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:45:40,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58d35dbfa74e32f992af HTTP/1.1" 200 None 2026-04-15 02:45:40,869 - lava_callback - ERROR - Error processing callback for node 69dc58d35dbfa74e32f992af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:20,866 - lava_callback - INFO - Received callback for node 69dc58f05dbfa74e32f992d4 INFO: 172.21.0.1:49374 - "POST /node/69dc58f05dbfa74e32f992d4 HTTP/1.0" 202 Accepted 2026-04-15 02:46:20,871 - lava_callback - INFO - Starting async job submit for node 69dc58f05dbfa74e32f992d4 2026-04-15 02:46:20,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,887 - lava_callback - DEBUG - Processing node 69dc58f05dbfa74e32f992d4: baseline-arm-baylibre 2026-04-15 02:46:20,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc58f05dbfa74e32f992d4 2026-04-15 02:46:20,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:46:20,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:20,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc58f05dbfa74e32f992d4 HTTP/1.1" 200 None 2026-04-15 02:46:20,949 - lava_callback - ERROR - Error processing callback for node 69dc58f05dbfa74e32f992d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:52,392 - lava_callback - INFO - Received callback for node 69dc59105dbfa74e32f99305 INFO: 172.21.0.1:44968 - "POST /node/69dc59105dbfa74e32f99305 HTTP/1.0" 202 Accepted 2026-04-15 02:46:52,398 - lava_callback - INFO - Starting async job submit for node 69dc59105dbfa74e32f99305 2026-04-15 02:46:52,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,418 - lava_callback - DEBUG - Processing node 69dc59105dbfa74e32f99305: baseline-arm-clabbe 2026-04-15 02:46:52,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59105dbfa74e32f99305 2026-04-15 02:46:52,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:46:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59105dbfa74e32f99305 HTTP/1.1" 200 None 2026-04-15 02:46:52,468 - lava_callback - ERROR - Error processing callback for node 69dc59105dbfa74e32f99305: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:46:57,730 - lava_callback - INFO - Received callback for node 69def75ef490930782fbb539 INFO: 172.21.0.1:44978 - "POST /node/69def75ef490930782fbb539 HTTP/1.0" 202 Accepted 2026-04-15 02:46:57,736 - lava_callback - INFO - Starting async job submit for node 69def75ef490930782fbb539 2026-04-15 02:46:57,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:57,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:57,796 - lava_callback - DEBUG - Processing node 69def75ef490930782fbb539: baseline-x86 2026-04-15 02:46:58,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:58,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:58,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/log.txt.gz 2026-04-15 02:46:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:59,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:59,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/lava-logs.yaml 2026-04-15 02:46:59,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:46:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:46:59,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69def75ef490930782fbb539/lava_callback.json.gz DEBUG: Setup failed for 69def75ef490930782fbb539. Transitting job node result: incomplete -> fail 2026-04-15 02:46:59,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:59,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 02:46:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:46:59,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def75ef490930782fbb539 HTTP/1.1" 200 None 2026-04-15 02:46:59,517 - lava_callback - INFO - Completed processing callback for node 69def75ef490930782fbb539 INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:32,357 - lava_callback - INFO - Received callback for node 69dc59315dbfa74e32f9932d INFO: 172.21.0.1:51496 - "POST /node/69dc59315dbfa74e32f9932d HTTP/1.0" 202 Accepted 2026-04-15 02:47:32,363 - lava_callback - INFO - Starting async job submit for node 69dc59315dbfa74e32f9932d 2026-04-15 02:47:32,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,379 - lava_callback - DEBUG - Processing node 69dc59315dbfa74e32f9932d: baseline-arm-clabbe 2026-04-15 02:47:32,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59315dbfa74e32f9932d 2026-04-15 02:47:32,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:47:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:32,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59315dbfa74e32f9932d HTTP/1.1" 200 None 2026-04-15 02:47:32,436 - lava_callback - ERROR - Error processing callback for node 69dc59315dbfa74e32f9932d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:47:52,391 - lava_callback - INFO - Received callback for node 69dc59515dbfa74e32f99344 INFO: 172.21.0.1:48758 - "POST /node/69dc59515dbfa74e32f99344 HTTP/1.0" 202 Accepted 2026-04-15 02:47:52,396 - lava_callback - INFO - Starting async job submit for node 69dc59515dbfa74e32f99344 2026-04-15 02:47:52,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,412 - lava_callback - DEBUG - Processing node 69dc59515dbfa74e32f99344: baseline-arm-clabbe 2026-04-15 02:47:52,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59515dbfa74e32f99344 2026-04-15 02:47:52,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:47:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:47:52,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59515dbfa74e32f99344 HTTP/1.1" 200 None 2026-04-15 02:47:52,476 - lava_callback - ERROR - Error processing callback for node 69dc59515dbfa74e32f99344: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:48:30,379 - lava_callback - INFO - Received callback for node 69defb98f490930782fbb9b9 INFO: 172.21.0.1:60562 - "POST /node/69defb98f490930782fbb9b9 HTTP/1.0" 202 Accepted 2026-04-15 02:48:30,386 - lava_callback - INFO - Starting async job submit for node 69defb98f490930782fbb9b9 2026-04-15 02:48:30,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:30,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:30,441 - lava_callback - DEBUG - Processing node 69defb98f490930782fbb9b9: ltp-smoke 2026-04-15 02:48:30,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:30,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:30,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/log.txt.gz 2026-04-15 02:48:31,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:31,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:31,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/lava-logs.yaml 2026-04-15 02:48:31,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:48:31,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:48:31,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69defb98f490930782fbb9b9/lava_callback.json.gz 2026-04-15 02:48:31,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:31,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 02:48:31,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:31,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defb98f490930782fbb9b9 HTTP/1.1" 200 None 2026-04-15 02:48:31,650 - lava_callback - INFO - Completed processing callback for node 69defb98f490930782fbb9b9 2026-04-15 02:48:32,403 - lava_callback - INFO - Received callback for node 69dc59755dbfa74e32f9937a INFO: 172.21.0.1:60572 - "POST /node/69dc59755dbfa74e32f9937a HTTP/1.0" 202 Accepted 2026-04-15 02:48:32,409 - lava_callback - INFO - Starting async job submit for node 69dc59755dbfa74e32f9937a 2026-04-15 02:48:32,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,428 - lava_callback - DEBUG - Processing node 69dc59755dbfa74e32f9937a: baseline-arm-clabbe 2026-04-15 02:48:32,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59755dbfa74e32f9937a 2026-04-15 02:48:32,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:48:32,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59755dbfa74e32f9937a HTTP/1.1" 200 None 2026-04-15 02:48:32,485 - lava_callback - ERROR - Error processing callback for node 69dc59755dbfa74e32f9937a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:48:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:48:37,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:49:12,485 - lava_callback - INFO - Received callback for node 69dc59945dbfa74e32f993a3 INFO: 172.21.0.1:57488 - "POST /node/69dc59945dbfa74e32f993a3 HTTP/1.0" 202 Accepted 2026-04-15 02:49:12,491 - lava_callback - INFO - Starting async job submit for node 69dc59945dbfa74e32f993a3 2026-04-15 02:49:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,507 - lava_callback - DEBUG - Processing node 69dc59945dbfa74e32f993a3: baseline-arm-clabbe 2026-04-15 02:49:12,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59945dbfa74e32f993a3 2026-04-15 02:49:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:49:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:12,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59945dbfa74e32f993a3 HTTP/1.1" 200 None 2026-04-15 02:49:12,559 - lava_callback - ERROR - Error processing callback for node 69dc59945dbfa74e32f993a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET /node/698a40c922b4cc0f227b05bc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:49:32,457 - lava_callback - INFO - Received callback for node 69dc59b45dbfa74e32f993cd INFO: 172.21.0.1:37474 - "POST /node/69dc59b45dbfa74e32f993cd HTTP/1.0" 202 Accepted 2026-04-15 02:49:32,463 - lava_callback - INFO - Starting async job submit for node 69dc59b45dbfa74e32f993cd 2026-04-15 02:49:32,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,479 - lava_callback - DEBUG - Processing node 69dc59b45dbfa74e32f993cd: baseline-arm-clabbe 2026-04-15 02:49:32,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59b45dbfa74e32f993cd 2026-04-15 02:49:32,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:49:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:49:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59b45dbfa74e32f993cd HTTP/1.1" 200 None 2026-04-15 02:49:32,535 - lava_callback - ERROR - Error processing callback for node 69dc59b45dbfa74e32f993cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:50:12,603 - lava_callback - INFO - Received callback for node 69dc59d45dbfa74e32f993ee INFO: 172.21.0.1:56972 - "POST /node/69dc59d45dbfa74e32f993ee HTTP/1.0" 202 Accepted 2026-04-15 02:50:12,609 - lava_callback - INFO - Starting async job submit for node 69dc59d45dbfa74e32f993ee 2026-04-15 02:50:12,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,625 - lava_callback - DEBUG - Processing node 69dc59d45dbfa74e32f993ee: baseline-arm-clabbe 2026-04-15 02:50:12,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59d45dbfa74e32f993ee 2026-04-15 02:50:12,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:50:12,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:12,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59d45dbfa74e32f993ee HTTP/1.1" 200 None 2026-04-15 02:50:12,683 - lava_callback - ERROR - Error processing callback for node 69dc59d45dbfa74e32f993ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:50:32,508 - lava_callback - INFO - Received callback for node 69dc59f25dbfa74e32f99423 INFO: 172.21.0.1:45666 - "POST /node/69dc59f25dbfa74e32f99423 HTTP/1.0" 202 Accepted 2026-04-15 02:50:32,513 - lava_callback - INFO - Starting async job submit for node 69dc59f25dbfa74e32f99423 2026-04-15 02:50:32,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,535 - lava_callback - DEBUG - Processing node 69dc59f25dbfa74e32f99423: baseline-arm-clabbe 2026-04-15 02:50:32,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc59f25dbfa74e32f99423 2026-04-15 02:50:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:50:32,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:50:32,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc59f25dbfa74e32f99423 HTTP/1.1" 200 None 2026-04-15 02:50:32,586 - lava_callback - ERROR - Error processing callback for node 69dc59f25dbfa74e32f99423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:51:12,638 - lava_callback - INFO - Received callback for node 69dc5a105dbfa74e32f99454 INFO: 172.21.0.1:49928 - "POST /node/69dc5a105dbfa74e32f99454 HTTP/1.0" 202 Accepted 2026-04-15 02:51:12,644 - lava_callback - INFO - Starting async job submit for node 69dc5a105dbfa74e32f99454 2026-04-15 02:51:12,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,661 - lava_callback - DEBUG - Processing node 69dc5a105dbfa74e32f99454: baseline-arm-clabbe 2026-04-15 02:51:12,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a105dbfa74e32f99454 2026-04-15 02:51:12,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 02:51:12,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a105dbfa74e32f99454 HTTP/1.1" 200 None 2026-04-15 02:51:12,713 - lava_callback - ERROR - Error processing callback for node 69dc5a105dbfa74e32f99454: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:51:41,213 - lava_callback - INFO - Received callback for node 69dc5a365dbfa74e32f9946d INFO: 172.21.0.1:60128 - "POST /node/69dc5a365dbfa74e32f9946d HTTP/1.0" 202 Accepted 2026-04-15 02:51:41,219 - lava_callback - INFO - Starting async job submit for node 69dc5a365dbfa74e32f9946d 2026-04-15 02:51:41,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,237 - lava_callback - DEBUG - Processing node 69dc5a365dbfa74e32f9946d: baseline-arm64-baylibre 2026-04-15 02:51:41,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a365dbfa74e32f9946d 2026-04-15 02:51:41,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:51:41,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:51:41,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a365dbfa74e32f9946d HTTP/1.1" 200 None 2026-04-15 02:51:41,296 - lava_callback - ERROR - Error processing callback for node 69dc5a365dbfa74e32f9946d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:53:01,197 - lava_callback - INFO - Received callback for node 69dc5a7f5dbfa74e32f99495 INFO: 172.21.0.1:46764 - "POST /node/69dc5a7f5dbfa74e32f99495 HTTP/1.0" 202 Accepted 2026-04-15 02:53:01,204 - lava_callback - INFO - Starting async job submit for node 69dc5a7f5dbfa74e32f99495 2026-04-15 02:53:01,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,220 - lava_callback - DEBUG - Processing node 69dc5a7f5dbfa74e32f99495: baseline-arm64-baylibre 2026-04-15 02:53:01,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5a7f5dbfa74e32f99495 2026-04-15 02:53:01,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:53:01,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:53:01,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5a7f5dbfa74e32f99495 HTTP/1.1" 200 None 2026-04-15 02:53:01,271 - lava_callback - ERROR - Error processing callback for node 69dc5a7f5dbfa74e32f99495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:01,249 - lava_callback - INFO - Received callback for node 69dc5abf5dbfa74e32f99506 INFO: 172.21.0.1:46274 - "POST /node/69dc5abf5dbfa74e32f99506 HTTP/1.0" 202 Accepted 2026-04-15 02:54:01,255 - lava_callback - INFO - Starting async job submit for node 69dc5abf5dbfa74e32f99506 2026-04-15 02:54:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,271 - lava_callback - DEBUG - Processing node 69dc5abf5dbfa74e32f99506: baseline-arm64-baylibre 2026-04-15 02:54:01,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5abf5dbfa74e32f99506 2026-04-15 02:54:01,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:54:01,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:01,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5abf5dbfa74e32f99506 HTTP/1.1" 200 None 2026-04-15 02:54:01,321 - lava_callback - ERROR - Error processing callback for node 69dc5abf5dbfa74e32f99506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:25,527 - lava_callback - INFO - Received callback for node 69def93df490930782fbb761 INFO: 172.21.0.1:51136 - "POST /node/69def93df490930782fbb761 HTTP/1.0" 202 Accepted 2026-04-15 02:54:25,536 - lava_callback - INFO - Starting async job submit for node 69def93df490930782fbb761 2026-04-15 02:54:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:25,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:25,630 - lava_callback - DEBUG - Processing node 69def93df490930782fbb761: baseline-nfs-arm64 INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:26,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:27,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:27,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/log.txt.gz 2026-04-15 02:54:27,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:28,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:28,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/lava-logs.yaml 2026-04-15 02:54:28,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:54:28,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:54:28,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def93df490930782fbb761/lava_callback.json.gz DEBUG: Setup failed for 69def93df490930782fbb761. Transitting job node result: incomplete -> fail 2026-04-15 02:54:28,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:54:28,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:28,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def93df490930782fbb761 HTTP/1.1" 200 None 2026-04-15 02:54:28,498 - lava_callback - INFO - Completed processing callback for node 69def93df490930782fbb761 INFO: 172.21.0.1:46538 - "GET /node/693f77160d8ce4018da945c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:54:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:54:37,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET /node/69894d8a85773790cd34e331%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:55:21,488 - lava_callback - INFO - Received callback for node 69dc5b095dbfa74e32f99531 INFO: 172.21.0.1:52446 - "POST /node/69dc5b095dbfa74e32f99531 HTTP/1.0" 202 Accepted 2026-04-15 02:55:21,493 - lava_callback - INFO - Starting async job submit for node 69dc5b095dbfa74e32f99531 2026-04-15 02:55:21,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,510 - lava_callback - DEBUG - Processing node 69dc5b095dbfa74e32f99531: baseline-arm64-baylibre 2026-04-15 02:55:21,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b095dbfa74e32f99531 2026-04-15 02:55:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:55:21,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:55:21,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b095dbfa74e32f99531 HTTP/1.1" 200 None 2026-04-15 02:55:21,581 - lava_callback - ERROR - Error processing callback for node 69dc5b095dbfa74e32f99531: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /node/699363a4cebe99dd8e063f4c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57362 - "GET /node/698a80bcd9a1cfa777a23317%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 02:56:21,414 - lava_callback - INFO - Received callback for node 69dc5b4c5dbfa74e32f9956a INFO: 172.21.0.1:57368 - "POST /node/69dc5b4c5dbfa74e32f9956a HTTP/1.0" 202 Accepted 2026-04-15 02:56:21,420 - lava_callback - INFO - Starting async job submit for node 69dc5b4c5dbfa74e32f9956a 2026-04-15 02:56:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,436 - lava_callback - DEBUG - Processing node 69dc5b4c5dbfa74e32f9956a: baseline-arm64-baylibre 2026-04-15 02:56:21,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b4c5dbfa74e32f9956a 2026-04-15 02:56:21,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:56:21,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:56:21,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b4c5dbfa74e32f9956a HTTP/1.1" 200 None 2026-04-15 02:56:21,511 - lava_callback - ERROR - Error processing callback for node 69dc5b4c5dbfa74e32f9956a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:11,601 - lava_callback - INFO - Received callback for node 69defa6af490930782fbb88c INFO: 172.21.0.1:47514 - "POST /node/69defa6af490930782fbb88c HTTP/1.0" 202 Accepted 2026-04-15 02:57:11,608 - lava_callback - INFO - Starting async job submit for node 69defa6af490930782fbb88c 2026-04-15 02:57:11,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:11,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:11,682 - lava_callback - DEBUG - Processing node 69defa6af490930782fbb88c: ltp-smoke 2026-04-15 02:57:12,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/log.txt.gz 2026-04-15 02:57:12,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/lava-logs.yaml 2026-04-15 02:57:12,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:12,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:12,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69defa6af490930782fbb88c/lava_callback.json.gz 2026-04-15 02:57:13,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:13,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 02:57:13,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:13,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defa6af490930782fbb88c HTTP/1.1" 200 None 2026-04-15 02:57:13,313 - lava_callback - INFO - Completed processing callback for node 69defa6af490930782fbb88c INFO: 172.21.0.1:47516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:21,565 - lava_callback - INFO - Received callback for node 69dc5b8b5dbfa74e32f995cf INFO: 172.21.0.1:57956 - "POST /node/69dc5b8b5dbfa74e32f995cf HTTP/1.0" 202 Accepted 2026-04-15 02:57:21,571 - lava_callback - INFO - Starting async job submit for node 69dc5b8b5dbfa74e32f995cf 2026-04-15 02:57:21,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,587 - lava_callback - DEBUG - Processing node 69dc5b8b5dbfa74e32f995cf: baseline-arm64-baylibre 2026-04-15 02:57:21,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5b8b5dbfa74e32f995cf 2026-04-15 02:57:21,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:57:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:21,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5b8b5dbfa74e32f995cf HTTP/1.1" 200 None 2026-04-15 02:57:21,634 - lava_callback - ERROR - Error processing callback for node 69dc5b8b5dbfa74e32f995cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 02:57:24,494 - lava_callback - INFO - Received callback for node 69def9caf490930782fbb806 INFO: 172.21.0.1:57962 - "POST /node/69def9caf490930782fbb806 HTTP/1.0" 202 Accepted 2026-04-15 02:57:24,502 - lava_callback - INFO - Starting async job submit for node 69def9caf490930782fbb806 2026-04-15 02:57:24,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:24,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:24,558 - lava_callback - DEBUG - Processing node 69def9caf490930782fbb806: baseline-nfs-arm64 2026-04-15 02:57:25,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:25,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:25,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/log.txt.gz 2026-04-15 02:57:25,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:25,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:25,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/lava-logs.yaml 2026-04-15 02:57:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 02:57:26,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 02:57:26,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69def9caf490930782fbb806/lava_callback.json.gz DEBUG: Setup failed for 69def9caf490930782fbb806. Transitting job node result: incomplete -> fail 2026-04-15 02:57:26,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 02:57:26,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69def9caf490930782fbb806 HTTP/1.1" 200 None 2026-04-15 02:57:26,265 - lava_callback - INFO - Completed processing callback for node 69def9caf490930782fbb806 INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:57:37,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:57:37,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52598 - "GET /node/69b913100ec88e58bad0d8a9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:58:32,985 - lava_callback - INFO - Received callback for node 69dc5bd65dbfa74e32f99620 INFO: 172.21.0.1:57058 - "POST /node/69dc5bd65dbfa74e32f99620 HTTP/1.0" 202 Accepted 2026-04-15 02:58:32,991 - lava_callback - INFO - Starting async job submit for node 69dc5bd65dbfa74e32f99620 2026-04-15 02:58:32,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,011 - lava_callback - DEBUG - Processing node 69dc5bd65dbfa74e32f99620: baseline-arm64-clabbe 2026-04-15 02:58:33,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5bd65dbfa74e32f99620 2026-04-15 02:58:33,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:58:33,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:58:33,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5bd65dbfa74e32f99620 HTTP/1.1" 200 None 2026-04-15 02:58:33,065 - lava_callback - ERROR - Error processing callback for node 69dc5bd65dbfa74e32f99620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET /node/695c09605dac150a0e838c26%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43126 - "GET /node/6919e16040db568ee36c906c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK 2026-04-15 02:59:53,018 - lava_callback - INFO - Received callback for node 69dc5c155dbfa74e32f9967d INFO: 172.21.0.1:38456 - "POST /node/69dc5c155dbfa74e32f9967d HTTP/1.0" 202 Accepted 2026-04-15 02:59:53,024 - lava_callback - INFO - Starting async job submit for node 69dc5c155dbfa74e32f9967d 2026-04-15 02:59:53,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,040 - lava_callback - DEBUG - Processing node 69dc5c155dbfa74e32f9967d: baseline-arm64-clabbe 2026-04-15 02:59:53,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c155dbfa74e32f9967d 2026-04-15 02:59:53,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 02:59:53,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 02:59:53,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c155dbfa74e32f9967d HTTP/1.1" 200 None 2026-04-15 02:59:53,104 - lava_callback - ERROR - Error processing callback for node 69dc5c155dbfa74e32f9967d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:01,864 - lava_callback - INFO - Received callback for node 69deff1cf490930782fbbe0c INFO: 172.21.0.1:40962 - "POST /node/69deff1cf490930782fbbe0c HTTP/1.0" 202 Accepted 2026-04-15 03:00:01,869 - lava_callback - INFO - Starting async job submit for node 69deff1cf490930782fbbe0c 2026-04-15 03:00:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:01,886 - lava_callback - DEBUG - Processing node 69deff1cf490930782fbbe0c: baseline-nfs-arm64 2026-04-15 03:00:01,887 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:00:01,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:00:02,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:00:02,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69deff1cf490930782fbbe0c/lava-logs.yaml 2026-04-15 03:00:02,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:00:02,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:00:02,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69deff1cf490930782fbbe0c/lava_callback.json.gz 2026-04-15 03:00:02,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:02,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:00:02,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:02,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deff1cf490930782fbbe0c HTTP/1.1" 200 None 2026-04-15 03:00:02,285 - lava_callback - INFO - Completed processing callback for node 69deff1cf490930782fbbe0c INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:07,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:07,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:00:53,117 - lava_callback - INFO - Received callback for node 69dc5c5c5dbfa74e32f996c3 INFO: 172.21.0.1:46228 - "POST /node/69dc5c5c5dbfa74e32f996c3 HTTP/1.0" 202 Accepted 2026-04-15 03:00:53,123 - lava_callback - INFO - Starting async job submit for node 69dc5c5c5dbfa74e32f996c3 2026-04-15 03:00:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,138 - lava_callback - DEBUG - Processing node 69dc5c5c5dbfa74e32f996c3: baseline-arm64-clabbe 2026-04-15 03:00:53,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c5c5dbfa74e32f996c3 2026-04-15 03:00:53,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:00:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:00:53,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c5c5dbfa74e32f996c3 HTTP/1.1" 200 None 2026-04-15 03:00:53,191 - lava_callback - ERROR - Error processing callback for node 69dc5c5c5dbfa74e32f996c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46244 - "GET /node/6992ea2a31166481c8dd8bb2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:32,640 - lava_callback - INFO - Received callback for node 69deff5cf490930782fbbe5e INFO: 172.21.0.1:37254 - "POST /node/69deff5cf490930782fbbe5e HTTP/1.0" 202 Accepted 2026-04-15 03:01:32,647 - lava_callback - INFO - Starting async job submit for node 69deff5cf490930782fbbe5e 2026-04-15 03:01:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:32,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:32,697 - lava_callback - DEBUG - Processing node 69deff5cf490930782fbbe5e: baseline-arm64 2026-04-15 03:01:32,851 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:01:32,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:01:33,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:01:33,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69deff5cf490930782fbbe5e/lava-logs.yaml 2026-04-15 03:01:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:01:33,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:01:33,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69deff5cf490930782fbbe5e/lava_callback.json.gz 2026-04-15 03:01:33,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:33,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:01:33,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:33,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deff5cf490930782fbbe5e HTTP/1.1" 200 None 2026-04-15 03:01:33,499 - lava_callback - INFO - Completed processing callback for node 69deff5cf490930782fbbe5e INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:37,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:37,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:01:53,129 - lava_callback - INFO - Received callback for node 69dc5c9b5dbfa74e32f99721 INFO: 172.21.0.1:58490 - "POST /node/69dc5c9b5dbfa74e32f99721 HTTP/1.0" 202 Accepted 2026-04-15 03:01:53,135 - lava_callback - INFO - Starting async job submit for node 69dc5c9b5dbfa74e32f99721 2026-04-15 03:01:53,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,151 - lava_callback - DEBUG - Processing node 69dc5c9b5dbfa74e32f99721: baseline-arm64-clabbe 2026-04-15 03:01:53,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5c9b5dbfa74e32f99721 2026-04-15 03:01:53,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:01:53,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:01:53,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5c9b5dbfa74e32f99721 HTTP/1.1" 200 None 2026-04-15 03:01:53,199 - lava_callback - ERROR - Error processing callback for node 69dc5c9b5dbfa74e32f99721: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:03:13,247 - lava_callback - INFO - Received callback for node 69dc5cde5dbfa74e32f9978b INFO: 172.21.0.1:47376 - "POST /node/69dc5cde5dbfa74e32f9978b HTTP/1.0" 202 Accepted 2026-04-15 03:03:13,252 - lava_callback - INFO - Starting async job submit for node 69dc5cde5dbfa74e32f9978b 2026-04-15 03:03:13,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,268 - lava_callback - DEBUG - Processing node 69dc5cde5dbfa74e32f9978b: baseline-arm64-clabbe 2026-04-15 03:03:13,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5cde5dbfa74e32f9978b 2026-04-15 03:03:13,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:03:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:03:13,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5cde5dbfa74e32f9978b HTTP/1.1" 200 None 2026-04-15 03:03:13,316 - lava_callback - ERROR - Error processing callback for node 69dc5cde5dbfa74e32f9978b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET /node/693fca36575bc060ce14a1af%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET /node/69b831b80b8ad4124cec369c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:04:13,237 - lava_callback - INFO - Received callback for node 69dc5d215dbfa74e32f997d3 INFO: 172.21.0.1:33718 - "POST /node/69dc5d215dbfa74e32f997d3 HTTP/1.0" 202 Accepted 2026-04-15 03:04:13,242 - lava_callback - INFO - Starting async job submit for node 69dc5d215dbfa74e32f997d3 2026-04-15 03:04:13,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,270 - lava_callback - DEBUG - Processing node 69dc5d215dbfa74e32f997d3: baseline-arm64-clabbe 2026-04-15 03:04:13,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5d215dbfa74e32f997d3 2026-04-15 03:04:13,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:04:13,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:04:13,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5d215dbfa74e32f997d3 HTTP/1.1" 200 None 2026-04-15 03:04:13,350 - lava_callback - ERROR - Error processing callback for node 69dc5d215dbfa74e32f997d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:05:13,223 - lava_callback - INFO - Received callback for node 69dc5d655dbfa74e32f9981b INFO: 172.21.0.1:51516 - "POST /node/69dc5d655dbfa74e32f9981b HTTP/1.0" 202 Accepted 2026-04-15 03:05:13,228 - lava_callback - INFO - Starting async job submit for node 69dc5d655dbfa74e32f9981b 2026-04-15 03:05:13,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,268 - lava_callback - DEBUG - Processing node 69dc5d655dbfa74e32f9981b: baseline-arm64-clabbe 2026-04-15 03:05:13,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc5d655dbfa74e32f9981b 2026-04-15 03:05:13,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 03:05:13,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:05:13,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc5d655dbfa74e32f9981b HTTP/1.1" 200 None 2026-04-15 03:05:13,321 - lava_callback - ERROR - Error processing callback for node 69dc5d655dbfa74e32f9981b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET /node/694a309c2060d3d84792197a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET /node/69bc36d017e5cb936602e4d4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET /node/6992680498a8bdb31c3920e1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /node/698e2a85952a14bf500e412f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET /node/6949cd9ad45a0a86fbe282c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60990 - "GET /node/69884c69e408e9ea60fad25c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET /node/6985d90a71989fb14149a896%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57036 - "GET /node/69a00f7662feda9f0694f0f1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET /node/698b8f1f0a16aea5a0dc8ec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET /node/6982ace13507dcddca590696%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET /node/698a41d422b4cc0f227b0687%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET /node/698fcc2d76d4b6342e9d75e5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42842 - "GET /node/698fc5d476d4b6342e9d717a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /node/698524403ff18e47df615276%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45852 - "GET /node/69a3fba36ebb1cc56c1decef%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET /node/69937308cebe99dd8e069d19%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44530 - "GET /node/698a184922b4cc0f227ae507%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:31:24,066 - lava_callback - INFO - Received callback for node 69df064ef490930782fbc5a2 INFO: 172.21.0.1:58276 - "POST /node/69df064ef490930782fbc5a2 HTTP/1.0" 202 Accepted 2026-04-15 03:31:24,073 - lava_callback - INFO - Starting async job submit for node 69df064ef490930782fbc5a2 2026-04-15 03:31:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:24,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:24,121 - lava_callback - DEBUG - Processing node 69df064ef490930782fbc5a2: baseline-arm64 2026-04-15 03:31:24,265 - lava_callback - WARNING - Failed to upload log 2026-04-15 03:31:24,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:31:24,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:31:24,688 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df064ef490930782fbc5a2/lava-logs.yaml 2026-04-15 03:31:24,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:31:25,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:31:25,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df064ef490930782fbc5a2/lava_callback.json.gz 2026-04-15 03:31:25,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:25,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:31:25,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:25,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df064ef490930782fbc5a2 HTTP/1.1" 200 None 2026-04-15 03:31:25,292 - lava_callback - INFO - Completed processing callback for node 69df064ef490930782fbc5a2 INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:31:37,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:31:37,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:05,929 - lava_callback - INFO - Received callback for node 69df0830f490930782fbc7ca INFO: 172.21.0.1:48594 - "POST /node/69df0830f490930782fbc7ca HTTP/1.0" 202 Accepted 2026-04-15 03:44:05,938 - lava_callback - INFO - Starting async job submit for node 69df0830f490930782fbc7ca 2026-04-15 03:44:05,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:06,008 - lava_callback - DEBUG - Processing node 69df0830f490930782fbc7ca: baseline-arm64-foundriesio INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:07,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:07,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/log.txt.gz 2026-04-15 03:44:08,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:08,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:08,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/lava-logs.yaml 2026-04-15 03:44:08,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:44:08,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:44:08,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df0830f490930782fbc7ca/lava_callback.json.gz DEBUG: Setup failed for 69df0830f490930782fbc7ca. Transitting job node result: incomplete -> fail 2026-04-15 03:44:08,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:08,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:44:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:08,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0830f490930782fbc7ca HTTP/1.1" 200 None 2026-04-15 03:44:08,868 - lava_callback - INFO - Completed processing callback for node 69df0830f490930782fbc7ca INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:44:37,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:44:37,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:45:32,944 - lava_callback - INFO - Received callback for node 69df08abf490930782fbc840 INFO: 172.21.0.1:40078 - "POST /node/69df08abf490930782fbc840 HTTP/1.0" 202 Accepted 2026-04-15 03:45:32,950 - lava_callback - INFO - Starting async job submit for node 69df08abf490930782fbc840 2026-04-15 03:45:32,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:32,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:32,990 - lava_callback - DEBUG - Processing node 69df08abf490930782fbc840: baseline-arm64 2026-04-15 03:45:33,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:33,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:33,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/log.txt.gz 2026-04-15 03:45:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:34,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:34,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/lava-logs.yaml 2026-04-15 03:45:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:45:34,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:45:34,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df08abf490930782fbc840/lava_callback.json.gz 2026-04-15 03:45:34,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:45:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:34,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df08abf490930782fbc840 HTTP/1.1" 200 None 2026-04-15 03:45:34,364 - lava_callback - INFO - Completed processing callback for node 69df08abf490930782fbc840 INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:45:37,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:45:37,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:48:32,057 - lava_callback - INFO - Received callback for node 69df0943f490930782fbc8d4 INFO: 172.21.0.1:54568 - "POST /node/69df0943f490930782fbc8d4 HTTP/1.0" 202 Accepted 2026-04-15 03:48:32,064 - lava_callback - INFO - Starting async job submit for node 69df0943f490930782fbc8d4 2026-04-15 03:48:32,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:32,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:32,121 - lava_callback - DEBUG - Processing node 69df0943f490930782fbc8d4: baseline-arm64 2026-04-15 03:48:32,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:32,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:32,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/log.txt.gz 2026-04-15 03:48:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:33,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:33,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/lava-logs.yaml 2026-04-15 03:48:33,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 03:48:33,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 03:48:33,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df0943f490930782fbc8d4/lava_callback.json.gz DEBUG: Setup failed for 69df0943f490930782fbc8d4. Transitting job node result: incomplete -> fail 2026-04-15 03:48:33,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 03:48:33,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:33,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0943f490930782fbc8d4 HTTP/1.1" 200 None 2026-04-15 03:48:33,521 - lava_callback - INFO - Completed processing callback for node 69df0943f490930782fbc8d4 INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK 2026-04-15 03:48:37,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 03:48:37,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:10:14,116 - lava_callback - INFO - Received callback for node 69df0b87f490930782fbcb64 INFO: 172.21.0.1:45988 - "POST /node/69df0b87f490930782fbcb64 HTTP/1.0" 202 Accepted 2026-04-15 04:10:14,122 - lava_callback - INFO - Starting async job submit for node 69df0b87f490930782fbcb64 2026-04-15 04:10:14,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:14,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:14,198 - lava_callback - DEBUG - Processing node 69df0b87f490930782fbcb64: baseline-arm 2026-04-15 04:10:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:14,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:14,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/log.txt.gz INFO: 172.21.0.1:45994 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 04:10:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:15,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:15,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/lava-logs.yaml 2026-04-15 04:10:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:10:15,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:10:15,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df0b87f490930782fbcb64/lava_callback.json.gz DEBUG: Setup failed for 69df0b87f490930782fbcb64. Transitting job node result: incomplete -> fail 2026-04-15 04:10:15,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:15,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-15 04:10:15,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:15,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0b87f490930782fbcb64 HTTP/1.1" 200 None 2026-04-15 04:10:16,027 - lava_callback - INFO - Completed processing callback for node 69df0b87f490930782fbcb64 INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:10:37,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:10:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:19:20,311 - lava_callback - INFO - Received callback for node 69df11bef490930782fbd0fe INFO: 172.21.0.1:57938 - "POST /node/69df11bef490930782fbd0fe HTTP/1.0" 202 Accepted 2026-04-15 04:19:20,316 - lava_callback - INFO - Starting async job submit for node 69df11bef490930782fbd0fe 2026-04-15 04:19:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,334 - lava_callback - DEBUG - Processing node 69df11bef490930782fbd0fe: baseline-nfs-arm64 2026-04-15 04:19:20,335 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:19:20,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:19:20,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:19:20,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df11bef490930782fbd0fe/lava-logs.yaml 2026-04-15 04:19:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:19:20,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:19:20,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df11bef490930782fbd0fe/lava_callback.json.gz 2026-04-15 04:19:20,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:19:20,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:20,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df11bef490930782fbd0fe HTTP/1.1" 200 None 2026-04-15 04:19:20,798 - lava_callback - INFO - Completed processing callback for node 69df11bef490930782fbd0fe INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:19:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:19:37,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:21:02,291 - lava_callback - INFO - Received callback for node 69df0d61f490930782fbcd0d INFO: 172.21.0.1:41004 - "POST /node/69df0d61f490930782fbcd0d HTTP/1.0" 202 Accepted 2026-04-15 04:21:02,298 - lava_callback - INFO - Starting async job submit for node 69df0d61f490930782fbcd0d 2026-04-15 04:21:02,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:02,355 - lava_callback - DEBUG - Processing node 69df0d61f490930782fbcd0d: baseline-x86 2026-04-15 04:21:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/log.txt.gz 2026-04-15 04:21:03,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/lava-logs.yaml 2026-04-15 04:21:03,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:21:03,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:21:03,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df0d61f490930782fbcd0d/lava_callback.json.gz DEBUG: Setup failed for 69df0d61f490930782fbcd0d. Transitting job node result: incomplete -> fail 2026-04-15 04:21:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:03,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-15 04:21:03,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:03,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0d61f490930782fbcd0d HTTP/1.1" 200 None 2026-04-15 04:21:04,016 - lava_callback - INFO - Completed processing callback for node 69df0d61f490930782fbcd0d INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:21:07,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:21:07,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 04:22:15,997 - lava_callback - INFO - Received callback for node 69df124af490930782fbd17c INFO: 172.21.0.1:52484 - "POST /node/69df124af490930782fbd17c HTTP/1.0" 202 Accepted 2026-04-15 04:22:16,005 - lava_callback - INFO - Starting async job submit for node 69df124af490930782fbd17c 2026-04-15 04:22:16,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,050 - lava_callback - DEBUG - Processing node 69df124af490930782fbd17c: baseline-arm64 2026-04-15 04:22:16,187 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:22:16,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:22:16,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:22:16,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df124af490930782fbd17c/lava-logs.yaml 2026-04-15 04:22:16,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:22:16,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:22:16,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df124af490930782fbd17c/lava_callback.json.gz 2026-04-15 04:22:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:22:16,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:16,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df124af490930782fbd17c HTTP/1.1" 200 None 2026-04-15 04:22:16,747 - lava_callback - INFO - Completed processing callback for node 69df124af490930782fbd17c INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:22:37,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:22:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:29:00,817 - lava_callback - INFO - Received callback for node 69df0f69f490930782fbcefa INFO: 172.21.0.1:51866 - "POST /node/69df0f69f490930782fbcefa HTTP/1.0" 202 Accepted 2026-04-15 04:29:00,826 - lava_callback - INFO - Starting async job submit for node 69df0f69f490930782fbcefa 2026-04-15 04:29:00,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:00,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:00,886 - lava_callback - DEBUG - Processing node 69df0f69f490930782fbcefa: baseline-nfs-arm64 2026-04-15 04:29:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:02,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:02,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/log.txt.gz 2026-04-15 04:29:03,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:03,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:03,765 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/lava-logs.yaml 2026-04-15 04:29:03,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:29:03,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:29:03,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df0f69f490930782fbcefa/lava_callback.json.gz DEBUG: Setup failed for 69df0f69f490930782fbcefa. Transitting job node result: incomplete -> fail 2026-04-15 04:29:04,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:04,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:29:04,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:04,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0f69f490930782fbcefa HTTP/1.1" 200 None 2026-04-15 04:29:04,251 - lava_callback - INFO - Completed processing callback for node 69df0f69f490930782fbcefa INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:29:07,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:29:07,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:30:35,736 - lava_callback - INFO - Received callback for node 69df1043f490930782fbcfa9 INFO: 172.21.0.1:55736 - "POST /node/69df1043f490930782fbcfa9 HTTP/1.0" 202 Accepted 2026-04-15 04:30:35,743 - lava_callback - INFO - Starting async job submit for node 69df1043f490930782fbcfa9 2026-04-15 04:30:35,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:35,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:35,816 - lava_callback - DEBUG - Processing node 69df1043f490930782fbcfa9: ltp-smoke 2026-04-15 04:30:36,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:30:36,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:36,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/log.txt.gz 2026-04-15 04:30:36,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:30:37,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:37,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/lava-logs.yaml 2026-04-15 04:30:37,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:30:37,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:30:37,272 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df1043f490930782fbcfa9/lava_callback.json.gz 2026-04-15 04:30:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:37,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded93df490930782fb6e24 HTTP/1.1" 200 None 2026-04-15 04:30:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1043f490930782fbcfa9 HTTP/1.1" 200 None 2026-04-15 04:30:37,539 - lava_callback - INFO - Completed processing callback for node 69df1043f490930782fbcfa9 2026-04-15 04:30:37,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:30:37,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:34:36,685 - lava_callback - INFO - Received callback for node 69df1099f490930782fbcfff INFO: 172.21.0.1:46900 - "POST /node/69df1099f490930782fbcfff HTTP/1.0" 202 Accepted 2026-04-15 04:34:36,693 - lava_callback - INFO - Starting async job submit for node 69df1099f490930782fbcfff 2026-04-15 04:34:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:36,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:36,762 - lava_callback - DEBUG - Processing node 69df1099f490930782fbcfff: baseline-nfs-arm64 2026-04-15 04:34:37,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:37,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:37,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/log.txt.gz 2026-04-15 04:34:38,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:38,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:38,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/lava-logs.yaml 2026-04-15 04:34:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:34:38,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:34:38,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1099f490930782fbcfff/lava_callback.json.gz DEBUG: Setup failed for 69df1099f490930782fbcfff. Transitting job node result: incomplete -> fail 2026-04-15 04:34:38,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:34:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:34:38,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1099f490930782fbcfff HTTP/1.1" 200 None 2026-04-15 04:34:39,045 - lava_callback - INFO - Completed processing callback for node 69df1099f490930782fbcfff INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:35:07,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:35:07,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET /node/693ae813fee8383e92b6563c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57024 - "GET /node/6986fdfe6e077e4126a7d8fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:39:06,079 - lava_callback - INFO - Received callback for node 69df1634f490930782fbd515 INFO: 172.21.0.1:33940 - "POST /node/69df1634f490930782fbd515 HTTP/1.0" 202 Accepted 2026-04-15 04:39:06,086 - lava_callback - INFO - Starting async job submit for node 69df1634f490930782fbd515 2026-04-15 04:39:06,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,132 - lava_callback - DEBUG - Processing node 69df1634f490930782fbd515: baseline-arm64 2026-04-15 04:39:06,276 - lava_callback - WARNING - Failed to upload log 2026-04-15 04:39:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:39:06,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:39:06,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1634f490930782fbd515/lava-logs.yaml 2026-04-15 04:39:06,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:39:06,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:39:06,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1634f490930782fbd515/lava_callback.json.gz 2026-04-15 04:39:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:39:06,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1634f490930782fbd515 HTTP/1.1" 200 None 2026-04-15 04:39:06,959 - lava_callback - INFO - Completed processing callback for node 69df1634f490930782fbd515 2026-04-15 04:39:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:39:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET /node/698d62ee820eff0a56c16925%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /node/698f87313013abef95d02349%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52950 - "GET /node/693f16d024745582e399b040%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:42:47,361 - lava_callback - INFO - Received callback for node 69dc74425dbfa74e32f99903 INFO: 172.21.0.1:54390 - "POST /node/69dc74425dbfa74e32f99903 HTTP/1.0" 202 Accepted 2026-04-15 04:42:47,367 - lava_callback - INFO - Starting async job submit for node 69dc74425dbfa74e32f99903 2026-04-15 04:42:47,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,388 - lava_callback - DEBUG - Processing node 69dc74425dbfa74e32f99903: baseline-arm-baylibre 2026-04-15 04:42:47,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74425dbfa74e32f99903 2026-04-15 04:42:47,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:42:47,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:42:47,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74425dbfa74e32f99903 HTTP/1.1" 200 None 2026-04-15 04:42:47,435 - lava_callback - ERROR - Error processing callback for node 69dc74425dbfa74e32f99903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:43:47,387 - lava_callback - INFO - Received callback for node 69dc747b5dbfa74e32f99945 INFO: 172.21.0.1:40156 - "POST /node/69dc747b5dbfa74e32f99945 HTTP/1.0" 202 Accepted 2026-04-15 04:43:47,393 - lava_callback - INFO - Starting async job submit for node 69dc747b5dbfa74e32f99945 2026-04-15 04:43:47,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,418 - lava_callback - DEBUG - Processing node 69dc747b5dbfa74e32f99945: baseline-arm-baylibre 2026-04-15 04:43:47,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc747b5dbfa74e32f99945 2026-04-15 04:43:47,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:43:47,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:43:47,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc747b5dbfa74e32f99945 HTTP/1.1" 200 None 2026-04-15 04:43:47,577 - lava_callback - ERROR - Error processing callback for node 69dc747b5dbfa74e32f99945: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:27,475 - lava_callback - INFO - Received callback for node 69dc749a5dbfa74e32f99954 INFO: 172.21.0.1:53426 - "POST /node/69dc749a5dbfa74e32f99954 HTTP/1.0" 202 Accepted 2026-04-15 04:44:27,482 - lava_callback - INFO - Starting async job submit for node 69dc749a5dbfa74e32f99954 2026-04-15 04:44:27,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,498 - lava_callback - DEBUG - Processing node 69dc749a5dbfa74e32f99954: baseline-arm-baylibre 2026-04-15 04:44:27,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc749a5dbfa74e32f99954 2026-04-15 04:44:27,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:44:27,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:27,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc749a5dbfa74e32f99954 HTTP/1.1" 200 None 2026-04-15 04:44:27,558 - lava_callback - ERROR - Error processing callback for node 69dc749a5dbfa74e32f99954: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 04:44:34,616 - lava_callback - INFO - Received callback for node 69df16c4f490930782fbd5b4 INFO: 172.21.0.1:44360 - "POST /node/69df16c4f490930782fbd5b4 HTTP/1.0" 202 Accepted 2026-04-15 04:44:34,622 - lava_callback - INFO - Starting async job submit for node 69df16c4f490930782fbd5b4 2026-04-15 04:44:34,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:34,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:34,655 - lava_callback - DEBUG - Processing node 69df16c4f490930782fbd5b4: baseline-arm64 2026-04-15 04:44:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/log.txt.gz 2026-04-15 04:44:35,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/lava-logs.yaml 2026-04-15 04:44:35,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:35,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:35,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df16c4f490930782fbd5b4/lava_callback.json.gz 2026-04-15 04:44:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:35,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:44:35,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:35,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df16c4f490930782fbd5b4 HTTP/1.1" 200 None 2026-04-15 04:44:35,864 - lava_callback - INFO - Completed processing callback for node 69df16c4f490930782fbd5b4 INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:37,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:37,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 04:44:41,561 - lava_callback - INFO - Received callback for node 69df1699f490930782fbd55a INFO: 172.21.0.1:50680 - "POST /node/69df1699f490930782fbd55a HTTP/1.0" 202 Accepted 2026-04-15 04:44:41,570 - lava_callback - INFO - Starting async job submit for node 69df1699f490930782fbd55a 2026-04-15 04:44:41,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:41,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:41,690 - lava_callback - DEBUG - Processing node 69df1699f490930782fbd55a: baseline-arm64-foundriesio 2026-04-15 04:44:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:43,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:43,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/log.txt.gz 2026-04-15 04:44:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:44,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:44,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/lava-logs.yaml 2026-04-15 04:44:44,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:44:44,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:44:44,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df1699f490930782fbd55a/lava_callback.json.gz DEBUG: 69df1699f490930782fbd55a Transitting job node result: pass -> incomplete 2026-04-15 04:44:44,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:44:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:44,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1699f490930782fbd55a HTTP/1.1" 200 None 2026-04-15 04:44:44,374 - lava_callback - INFO - Completed processing callback for node 69df1699f490930782fbd55a INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:44:47,423 - lava_callback - INFO - Received callback for node 69dc74bc5dbfa74e32f99983 INFO: 172.21.0.1:50696 - "POST /node/69dc74bc5dbfa74e32f99983 HTTP/1.0" 202 Accepted 2026-04-15 04:44:47,429 - lava_callback - INFO - Starting async job submit for node 69dc74bc5dbfa74e32f99983 2026-04-15 04:44:47,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,444 - lava_callback - DEBUG - Processing node 69dc74bc5dbfa74e32f99983: baseline-arm-baylibre 2026-04-15 04:44:47,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74bc5dbfa74e32f99983 2026-04-15 04:44:47,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:44:47,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:44:47,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74bc5dbfa74e32f99983 HTTP/1.1" 200 None 2026-04-15 04:44:47,492 - lava_callback - ERROR - Error processing callback for node 69dc74bc5dbfa74e32f99983: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:45:07,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:07,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:45:47,768 - lava_callback - INFO - Received callback for node 69dc74f55dbfa74e32f999b2 INFO: 172.21.0.1:51276 - "POST /node/69dc74f55dbfa74e32f999b2 HTTP/1.0" 202 Accepted 2026-04-15 04:45:47,774 - lava_callback - INFO - Starting async job submit for node 69dc74f55dbfa74e32f999b2 2026-04-15 04:45:47,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,789 - lava_callback - DEBUG - Processing node 69dc74f55dbfa74e32f999b2: baseline-arm-baylibre 2026-04-15 04:45:47,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc74f55dbfa74e32f999b2 2026-04-15 04:45:47,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:45:47,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:45:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc74f55dbfa74e32f999b2 HTTP/1.1" 200 None 2026-04-15 04:45:47,841 - lava_callback - ERROR - Error processing callback for node 69dc74f55dbfa74e32f999b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:46:27,543 - lava_callback - INFO - Received callback for node 69dc75165dbfa74e32f999c1 INFO: 172.21.0.1:33842 - "POST /node/69dc75165dbfa74e32f999c1 HTTP/1.0" 202 Accepted 2026-04-15 04:46:27,549 - lava_callback - INFO - Starting async job submit for node 69dc75165dbfa74e32f999c1 2026-04-15 04:46:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,566 - lava_callback - DEBUG - Processing node 69dc75165dbfa74e32f999c1: baseline-arm-baylibre 2026-04-15 04:46:27,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75165dbfa74e32f999c1 2026-04-15 04:46:27,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:46:27,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:46:27,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75165dbfa74e32f999c1 HTTP/1.1" 200 None 2026-04-15 04:46:27,641 - lava_callback - ERROR - Error processing callback for node 69dc75165dbfa74e32f999c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:48:17,554 - lava_callback - INFO - Received callback for node 69dc75895dbfa74e32f99a2d INFO: 172.21.0.1:47270 - "POST /node/69dc75895dbfa74e32f99a2d HTTP/1.0" 202 Accepted 2026-04-15 04:48:17,559 - lava_callback - INFO - Starting async job submit for node 69dc75895dbfa74e32f99a2d 2026-04-15 04:48:17,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,575 - lava_callback - DEBUG - Processing node 69dc75895dbfa74e32f99a2d: baseline-arm-clabbe 2026-04-15 04:48:17,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75895dbfa74e32f99a2d 2026-04-15 04:48:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:48:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:17,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75895dbfa74e32f99a2d HTTP/1.1" 200 None 2026-04-15 04:48:17,627 - lava_callback - ERROR - Error processing callback for node 69dc75895dbfa74e32f99a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:48:57,500 - lava_callback - INFO - Received callback for node 69dc75ac5dbfa74e32f99a61 INFO: 172.21.0.1:44126 - "POST /node/69dc75ac5dbfa74e32f99a61 HTTP/1.0" 202 Accepted 2026-04-15 04:48:57,506 - lava_callback - INFO - Starting async job submit for node 69dc75ac5dbfa74e32f99a61 2026-04-15 04:48:57,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,526 - lava_callback - DEBUG - Processing node 69dc75ac5dbfa74e32f99a61: baseline-arm-clabbe 2026-04-15 04:48:57,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75ac5dbfa74e32f99a61 2026-04-15 04:48:57,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:48:57,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:48:57,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75ac5dbfa74e32f99a61 HTTP/1.1" 200 None 2026-04-15 04:48:57,583 - lava_callback - ERROR - Error processing callback for node 69dc75ac5dbfa74e32f99a61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:34,436 - lava_callback - INFO - Received callback for node 69df1713f490930782fbd5e9 INFO: 172.21.0.1:39138 - "POST /node/69df1713f490930782fbd5e9 HTTP/1.0" 202 Accepted 2026-04-15 04:49:34,443 - lava_callback - INFO - Starting async job submit for node 69df1713f490930782fbd5e9 2026-04-15 04:49:34,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:34,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:34,686 - lava_callback - DEBUG - Processing node 69df1713f490930782fbd5e9: baseline-arm64 2026-04-15 04:49:35,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/log.txt.gz 2026-04-15 04:49:35,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/lava-logs.yaml 2026-04-15 04:49:35,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 04:49:35,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 04:49:35,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df1713f490930782fbd5e9/lava_callback.json.gz DEBUG: Setup failed for 69df1713f490930782fbd5e9. Transitting job node result: incomplete -> fail 2026-04-15 04:49:35,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:35,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 04:49:35,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:35,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1713f490930782fbd5e9 HTTP/1.1" 200 None 2026-04-15 04:49:36,058 - lava_callback - INFO - Completed processing callback for node 69df1713f490930782fbd5e9 INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:37,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:37,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:49:57,644 - lava_callback - INFO - Received callback for node 69dc75e75dbfa74e32f99a8c INFO: 172.21.0.1:48812 - "POST /node/69dc75e75dbfa74e32f99a8c HTTP/1.0" 202 Accepted 2026-04-15 04:49:57,650 - lava_callback - INFO - Starting async job submit for node 69dc75e75dbfa74e32f99a8c 2026-04-15 04:49:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,667 - lava_callback - DEBUG - Processing node 69dc75e75dbfa74e32f99a8c: baseline-arm-clabbe 2026-04-15 04:49:57,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc75e75dbfa74e32f99a8c 2026-04-15 04:49:57,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:49:57,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:49:57,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc75e75dbfa74e32f99a8c HTTP/1.1" 200 None 2026-04-15 04:49:57,720 - lava_callback - ERROR - Error processing callback for node 69dc75e75dbfa74e32f99a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:50:37,555 - lava_callback - INFO - Received callback for node 69dc76095dbfa74e32f99a9e INFO: 172.21.0.1:47804 - "POST /node/69dc76095dbfa74e32f99a9e HTTP/1.0" 202 Accepted 2026-04-15 04:50:37,561 - lava_callback - INFO - Starting async job submit for node 69dc76095dbfa74e32f99a9e 2026-04-15 04:50:37,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,588 - lava_callback - DEBUG - Processing node 69dc76095dbfa74e32f99a9e: baseline-arm-clabbe 2026-04-15 04:50:37,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76095dbfa74e32f99a9e 2026-04-15 04:50:37,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:50:37,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:37,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76095dbfa74e32f99a9e HTTP/1.1" 200 None 2026-04-15 04:50:37,648 - lava_callback - ERROR - Error processing callback for node 69dc76095dbfa74e32f99a9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:50:57,615 - lava_callback - INFO - Received callback for node 69dc762b5dbfa74e32f99abc INFO: 172.21.0.1:51600 - "POST /node/69dc762b5dbfa74e32f99abc HTTP/1.0" 202 Accepted 2026-04-15 04:50:57,621 - lava_callback - INFO - Starting async job submit for node 69dc762b5dbfa74e32f99abc 2026-04-15 04:50:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,648 - lava_callback - DEBUG - Processing node 69dc762b5dbfa74e32f99abc: baseline-arm-clabbe 2026-04-15 04:50:57,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc762b5dbfa74e32f99abc 2026-04-15 04:50:57,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:50:57,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:50:57,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc762b5dbfa74e32f99abc HTTP/1.1" 200 None 2026-04-15 04:50:57,702 - lava_callback - ERROR - Error processing callback for node 69dc762b5dbfa74e32f99abc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43708 - "GET /node/698ff21176d4b6342e9db945%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:51:37,601 - lava_callback - INFO - Received callback for node 69dc764a5dbfa74e32f99afa INFO: 172.21.0.1:34434 - "POST /node/69dc764a5dbfa74e32f99afa HTTP/1.0" 202 Accepted 2026-04-15 04:51:37,607 - lava_callback - INFO - Starting async job submit for node 69dc764a5dbfa74e32f99afa 2026-04-15 04:51:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,625 - lava_callback - DEBUG - Processing node 69dc764a5dbfa74e32f99afa: baseline-arm-clabbe 2026-04-15 04:51:37,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc764a5dbfa74e32f99afa 2026-04-15 04:51:37,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:51:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:37,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc764a5dbfa74e32f99afa HTTP/1.1" 200 None 2026-04-15 04:51:37,673 - lava_callback - ERROR - Error processing callback for node 69dc764a5dbfa74e32f99afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:51:57,644 - lava_callback - INFO - Received callback for node 69dc76675dbfa74e32f99b32 INFO: 172.21.0.1:40452 - "POST /node/69dc76675dbfa74e32f99b32 HTTP/1.0" 202 Accepted 2026-04-15 04:51:57,649 - lava_callback - INFO - Starting async job submit for node 69dc76675dbfa74e32f99b32 2026-04-15 04:51:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,665 - lava_callback - DEBUG - Processing node 69dc76675dbfa74e32f99b32: baseline-arm-clabbe 2026-04-15 04:51:57,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76675dbfa74e32f99b32 2026-04-15 04:51:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:51:57,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:51:57,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76675dbfa74e32f99b32 HTTP/1.1" 200 None 2026-04-15 04:51:57,713 - lava_callback - ERROR - Error processing callback for node 69dc76675dbfa74e32f99b32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:52:37,652 - lava_callback - INFO - Received callback for node 69dc76865dbfa74e32f99b5a INFO: 172.21.0.1:39552 - "POST /node/69dc76865dbfa74e32f99b5a HTTP/1.0" 202 Accepted 2026-04-15 04:52:37,657 - lava_callback - INFO - Starting async job submit for node 69dc76865dbfa74e32f99b5a 2026-04-15 04:52:37,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,673 - lava_callback - DEBUG - Processing node 69dc76865dbfa74e32f99b5a: baseline-arm-clabbe 2026-04-15 04:52:37,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76865dbfa74e32f99b5a 2026-04-15 04:52:37,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:52:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:37,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76865dbfa74e32f99b5a HTTP/1.1" 200 None 2026-04-15 04:52:37,734 - lava_callback - ERROR - Error processing callback for node 69dc76865dbfa74e32f99b5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK 2026-04-15 04:52:57,652 - lava_callback - INFO - Received callback for node 69dc76a65dbfa74e32f99b81 INFO: 172.21.0.1:41452 - "POST /node/69dc76a65dbfa74e32f99b81 HTTP/1.0" 202 Accepted 2026-04-15 04:52:57,658 - lava_callback - INFO - Starting async job submit for node 69dc76a65dbfa74e32f99b81 2026-04-15 04:52:57,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,673 - lava_callback - DEBUG - Processing node 69dc76a65dbfa74e32f99b81: baseline-arm-clabbe 2026-04-15 04:52:57,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc76a65dbfa74e32f99b81 2026-04-15 04:52:57,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 04:52:57,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 04:52:57,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc76a65dbfa74e32f99b81 HTTP/1.1" 200 None 2026-04-15 04:52:57,725 - lava_callback - ERROR - Error processing callback for node 69dc76a65dbfa74e32f99b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET /node/698e2af8952a14bf500e41a1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET /node/69d05ed5d2be3e1cf2a5acf4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET /node/693f044124745582e399741a%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 05:00:08,625 - lava_callback - INFO - Received callback for node 69dc78435dbfa74e32f99bcd INFO: 172.21.0.1:34974 - "POST /node/69dc78435dbfa74e32f99bcd HTTP/1.0" 202 Accepted 2026-04-15 05:00:08,630 - lava_callback - INFO - Starting async job submit for node 69dc78435dbfa74e32f99bcd 2026-04-15 05:00:08,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,664 - lava_callback - DEBUG - Processing node 69dc78435dbfa74e32f99bcd: baseline-arm-baylibre 2026-04-15 05:00:08,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc78435dbfa74e32f99bcd 2026-04-15 05:00:08,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:00:08,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:08,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc78435dbfa74e32f99bcd HTTP/1.1" 200 None 2026-04-15 05:00:08,712 - lava_callback - ERROR - Error processing callback for node 69dc78435dbfa74e32f99bcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53898 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:00:28,295 - lava_callback - INFO - Received callback for node 69dc78675dbfa74e32f99bf0 INFO: 172.21.0.1:53900 - "POST /node/69dc78675dbfa74e32f99bf0 HTTP/1.0" 202 Accepted 2026-04-15 05:00:28,301 - lava_callback - INFO - Starting async job submit for node 69dc78675dbfa74e32f99bf0 2026-04-15 05:00:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,316 - lava_callback - DEBUG - Processing node 69dc78675dbfa74e32f99bf0: baseline-arm-baylibre 2026-04-15 05:00:28,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc78675dbfa74e32f99bf0 2026-04-15 05:00:28,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:00:28,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:00:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc78675dbfa74e32f99bf0 HTTP/1.1" 200 None 2026-04-15 05:00:28,369 - lava_callback - ERROR - Error processing callback for node 69dc78675dbfa74e32f99bf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET /node/69d0cfe5691bac272b3234c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49120 - "GET /node/6988c5b59fc35f969e1eeba6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:01:28,358 - lava_callback - INFO - Received callback for node 69dc789e5dbfa74e32f99c0e INFO: 172.21.0.1:52974 - "POST /node/69dc789e5dbfa74e32f99c0e HTTP/1.0" 202 Accepted 2026-04-15 05:01:28,364 - lava_callback - INFO - Starting async job submit for node 69dc789e5dbfa74e32f99c0e 2026-04-15 05:01:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,379 - lava_callback - DEBUG - Processing node 69dc789e5dbfa74e32f99c0e: baseline-arm-baylibre 2026-04-15 05:01:28,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc789e5dbfa74e32f99c0e 2026-04-15 05:01:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:01:28,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:01:28,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc789e5dbfa74e32f99c0e HTTP/1.1" 200 None 2026-04-15 05:01:28,446 - lava_callback - ERROR - Error processing callback for node 69dc789e5dbfa74e32f99c0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET /node/6986fd4d6e077e4126a7d842%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:02:51,460 - lava_callback - INFO - Received callback for node 69df1761f490930782fbd653 INFO: 172.21.0.1:40296 - "POST /node/69df1761f490930782fbd653 HTTP/1.0" 202 Accepted 2026-04-15 05:02:51,469 - lava_callback - INFO - Starting async job submit for node 69df1761f490930782fbd653 2026-04-15 05:02:51,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:51,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:51,532 - lava_callback - DEBUG - Processing node 69df1761f490930782fbd653: baseline-nfs-arm64 2026-04-15 05:02:52,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:52,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:52,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/log.txt.gz 2026-04-15 05:02:53,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:53,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:53,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/lava-logs.yaml 2026-04-15 05:02:53,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:02:53,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:02:53,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df1761f490930782fbd653/lava_callback.json.gz DEBUG: Setup failed for 69df1761f490930782fbd653. Transitting job node result: incomplete -> fail 2026-04-15 05:02:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:54,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:02:54,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:02:54,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1761f490930782fbd653 HTTP/1.1" 200 None 2026-04-15 05:02:54,171 - lava_callback - INFO - Completed processing callback for node 69df1761f490930782fbd653 INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:07,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:18,260 - lava_callback - INFO - Received callback for node 69dc79075dbfa74e32f99c2b INFO: 172.21.0.1:47792 - "POST /node/69dc79075dbfa74e32f99c2b HTTP/1.0" 202 Accepted 2026-04-15 05:03:18,266 - lava_callback - INFO - Starting async job submit for node 69dc79075dbfa74e32f99c2b 2026-04-15 05:03:18,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,282 - lava_callback - DEBUG - Processing node 69dc79075dbfa74e32f99c2b: baseline-arm-clabbe 2026-04-15 05:03:18,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79075dbfa74e32f99c2b 2026-04-15 05:03:18,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:03:18,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:18,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79075dbfa74e32f99c2b HTTP/1.1" 200 None 2026-04-15 05:03:18,339 - lava_callback - ERROR - Error processing callback for node 69dc79075dbfa74e32f99c2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:03:58,198 - lava_callback - INFO - Received callback for node 69dc792f5dbfa74e32f99c4d INFO: 172.21.0.1:48750 - "POST /node/69dc792f5dbfa74e32f99c4d HTTP/1.0" 202 Accepted 2026-04-15 05:03:58,204 - lava_callback - INFO - Starting async job submit for node 69dc792f5dbfa74e32f99c4d 2026-04-15 05:03:58,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,220 - lava_callback - DEBUG - Processing node 69dc792f5dbfa74e32f99c4d: baseline-arm-clabbe 2026-04-15 05:03:58,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc792f5dbfa74e32f99c4d 2026-04-15 05:03:58,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:03:58,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:03:58,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc792f5dbfa74e32f99c4d HTTP/1.1" 200 None 2026-04-15 05:03:58,277 - lava_callback - ERROR - Error processing callback for node 69dc792f5dbfa74e32f99c4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57500 - "GET /node/6910c3b4699dbc4cda8e1caf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:28,553 - lava_callback - INFO - Received callback for node 69dc794e5dbfa74e32f99c5b INFO: 172.21.0.1:38304 - "POST /node/69dc794e5dbfa74e32f99c5b HTTP/1.0" 202 Accepted 2026-04-15 05:04:28,558 - lava_callback - INFO - Starting async job submit for node 69dc794e5dbfa74e32f99c5b 2026-04-15 05:04:28,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,574 - lava_callback - DEBUG - Processing node 69dc794e5dbfa74e32f99c5b: baseline-arm-baylibre 2026-04-15 05:04:28,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc794e5dbfa74e32f99c5b 2026-04-15 05:04:28,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:04:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:28,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc794e5dbfa74e32f99c5b HTTP/1.1" 200 None 2026-04-15 05:04:28,631 - lava_callback - ERROR - Error processing callback for node 69dc794e5dbfa74e32f99c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 05:04:32,820 - lava_callback - INFO - Received callback for node 69df17adf490930782fbd69a INFO: 172.21.0.1:60422 - "POST /node/69df17adf490930782fbd69a HTTP/1.0" 202 Accepted 2026-04-15 05:04:32,828 - lava_callback - INFO - Starting async job submit for node 69df17adf490930782fbd69a 2026-04-15 05:04:32,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:32,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:32,896 - lava_callback - DEBUG - Processing node 69df17adf490930782fbd69a: baseline-nfs-arm64 2026-04-15 05:04:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/log.txt.gz 2026-04-15 05:04:34,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/lava-logs.yaml 2026-04-15 05:04:34,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:04:34,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:04:34,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df17adf490930782fbd69a/lava_callback.json.gz DEBUG: Setup failed for 69df17adf490930782fbd69a. Transitting job node result: incomplete -> fail 2026-04-15 05:04:35,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:35,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:04:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:35,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df17adf490930782fbd69a HTTP/1.1" 200 None 2026-04-15 05:04:35,194 - lava_callback - INFO - Completed processing callback for node 69df17adf490930782fbd69a INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:37,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:37,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:04:58,270 - lava_callback - INFO - Received callback for node 69dc79725dbfa74e32f99c75 INFO: 172.21.0.1:44704 - "POST /node/69dc79725dbfa74e32f99c75 HTTP/1.0" 202 Accepted 2026-04-15 05:04:58,276 - lava_callback - INFO - Starting async job submit for node 69dc79725dbfa74e32f99c75 2026-04-15 05:04:58,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,304 - lava_callback - DEBUG - Processing node 69dc79725dbfa74e32f99c75: baseline-arm-clabbe 2026-04-15 05:04:58,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79725dbfa74e32f99c75 2026-04-15 05:04:58,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:04:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:04:58,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79725dbfa74e32f99c75 HTTP/1.1" 200 None 2026-04-15 05:04:58,356 - lava_callback - ERROR - Error processing callback for node 69dc79725dbfa74e32f99c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:05:38,278 - lava_callback - INFO - Received callback for node 69dc79965dbfa74e32f99c9f INFO: 172.21.0.1:47864 - "POST /node/69dc79965dbfa74e32f99c9f HTTP/1.0" 202 Accepted 2026-04-15 05:05:38,284 - lava_callback - INFO - Starting async job submit for node 69dc79965dbfa74e32f99c9f 2026-04-15 05:05:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,345 - lava_callback - DEBUG - Processing node 69dc79965dbfa74e32f99c9f: baseline-arm-clabbe 2026-04-15 05:05:38,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79965dbfa74e32f99c9f 2026-04-15 05:05:38,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:05:38,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:05:38,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79965dbfa74e32f99c9f HTTP/1.1" 200 None 2026-04-15 05:05:38,392 - lava_callback - ERROR - Error processing callback for node 69dc79965dbfa74e32f99c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:06:18,342 - lava_callback - INFO - Received callback for node 69dc79b75dbfa74e32f99cc9 INFO: 172.21.0.1:40666 - "POST /node/69dc79b75dbfa74e32f99cc9 HTTP/1.0" 202 Accepted 2026-04-15 05:06:18,348 - lava_callback - INFO - Starting async job submit for node 69dc79b75dbfa74e32f99cc9 2026-04-15 05:06:18,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,372 - lava_callback - DEBUG - Processing node 69dc79b75dbfa74e32f99cc9: baseline-arm-clabbe 2026-04-15 05:06:18,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79b75dbfa74e32f99cc9 2026-04-15 05:06:18,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:06:18,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:18,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79b75dbfa74e32f99cc9 HTTP/1.1" 200 None 2026-04-15 05:06:18,437 - lava_callback - ERROR - Error processing callback for node 69dc79b75dbfa74e32f99cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:06:38,288 - lava_callback - INFO - Received callback for node 69dc79db5dbfa74e32f99cd6 INFO: 172.21.0.1:40366 - "POST /node/69dc79db5dbfa74e32f99cd6 HTTP/1.0" 202 Accepted 2026-04-15 05:06:38,294 - lava_callback - INFO - Starting async job submit for node 69dc79db5dbfa74e32f99cd6 2026-04-15 05:06:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,310 - lava_callback - DEBUG - Processing node 69dc79db5dbfa74e32f99cd6: baseline-arm-clabbe 2026-04-15 05:06:38,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79db5dbfa74e32f99cd6 2026-04-15 05:06:38,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:06:38,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:06:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79db5dbfa74e32f99cd6 HTTP/1.1" 200 None 2026-04-15 05:06:38,359 - lava_callback - ERROR - Error processing callback for node 69dc79db5dbfa74e32f99cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:07:08,688 - lava_callback - INFO - Received callback for node 69dc79f95dbfa74e32f99cfc INFO: 172.21.0.1:36234 - "POST /node/69dc79f95dbfa74e32f99cfc HTTP/1.0" 202 Accepted 2026-04-15 05:07:08,693 - lava_callback - INFO - Starting async job submit for node 69dc79f95dbfa74e32f99cfc 2026-04-15 05:07:08,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,710 - lava_callback - DEBUG - Processing node 69dc79f95dbfa74e32f99cfc: baseline-arm-baylibre 2026-04-15 05:07:08,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc79f95dbfa74e32f99cfc 2026-04-15 05:07:08,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:07:08,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:08,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc79f95dbfa74e32f99cfc HTTP/1.1" 200 None 2026-04-15 05:07:08,766 - lava_callback - ERROR - Error processing callback for node 69dc79f95dbfa74e32f99cfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /node/6910a8f88b15debe9dd52c61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:07:58,411 - lava_callback - INFO - Received callback for node 69dc7a1f5dbfa74e32f99d1c INFO: 172.21.0.1:57716 - "POST /node/69dc7a1f5dbfa74e32f99d1c HTTP/1.0" 202 Accepted 2026-04-15 05:07:58,417 - lava_callback - INFO - Starting async job submit for node 69dc7a1f5dbfa74e32f99d1c 2026-04-15 05:07:58,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,440 - lava_callback - DEBUG - Processing node 69dc7a1f5dbfa74e32f99d1c: baseline-arm-clabbe 2026-04-15 05:07:58,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a1f5dbfa74e32f99d1c 2026-04-15 05:07:58,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:07:58,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:07:58,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a1f5dbfa74e32f99d1c HTTP/1.1" 200 None 2026-04-15 05:07:58,495 - lava_callback - ERROR - Error processing callback for node 69dc7a1f5dbfa74e32f99d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:08:28,765 - lava_callback - INFO - Received callback for node 69dc7a405dbfa74e32f99d2f INFO: 172.21.0.1:57002 - "POST /node/69dc7a405dbfa74e32f99d2f HTTP/1.0" 202 Accepted 2026-04-15 05:08:28,771 - lava_callback - INFO - Starting async job submit for node 69dc7a405dbfa74e32f99d2f 2026-04-15 05:08:28,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,798 - lava_callback - DEBUG - Processing node 69dc7a405dbfa74e32f99d2f: baseline-arm-baylibre 2026-04-15 05:08:28,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a405dbfa74e32f99d2f 2026-04-15 05:08:28,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:08:28,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:28,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a405dbfa74e32f99d2f HTTP/1.1" 200 None 2026-04-15 05:08:28,845 - lava_callback - ERROR - Error processing callback for node 69dc7a405dbfa74e32f99d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:08:58,453 - lava_callback - INFO - Received callback for node 69dc7a615dbfa74e32f99d44 INFO: 172.21.0.1:38250 - "POST /node/69dc7a615dbfa74e32f99d44 HTTP/1.0" 202 Accepted 2026-04-15 05:08:58,460 - lava_callback - INFO - Starting async job submit for node 69dc7a615dbfa74e32f99d44 2026-04-15 05:08:58,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,480 - lava_callback - DEBUG - Processing node 69dc7a615dbfa74e32f99d44: baseline-arm-clabbe 2026-04-15 05:08:58,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a615dbfa74e32f99d44 2026-04-15 05:08:58,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:08:58,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:08:58,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a615dbfa74e32f99d44 HTTP/1.1" 200 None 2026-04-15 05:08:58,538 - lava_callback - ERROR - Error processing callback for node 69dc7a615dbfa74e32f99d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:09:28,769 - lava_callback - INFO - Received callback for node 69dc7a825dbfa74e32f99d6c INFO: 172.21.0.1:47600 - "POST /node/69dc7a825dbfa74e32f99d6c HTTP/1.0" 202 Accepted 2026-04-15 05:09:28,775 - lava_callback - INFO - Starting async job submit for node 69dc7a825dbfa74e32f99d6c 2026-04-15 05:09:28,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,791 - lava_callback - DEBUG - Processing node 69dc7a825dbfa74e32f99d6c: baseline-arm-baylibre 2026-04-15 05:09:28,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7a825dbfa74e32f99d6c 2026-04-15 05:09:28,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:09:28,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:28,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7a825dbfa74e32f99d6c HTTP/1.1" 200 None 2026-04-15 05:09:28,866 - lava_callback - ERROR - Error processing callback for node 69dc7a825dbfa74e32f99d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:09:58,543 - lava_callback - INFO - Received callback for node 69dc7aa35dbfa74e32f99d93 INFO: 172.21.0.1:36520 - "POST /node/69dc7aa35dbfa74e32f99d93 HTTP/1.0" 202 Accepted 2026-04-15 05:09:58,548 - lava_callback - INFO - Starting async job submit for node 69dc7aa35dbfa74e32f99d93 2026-04-15 05:09:58,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,564 - lava_callback - DEBUG - Processing node 69dc7aa35dbfa74e32f99d93: baseline-arm-clabbe 2026-04-15 05:09:58,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7aa35dbfa74e32f99d93 2026-04-15 05:09:58,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:09:58,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:09:58,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7aa35dbfa74e32f99d93 HTTP/1.1" 200 None 2026-04-15 05:09:58,625 - lava_callback - ERROR - Error processing callback for node 69dc7aa35dbfa74e32f99d93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:10:38,507 - lava_callback - INFO - Received callback for node 69dc7ac75dbfa74e32f99da0 INFO: 172.21.0.1:40578 - "POST /node/69dc7ac75dbfa74e32f99da0 HTTP/1.0" 202 Accepted 2026-04-15 05:10:38,513 - lava_callback - INFO - Starting async job submit for node 69dc7ac75dbfa74e32f99da0 2026-04-15 05:10:38,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,528 - lava_callback - DEBUG - Processing node 69dc7ac75dbfa74e32f99da0: baseline-arm-clabbe 2026-04-15 05:10:38,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7ac75dbfa74e32f99da0 2026-04-15 05:10:38,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:10:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:10:38,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7ac75dbfa74e32f99da0 HTTP/1.1" 200 None 2026-04-15 05:10:38,595 - lava_callback - ERROR - Error processing callback for node 69dc7ac75dbfa74e32f99da0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:11:18,592 - lava_callback - INFO - Received callback for node 69dc7aee5dbfa74e32f99db3 INFO: 172.21.0.1:46528 - "POST /node/69dc7aee5dbfa74e32f99db3 HTTP/1.0" 202 Accepted 2026-04-15 05:11:18,599 - lava_callback - INFO - Starting async job submit for node 69dc7aee5dbfa74e32f99db3 2026-04-15 05:11:18,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,619 - lava_callback - DEBUG - Processing node 69dc7aee5dbfa74e32f99db3: baseline-arm-clabbe 2026-04-15 05:11:18,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7aee5dbfa74e32f99db3 2026-04-15 05:11:18,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:11:18,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:18,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7aee5dbfa74e32f99db3 HTTP/1.1" 200 None 2026-04-15 05:11:18,720 - lava_callback - ERROR - Error processing callback for node 69dc7aee5dbfa74e32f99db3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:11:58,588 - lava_callback - INFO - Received callback for node 69dc7b125dbfa74e32f99dc6 INFO: 172.21.0.1:58016 - "POST /node/69dc7b125dbfa74e32f99dc6 HTTP/1.0" 202 Accepted 2026-04-15 05:11:58,594 - lava_callback - INFO - Starting async job submit for node 69dc7b125dbfa74e32f99dc6 2026-04-15 05:11:58,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,610 - lava_callback - DEBUG - Processing node 69dc7b125dbfa74e32f99dc6: baseline-arm-clabbe 2026-04-15 05:11:58,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b125dbfa74e32f99dc6 2026-04-15 05:11:58,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:11:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:11:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b125dbfa74e32f99dc6 HTTP/1.1" 200 None 2026-04-15 05:11:58,663 - lava_callback - ERROR - Error processing callback for node 69dc7b125dbfa74e32f99dc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET /node/693f095b24745582e39985bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:12:58,659 - lava_callback - INFO - Received callback for node 69dc7b4e5dbfa74e32f99deb INFO: 172.21.0.1:35262 - "POST /node/69dc7b4e5dbfa74e32f99deb HTTP/1.0" 202 Accepted 2026-04-15 05:12:58,665 - lava_callback - INFO - Starting async job submit for node 69dc7b4e5dbfa74e32f99deb 2026-04-15 05:12:58,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,681 - lava_callback - DEBUG - Processing node 69dc7b4e5dbfa74e32f99deb: baseline-arm-clabbe 2026-04-15 05:12:58,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b4e5dbfa74e32f99deb 2026-04-15 05:12:58,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:12:58,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:12:58,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b4e5dbfa74e32f99deb HTTP/1.1" 200 None 2026-04-15 05:12:58,754 - lava_callback - ERROR - Error processing callback for node 69dc7b4e5dbfa74e32f99deb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:13:49,055 - lava_callback - INFO - Received callback for node 69dc7b885dbfa74e32f99e0a INFO: 172.21.0.1:33988 - "POST /node/69dc7b885dbfa74e32f99e0a HTTP/1.0" 202 Accepted 2026-04-15 05:13:49,061 - lava_callback - INFO - Starting async job submit for node 69dc7b885dbfa74e32f99e0a 2026-04-15 05:13:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,085 - lava_callback - DEBUG - Processing node 69dc7b885dbfa74e32f99e0a: baseline-arm-baylibre 2026-04-15 05:13:49,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7b885dbfa74e32f99e0a 2026-04-15 05:13:49,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:13:49,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:13:49,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7b885dbfa74e32f99e0a HTTP/1.1" 200 None 2026-04-15 05:13:49,149 - lava_callback - ERROR - Error processing callback for node 69dc7b885dbfa74e32f99e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:14:38,670 - lava_callback - INFO - Received callback for node 69dc7bac5dbfa74e32f99e16 INFO: 172.21.0.1:41560 - "POST /node/69dc7bac5dbfa74e32f99e16 HTTP/1.0" 202 Accepted 2026-04-15 05:14:38,676 - lava_callback - INFO - Starting async job submit for node 69dc7bac5dbfa74e32f99e16 2026-04-15 05:14:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,693 - lava_callback - DEBUG - Processing node 69dc7bac5dbfa74e32f99e16: baseline-arm-clabbe 2026-04-15 05:14:38,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bac5dbfa74e32f99e16 2026-04-15 05:14:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:14:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:38,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bac5dbfa74e32f99e16 HTTP/1.1" 200 None 2026-04-15 05:14:38,745 - lava_callback - ERROR - Error processing callback for node 69dc7bac5dbfa74e32f99e16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:14:58,652 - lava_callback - INFO - Received callback for node 69dc7bcc5dbfa74e32f99e4e INFO: 172.21.0.1:56566 - "POST /node/69dc7bcc5dbfa74e32f99e4e HTTP/1.0" 202 Accepted 2026-04-15 05:14:58,658 - lava_callback - INFO - Starting async job submit for node 69dc7bcc5dbfa74e32f99e4e 2026-04-15 05:14:58,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,688 - lava_callback - DEBUG - Processing node 69dc7bcc5dbfa74e32f99e4e: baseline-arm-clabbe 2026-04-15 05:14:58,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bcc5dbfa74e32f99e4e 2026-04-15 05:14:58,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:14:58,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:14:58,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bcc5dbfa74e32f99e4e HTTP/1.1" 200 None 2026-04-15 05:14:58,748 - lava_callback - ERROR - Error processing callback for node 69dc7bcc5dbfa74e32f99e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:15:29,216 - lava_callback - INFO - Received callback for node 69dc7bed5dbfa74e32f99e61 INFO: 172.21.0.1:33632 - "POST /node/69dc7bed5dbfa74e32f99e61 HTTP/1.0" 202 Accepted 2026-04-15 05:15:29,221 - lava_callback - INFO - Starting async job submit for node 69dc7bed5dbfa74e32f99e61 2026-04-15 05:15:29,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,237 - lava_callback - DEBUG - Processing node 69dc7bed5dbfa74e32f99e61: baseline-arm-baylibre 2026-04-15 05:15:29,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7bed5dbfa74e32f99e61 2026-04-15 05:15:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:15:29,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:15:29,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7bed5dbfa74e32f99e61 HTTP/1.1" 200 None 2026-04-15 05:15:29,535 - lava_callback - ERROR - Error processing callback for node 69dc7bed5dbfa74e32f99e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:16:09,125 - lava_callback - INFO - Received callback for node 69dc7c125dbfa74e32f99e6d INFO: 172.21.0.1:35618 - "POST /node/69dc7c125dbfa74e32f99e6d HTTP/1.0" 202 Accepted 2026-04-15 05:16:09,131 - lava_callback - INFO - Starting async job submit for node 69dc7c125dbfa74e32f99e6d 2026-04-15 05:16:09,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,147 - lava_callback - DEBUG - Processing node 69dc7c125dbfa74e32f99e6d: baseline-arm-baylibre 2026-04-15 05:16:09,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c125dbfa74e32f99e6d 2026-04-15 05:16:09,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:16:09,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c125dbfa74e32f99e6d HTTP/1.1" 200 None 2026-04-15 05:16:09,205 - lava_callback - ERROR - Error processing callback for node 69dc7c125dbfa74e32f99e6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:16:58,812 - lava_callback - INFO - Received callback for node 69dc7c3f5dbfa74e32f99e7f INFO: 172.21.0.1:45356 - "POST /node/69dc7c3f5dbfa74e32f99e7f HTTP/1.0" 202 Accepted 2026-04-15 05:16:58,817 - lava_callback - INFO - Starting async job submit for node 69dc7c3f5dbfa74e32f99e7f 2026-04-15 05:16:58,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,833 - lava_callback - DEBUG - Processing node 69dc7c3f5dbfa74e32f99e7f: baseline-arm-clabbe 2026-04-15 05:16:58,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c3f5dbfa74e32f99e7f 2026-04-15 05:16:58,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:16:58,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:16:58,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c3f5dbfa74e32f99e7f HTTP/1.1" 200 None 2026-04-15 05:16:58,923 - lava_callback - ERROR - Error processing callback for node 69dc7c3f5dbfa74e32f99e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:17:38,764 - lava_callback - INFO - Received callback for node 69dc7c645dbfa74e32f99e8c INFO: 172.21.0.1:38576 - "POST /node/69dc7c645dbfa74e32f99e8c HTTP/1.0" 202 Accepted 2026-04-15 05:17:38,770 - lava_callback - INFO - Starting async job submit for node 69dc7c645dbfa74e32f99e8c 2026-04-15 05:17:38,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,821 - lava_callback - DEBUG - Processing node 69dc7c645dbfa74e32f99e8c: baseline-arm-clabbe 2026-04-15 05:17:38,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c645dbfa74e32f99e8c 2026-04-15 05:17:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:17:38,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:17:38,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c645dbfa74e32f99e8c HTTP/1.1" 200 None 2026-04-15 05:17:38,877 - lava_callback - ERROR - Error processing callback for node 69dc7c645dbfa74e32f99e8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:18:09,292 - lava_callback - INFO - Received callback for node 69dc7c825dbfa74e32f99eaa INFO: 172.21.0.1:43132 - "POST /node/69dc7c825dbfa74e32f99eaa HTTP/1.0" 202 Accepted 2026-04-15 05:18:09,297 - lava_callback - INFO - Starting async job submit for node 69dc7c825dbfa74e32f99eaa 2026-04-15 05:18:09,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,324 - lava_callback - DEBUG - Processing node 69dc7c825dbfa74e32f99eaa: baseline-arm-baylibre 2026-04-15 05:18:09,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7c825dbfa74e32f99eaa 2026-04-15 05:18:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:18:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:09,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7c825dbfa74e32f99eaa HTTP/1.1" 200 None 2026-04-15 05:18:09,381 - lava_callback - ERROR - Error processing callback for node 69dc7c825dbfa74e32f99eaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:18:59,299 - lava_callback - INFO - Received callback for node 69dc7cb75dbfa74e32f99ecc INFO: 172.21.0.1:41982 - "POST /node/69dc7cb75dbfa74e32f99ecc HTTP/1.0" 202 Accepted 2026-04-15 05:18:59,305 - lava_callback - INFO - Starting async job submit for node 69dc7cb75dbfa74e32f99ecc 2026-04-15 05:18:59,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,323 - lava_callback - DEBUG - Processing node 69dc7cb75dbfa74e32f99ecc: baseline-arm-clabbe 2026-04-15 05:18:59,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cb75dbfa74e32f99ecc 2026-04-15 05:18:59,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:18:59,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:18:59,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cb75dbfa74e32f99ecc HTTP/1.1" 200 None 2026-04-15 05:18:59,375 - lava_callback - ERROR - Error processing callback for node 69dc7cb75dbfa74e32f99ecc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:19:18,774 - lava_callback - INFO - Received callback for node 69dc7cd45dbfa74e32f99edb INFO: 172.21.0.1:37396 - "POST /node/69dc7cd45dbfa74e32f99edb HTTP/1.0" 202 Accepted 2026-04-15 05:19:18,780 - lava_callback - INFO - Starting async job submit for node 69dc7cd45dbfa74e32f99edb 2026-04-15 05:19:18,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,804 - lava_callback - DEBUG - Processing node 69dc7cd45dbfa74e32f99edb: baseline-arm-clabbe 2026-04-15 05:19:18,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cd45dbfa74e32f99edb 2026-04-15 05:19:18,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:19:18,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:18,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cd45dbfa74e32f99edb HTTP/1.1" 200 None 2026-04-15 05:19:18,877 - lava_callback - ERROR - Error processing callback for node 69dc7cd45dbfa74e32f99edb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:19:58,845 - lava_callback - INFO - Received callback for node 69dc7cf85dbfa74e32f99f1c INFO: 172.21.0.1:58558 - "POST /node/69dc7cf85dbfa74e32f99f1c HTTP/1.0" 202 Accepted 2026-04-15 05:19:58,851 - lava_callback - INFO - Starting async job submit for node 69dc7cf85dbfa74e32f99f1c 2026-04-15 05:19:58,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,867 - lava_callback - DEBUG - Processing node 69dc7cf85dbfa74e32f99f1c: baseline-arm-clabbe 2026-04-15 05:19:58,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7cf85dbfa74e32f99f1c 2026-04-15 05:19:58,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:19:58,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:19:58,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7cf85dbfa74e32f99f1c HTTP/1.1" 200 None 2026-04-15 05:19:58,917 - lava_callback - ERROR - Error processing callback for node 69dc7cf85dbfa74e32f99f1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:20:58,912 - lava_callback - INFO - Received callback for node 69dc7d305dbfa74e32f99f3c INFO: 172.21.0.1:37940 - "POST /node/69dc7d305dbfa74e32f99f3c HTTP/1.0" 202 Accepted 2026-04-15 05:20:58,918 - lava_callback - INFO - Starting async job submit for node 69dc7d305dbfa74e32f99f3c 2026-04-15 05:20:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,944 - lava_callback - DEBUG - Processing node 69dc7d305dbfa74e32f99f3c: baseline-arm-clabbe 2026-04-15 05:20:58,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7d305dbfa74e32f99f3c 2026-04-15 05:20:58,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:20:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:20:58,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7d305dbfa74e32f99f3c HTTP/1.1" 200 None 2026-04-15 05:20:58,993 - lava_callback - ERROR - Error processing callback for node 69dc7d305dbfa74e32f99f3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:21:38,875 - lava_callback - INFO - Received callback for node 69dc7d4f5dbfa74e32f99f46 INFO: 172.21.0.1:59632 - "POST /node/69dc7d4f5dbfa74e32f99f46 HTTP/1.0" 202 Accepted 2026-04-15 05:21:38,881 - lava_callback - INFO - Starting async job submit for node 69dc7d4f5dbfa74e32f99f46 2026-04-15 05:21:38,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:38,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:38,940 - lava_callback - DEBUG - Processing node 69dc7d4f5dbfa74e32f99f46: baseline-arm-clabbe 2026-04-15 05:21:38,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7d4f5dbfa74e32f99f46 2026-04-15 05:21:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:38,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:39,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:21:39,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:21:39,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7d4f5dbfa74e32f99f46 HTTP/1.1" 200 None 2026-04-15 05:21:39,049 - lava_callback - ERROR - Error processing callback for node 69dc7d4f5dbfa74e32f99f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:22:58,985 - lava_callback - INFO - Received callback for node 69dc7da85dbfa74e32f99f99 INFO: 172.21.0.1:39878 - "POST /node/69dc7da85dbfa74e32f99f99 HTTP/1.0" 202 Accepted 2026-04-15 05:22:58,991 - lava_callback - INFO - Starting async job submit for node 69dc7da85dbfa74e32f99f99 2026-04-15 05:22:58,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,007 - lava_callback - DEBUG - Processing node 69dc7da85dbfa74e32f99f99: baseline-arm-clabbe 2026-04-15 05:22:59,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7da85dbfa74e32f99f99 2026-04-15 05:22:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:22:59,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:22:59,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7da85dbfa74e32f99f99 HTTP/1.1" 200 None 2026-04-15 05:22:59,054 - lava_callback - ERROR - Error processing callback for node 69dc7da85dbfa74e32f99f99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:23:59,068 - lava_callback - INFO - Received callback for node 69dc7de45dbfa74e32f99fab INFO: 172.21.0.1:38906 - "POST /node/69dc7de45dbfa74e32f99fab HTTP/1.0" 202 Accepted 2026-04-15 05:23:59,074 - lava_callback - INFO - Starting async job submit for node 69dc7de45dbfa74e32f99fab 2026-04-15 05:23:59,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,090 - lava_callback - DEBUG - Processing node 69dc7de45dbfa74e32f99fab: baseline-arm-clabbe 2026-04-15 05:23:59,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7de45dbfa74e32f99fab 2026-04-15 05:23:59,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:23:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:23:59,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7de45dbfa74e32f99fab HTTP/1.1" 200 None 2026-04-15 05:23:59,137 - lava_callback - ERROR - Error processing callback for node 69dc7de45dbfa74e32f99fab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:24:59,072 - lava_callback - INFO - Received callback for node 69dc7e205dbfa74e32f99fcc INFO: 172.21.0.1:43302 - "POST /node/69dc7e205dbfa74e32f99fcc HTTP/1.0" 202 Accepted 2026-04-15 05:24:59,080 - lava_callback - INFO - Starting async job submit for node 69dc7e205dbfa74e32f99fcc 2026-04-15 05:24:59,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,098 - lava_callback - DEBUG - Processing node 69dc7e205dbfa74e32f99fcc: baseline-arm-clabbe 2026-04-15 05:24:59,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e205dbfa74e32f99fcc 2026-04-15 05:24:59,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:24:59,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:24:59,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e205dbfa74e32f99fcc HTTP/1.1" 200 None 2026-04-15 05:24:59,146 - lava_callback - ERROR - Error processing callback for node 69dc7e205dbfa74e32f99fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:25:59,150 - lava_callback - INFO - Received callback for node 69dc7e5c5dbfa74e32f99ffd INFO: 172.21.0.1:38228 - "POST /node/69dc7e5c5dbfa74e32f99ffd HTTP/1.0" 202 Accepted 2026-04-15 05:25:59,156 - lava_callback - INFO - Starting async job submit for node 69dc7e5c5dbfa74e32f99ffd 2026-04-15 05:25:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,172 - lava_callback - DEBUG - Processing node 69dc7e5c5dbfa74e32f99ffd: baseline-arm-clabbe 2026-04-15 05:25:59,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e5c5dbfa74e32f99ffd 2026-04-15 05:25:59,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:25:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:25:59,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e5c5dbfa74e32f99ffd HTTP/1.1" 200 None 2026-04-15 05:25:59,241 - lava_callback - ERROR - Error processing callback for node 69dc7e5c5dbfa74e32f99ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:26:59,191 - lava_callback - INFO - Received callback for node 69dc7e995dbfa74e32f9a022 INFO: 172.21.0.1:53692 - "POST /node/69dc7e995dbfa74e32f9a022 HTTP/1.0" 202 Accepted 2026-04-15 05:26:59,197 - lava_callback - INFO - Starting async job submit for node 69dc7e995dbfa74e32f9a022 2026-04-15 05:26:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,236 - lava_callback - DEBUG - Processing node 69dc7e995dbfa74e32f9a022: baseline-arm-clabbe 2026-04-15 05:26:59,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7e995dbfa74e32f9a022 2026-04-15 05:26:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-15 05:26:59,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:26:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7e995dbfa74e32f9a022 HTTP/1.1" 200 None 2026-04-15 05:26:59,303 - lava_callback - ERROR - Error processing callback for node 69dc7e995dbfa74e32f9a022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:30:50,079 - lava_callback - INFO - Received callback for node 69dc7f755dbfa74e32f9a03e INFO: 172.21.0.1:52748 - "POST /node/69dc7f755dbfa74e32f9a03e HTTP/1.0" 202 Accepted 2026-04-15 05:30:50,084 - lava_callback - INFO - Starting async job submit for node 69dc7f755dbfa74e32f9a03e 2026-04-15 05:30:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,102 - lava_callback - DEBUG - Processing node 69dc7f755dbfa74e32f9a03e: baseline-arm64-baylibre 2026-04-15 05:30:50,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7f755dbfa74e32f9a03e 2026-04-15 05:30:50,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:30:50,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:30:50,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7f755dbfa74e32f9a03e HTTP/1.1" 200 None 2026-04-15 05:30:50,184 - lava_callback - ERROR - Error processing callback for node 69dc7f755dbfa74e32f9a03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:10,121 - lava_callback - INFO - Received callback for node 69dc7fc55dbfa74e32f9a08d INFO: 172.21.0.1:33324 - "POST /node/69dc7fc55dbfa74e32f9a08d HTTP/1.0" 202 Accepted 2026-04-15 05:32:10,127 - lava_callback - INFO - Starting async job submit for node 69dc7fc55dbfa74e32f9a08d 2026-04-15 05:32:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,144 - lava_callback - DEBUG - Processing node 69dc7fc55dbfa74e32f9a08d: baseline-arm64-baylibre 2026-04-15 05:32:10,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc7fc55dbfa74e32f9a08d 2026-04-15 05:32:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:32:10,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:10,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc7fc55dbfa74e32f9a08d HTTP/1.1" 200 None 2026-04-15 05:32:10,205 - lava_callback - ERROR - Error processing callback for node 69dc7fc55dbfa74e32f9a08d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:16,763 - lava_callback - INFO - Received callback for node 69de8fa0f6535ffd5b3ef3a4 INFO: 172.21.0.1:33364 - "POST /node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.0" 202 Accepted 2026-04-15 05:32:16,769 - lava_callback - INFO - Starting async job submit for node 69de8fa0f6535ffd5b3ef3a4 2026-04-15 05:32:16,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:16,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:16,835 - lava_callback - DEBUG - Processing node 69de8fa0f6535ffd5b3ef3a4: baseline-arm64-broonie 2026-04-15 05:32:17,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,206 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/log.txt.gz 2026-04-15 05:32:17,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/lava-logs.yaml 2026-04-15 05:32:17,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:17,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:17,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69de8fa0f6535ffd5b3ef3a4/lava_callback.json.gz 2026-04-15 05:32:17,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:17,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 05:32:17,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8fa0f6535ffd5b3ef3a4 HTTP/1.1" 200 None 2026-04-15 05:32:17,789 - lava_callback - INFO - Completed processing callback for node 69de8fa0f6535ffd5b3ef3a4 2026-04-15 05:32:18,308 - lava_callback - INFO - Received callback for node 69dea1047a8aab7fee69d785 INFO: 172.21.0.1:33366 - "POST /node/69dea1047a8aab7fee69d785 HTTP/1.0" 202 Accepted 2026-04-15 05:32:18,317 - lava_callback - INFO - Starting async job submit for node 69dea1047a8aab7fee69d785 2026-04-15 05:32:18,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:18,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:18,357 - lava_callback - DEBUG - Processing node 69dea1047a8aab7fee69d785: baseline-arm64-broonie 2026-04-15 05:32:18,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:18,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:18,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/log.txt.gz 2026-04-15 05:32:18,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:19,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:19,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/lava-logs.yaml 2026-04-15 05:32:19,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:32:19,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:32:19,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dea1047a8aab7fee69d785/lava_callback.json.gz 2026-04-15 05:32:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:19,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 05:32:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:19,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dea1047a8aab7fee69d785 HTTP/1.1" 200 None 2026-04-15 05:32:19,265 - lava_callback - INFO - Completed processing callback for node 69dea1047a8aab7fee69d785 INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:32:37,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:32:37,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:10,141 - lava_callback - INFO - Received callback for node 69dc800b5dbfa74e32f9a0d3 INFO: 172.21.0.1:36734 - "POST /node/69dc800b5dbfa74e32f9a0d3 HTTP/1.0" 202 Accepted 2026-04-15 05:33:10,146 - lava_callback - INFO - Starting async job submit for node 69dc800b5dbfa74e32f9a0d3 2026-04-15 05:33:10,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,164 - lava_callback - DEBUG - Processing node 69dc800b5dbfa74e32f9a0d3: baseline-arm64-baylibre 2026-04-15 05:33:10,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc800b5dbfa74e32f9a0d3 2026-04-15 05:33:10,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:33:10,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:10,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc800b5dbfa74e32f9a0d3 HTTP/1.1" 200 None 2026-04-15 05:33:10,215 - lava_callback - ERROR - Error processing callback for node 69dc800b5dbfa74e32f9a0d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:36,699 - lava_callback - INFO - Received callback for node 69defc31f490930782fbba9c INFO: 172.21.0.1:50834 - "POST /node/69defc31f490930782fbba9c HTTP/1.0" 202 Accepted 2026-04-15 05:33:36,705 - lava_callback - INFO - Starting async job submit for node 69defc31f490930782fbba9c 2026-04-15 05:33:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:36,751 - lava_callback - DEBUG - Processing node 69defc31f490930782fbba9c: baseline-arm64-broonie 2026-04-15 05:33:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/log.txt.gz 2026-04-15 05:33:37,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/lava-logs.yaml 2026-04-15 05:33:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:37,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:37,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69defc31f490930782fbba9c/lava_callback.json.gz 2026-04-15 05:33:37,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:37,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 05:33:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defc31f490930782fbba9c HTTP/1.1" 200 None 2026-04-15 05:33:37,651 - lava_callback - INFO - Completed processing callback for node 69defc31f490930782fbba9c 2026-04-15 05:33:37,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:37,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:33:57,520 - lava_callback - INFO - Received callback for node 69dee86df490930782fba3ea INFO: 172.21.0.1:46166 - "POST /node/69dee86df490930782fba3ea HTTP/1.0" 202 Accepted 2026-04-15 05:33:57,526 - lava_callback - INFO - Starting async job submit for node 69dee86df490930782fba3ea 2026-04-15 05:33:57,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:57,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:57,578 - lava_callback - DEBUG - Processing node 69dee86df490930782fba3ea: baseline-arm64-broonie 2026-04-15 05:33:57,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:57,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:57,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/log.txt.gz 2026-04-15 05:33:58,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:58,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:58,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/lava-logs.yaml 2026-04-15 05:33:58,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:33:58,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:33:58,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dee86df490930782fba3ea/lava_callback.json.gz 2026-04-15 05:33:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:58,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 05:33:58,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:33:58,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dee86df490930782fba3ea HTTP/1.1" 200 None 2026-04-15 05:33:58,530 - lava_callback - INFO - Completed processing callback for node 69dee86df490930782fba3ea INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:19,420 - lava_callback - INFO - Received callback for node 69dc80575dbfa74e32f9a111 INFO: 172.21.0.1:56042 - "POST /node/69dc80575dbfa74e32f9a111 HTTP/1.0" 202 Accepted 2026-04-15 05:34:19,428 - lava_callback - INFO - Starting async job submit for node 69dc80575dbfa74e32f9a111 2026-04-15 05:34:19,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,446 - lava_callback - DEBUG - Processing node 69dc80575dbfa74e32f9a111: baseline-arm64-clabbe 2026-04-15 05:34:19,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80575dbfa74e32f9a111 2026-04-15 05:34:19,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:34:19,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:19,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80575dbfa74e32f9a111 HTTP/1.1" 200 None 2026-04-15 05:34:19,506 - lava_callback - ERROR - Error processing callback for node 69dc80575dbfa74e32f9a111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:34:56,696 - lava_callback - INFO - Received callback for node 69df0364f490930782fbc2ac INFO: 172.21.0.1:45176 - "POST /node/69df0364f490930782fbc2ac HTTP/1.0" 202 Accepted 2026-04-15 05:34:56,702 - lava_callback - INFO - Starting async job submit for node 69df0364f490930782fbc2ac 2026-04-15 05:34:56,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:56,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:56,744 - lava_callback - DEBUG - Processing node 69df0364f490930782fbc2ac: baseline-arm64-broonie 2026-04-15 05:34:56,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/log.txt.gz 2026-04-15 05:34:57,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/lava-logs.yaml 2026-04-15 05:34:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 05:34:57,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 05:34:57,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df0364f490930782fbc2ac/lava_callback.json.gz 2026-04-15 05:34:57,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:57,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 05:34:57,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:34:57,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df0364f490930782fbc2ac HTTP/1.1" 200 None 2026-04-15 05:34:57,861 - lava_callback - INFO - Completed processing callback for node 69df0364f490930782fbc2ac INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:35:08,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:35:59,493 - lava_callback - INFO - Received callback for node 69dc80aa5dbfa74e32f9a183 INFO: 172.21.0.1:39808 - "POST /node/69dc80aa5dbfa74e32f9a183 HTTP/1.0" 202 Accepted 2026-04-15 05:35:59,499 - lava_callback - INFO - Starting async job submit for node 69dc80aa5dbfa74e32f9a183 2026-04-15 05:35:59,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,526 - lava_callback - DEBUG - Processing node 69dc80aa5dbfa74e32f9a183: baseline-arm64-clabbe 2026-04-15 05:35:59,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80aa5dbfa74e32f9a183 2026-04-15 05:35:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:35:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:35:59,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80aa5dbfa74e32f9a183 HTTP/1.1" 200 None 2026-04-15 05:35:59,587 - lava_callback - ERROR - Error processing callback for node 69dc80aa5dbfa74e32f9a183: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:36:59,530 - lava_callback - INFO - Received callback for node 69dc80ef5dbfa74e32f9a1c6 INFO: 172.21.0.1:44838 - "POST /node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.0" 202 Accepted 2026-04-15 05:36:59,536 - lava_callback - INFO - Starting async job submit for node 69dc80ef5dbfa74e32f9a1c6 2026-04-15 05:36:59,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,583 - lava_callback - DEBUG - Processing node 69dc80ef5dbfa74e32f9a1c6: baseline-arm64-clabbe 2026-04-15 05:36:59,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc80ef5dbfa74e32f9a1c6 2026-04-15 05:36:59,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:36:59,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:36:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc80ef5dbfa74e32f9a1c6 HTTP/1.1" 200 None 2026-04-15 05:36:59,656 - lava_callback - ERROR - Error processing callback for node 69dc80ef5dbfa74e32f9a1c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:38:19,622 - lava_callback - INFO - Received callback for node 69dc81355dbfa74e32f9a22e INFO: 172.21.0.1:52202 - "POST /node/69dc81355dbfa74e32f9a22e HTTP/1.0" 202 Accepted 2026-04-15 05:38:19,628 - lava_callback - INFO - Starting async job submit for node 69dc81355dbfa74e32f9a22e 2026-04-15 05:38:19,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,651 - lava_callback - DEBUG - Processing node 69dc81355dbfa74e32f9a22e: baseline-arm64-clabbe 2026-04-15 05:38:19,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc81355dbfa74e32f9a22e 2026-04-15 05:38:19,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:38:19,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:38:19,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc81355dbfa74e32f9a22e HTTP/1.1" 200 None 2026-04-15 05:38:19,703 - lava_callback - ERROR - Error processing callback for node 69dc81355dbfa74e32f9a22e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:39:19,601 - lava_callback - INFO - Received callback for node 69dc817e5dbfa74e32f9a25f INFO: 172.21.0.1:53630 - "POST /node/69dc817e5dbfa74e32f9a25f HTTP/1.0" 202 Accepted 2026-04-15 05:39:19,607 - lava_callback - INFO - Starting async job submit for node 69dc817e5dbfa74e32f9a25f 2026-04-15 05:39:19,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,623 - lava_callback - DEBUG - Processing node 69dc817e5dbfa74e32f9a25f: baseline-arm64-clabbe 2026-04-15 05:39:19,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc817e5dbfa74e32f9a25f 2026-04-15 05:39:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:39:19,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:39:19,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc817e5dbfa74e32f9a25f HTTP/1.1" 200 None 2026-04-15 05:39:19,675 - lava_callback - ERROR - Error processing callback for node 69dc817e5dbfa74e32f9a25f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:40:39,717 - lava_callback - INFO - Received callback for node 69dc81cb5dbfa74e32f9a2ac INFO: 172.21.0.1:34598 - "POST /node/69dc81cb5dbfa74e32f9a2ac HTTP/1.0" 202 Accepted 2026-04-15 05:40:39,723 - lava_callback - INFO - Starting async job submit for node 69dc81cb5dbfa74e32f9a2ac 2026-04-15 05:40:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,739 - lava_callback - DEBUG - Processing node 69dc81cb5dbfa74e32f9a2ac: baseline-arm64-clabbe 2026-04-15 05:40:39,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc81cb5dbfa74e32f9a2ac 2026-04-15 05:40:39,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:40:39,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:40:39,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc81cb5dbfa74e32f9a2ac HTTP/1.1" 200 None 2026-04-15 05:40:39,800 - lava_callback - ERROR - Error processing callback for node 69dc81cb5dbfa74e32f9a2ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:42:59,820 - lava_callback - INFO - Received callback for node 69dc82525dbfa74e32f9a34a INFO: 172.21.0.1:45750 - "POST /node/69dc82525dbfa74e32f9a34a HTTP/1.0" 202 Accepted 2026-04-15 05:42:59,826 - lava_callback - INFO - Starting async job submit for node 69dc82525dbfa74e32f9a34a 2026-04-15 05:42:59,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,843 - lava_callback - DEBUG - Processing node 69dc82525dbfa74e32f9a34a: baseline-arm64-clabbe 2026-04-15 05:42:59,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc82525dbfa74e32f9a34a 2026-04-15 05:42:59,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 05:42:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:42:59,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc82525dbfa74e32f9a34a HTTP/1.1" 200 None 2026-04-15 05:42:59,899 - lava_callback - ERROR - Error processing callback for node 69dc82525dbfa74e32f9a34a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:47:51,028 - lava_callback - INFO - Received callback for node 69dc83725dbfa74e32f9a458 INFO: 172.21.0.1:53690 - "POST /node/69dc83725dbfa74e32f9a458 HTTP/1.0" 202 Accepted 2026-04-15 05:47:51,034 - lava_callback - INFO - Starting async job submit for node 69dc83725dbfa74e32f9a458 2026-04-15 05:47:51,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,052 - lava_callback - DEBUG - Processing node 69dc83725dbfa74e32f9a458: baseline-arm64-baylibre 2026-04-15 05:47:51,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83725dbfa74e32f9a458 2026-04-15 05:47:51,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:47:51,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:47:51,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83725dbfa74e32f9a458 HTTP/1.1" 200 None 2026-04-15 05:47:51,110 - lava_callback - ERROR - Error processing callback for node 69dc83725dbfa74e32f9a458: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:48:51,017 - lava_callback - INFO - Received callback for node 69dc83b15dbfa74e32f9a4b7 INFO: 172.21.0.1:55194 - "POST /node/69dc83b15dbfa74e32f9a4b7 HTTP/1.0" 202 Accepted 2026-04-15 05:48:51,022 - lava_callback - INFO - Starting async job submit for node 69dc83b15dbfa74e32f9a4b7 2026-04-15 05:48:51,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,038 - lava_callback - DEBUG - Processing node 69dc83b15dbfa74e32f9a4b7: baseline-arm64-baylibre 2026-04-15 05:48:51,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83b15dbfa74e32f9a4b7 2026-04-15 05:48:51,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:48:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:48:51,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83b15dbfa74e32f9a4b7 HTTP/1.1" 200 None 2026-04-15 05:48:51,087 - lava_callback - ERROR - Error processing callback for node 69dc83b15dbfa74e32f9a4b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:49:51,101 - lava_callback - INFO - Received callback for node 69dc83f45dbfa74e32f9a501 INFO: 172.21.0.1:52868 - "POST /node/69dc83f45dbfa74e32f9a501 HTTP/1.0" 202 Accepted 2026-04-15 05:49:51,107 - lava_callback - INFO - Starting async job submit for node 69dc83f45dbfa74e32f9a501 2026-04-15 05:49:51,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,124 - lava_callback - DEBUG - Processing node 69dc83f45dbfa74e32f9a501: baseline-arm64-baylibre 2026-04-15 05:49:51,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc83f45dbfa74e32f9a501 2026-04-15 05:49:51,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:49:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:49:51,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc83f45dbfa74e32f9a501 HTTP/1.1" 200 None 2026-04-15 05:49:51,184 - lava_callback - ERROR - Error processing callback for node 69dc83f45dbfa74e32f9a501: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:50:51,143 - lava_callback - INFO - Received callback for node 69dc84375dbfa74e32f9a544 INFO: 172.21.0.1:52328 - "POST /node/69dc84375dbfa74e32f9a544 HTTP/1.0" 202 Accepted 2026-04-15 05:50:51,149 - lava_callback - INFO - Starting async job submit for node 69dc84375dbfa74e32f9a544 2026-04-15 05:50:51,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,167 - lava_callback - DEBUG - Processing node 69dc84375dbfa74e32f9a544: baseline-arm64-baylibre 2026-04-15 05:50:51,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc84375dbfa74e32f9a544 2026-04-15 05:50:51,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:50:51,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:50:51,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc84375dbfa74e32f9a544 HTTP/1.1" 200 None 2026-04-15 05:50:51,214 - lava_callback - ERROR - Error processing callback for node 69dc84375dbfa74e32f9a544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:52:11,266 - lava_callback - INFO - Received callback for node 69dc847e5dbfa74e32f9a5a4 INFO: 172.21.0.1:35480 - "POST /node/69dc847e5dbfa74e32f9a5a4 HTTP/1.0" 202 Accepted 2026-04-15 05:52:11,272 - lava_callback - INFO - Starting async job submit for node 69dc847e5dbfa74e32f9a5a4 2026-04-15 05:52:11,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,289 - lava_callback - DEBUG - Processing node 69dc847e5dbfa74e32f9a5a4: baseline-arm64-baylibre 2026-04-15 05:52:11,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc847e5dbfa74e32f9a5a4 2026-04-15 05:52:11,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:52:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:52:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc847e5dbfa74e32f9a5a4 HTTP/1.1" 200 None 2026-04-15 05:52:11,337 - lava_callback - ERROR - Error processing callback for node 69dc847e5dbfa74e32f9a5a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:53:11,319 - lava_callback - INFO - Received callback for node 69dc84bb5dbfa74e32f9a610 INFO: 172.21.0.1:42574 - "POST /node/69dc84bb5dbfa74e32f9a610 HTTP/1.0" 202 Accepted 2026-04-15 05:53:11,328 - lava_callback - INFO - Starting async job submit for node 69dc84bb5dbfa74e32f9a610 2026-04-15 05:53:11,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,345 - lava_callback - DEBUG - Processing node 69dc84bb5dbfa74e32f9a610: baseline-arm64-baylibre 2026-04-15 05:53:11,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc84bb5dbfa74e32f9a610 2026-04-15 05:53:11,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:53:11,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:53:11,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc84bb5dbfa74e32f9a610 HTTP/1.1" 200 None 2026-04-15 05:53:11,410 - lava_callback - ERROR - Error processing callback for node 69dc84bb5dbfa74e32f9a610: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:54:20,323 - lava_callback - INFO - Received callback for node 69dc85085dbfa74e32f9a642 INFO: 172.21.0.1:43394 - "POST /node/69dc85085dbfa74e32f9a642 HTTP/1.0" 202 Accepted 2026-04-15 05:54:20,329 - lava_callback - INFO - Starting async job submit for node 69dc85085dbfa74e32f9a642 2026-04-15 05:54:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,349 - lava_callback - DEBUG - Processing node 69dc85085dbfa74e32f9a642: baseline-arm64-clabbe 2026-04-15 05:54:20,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85085dbfa74e32f9a642 2026-04-15 05:54:20,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:54:20,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:54:20,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85085dbfa74e32f9a642 HTTP/1.1" 200 None 2026-04-15 05:54:20,397 - lava_callback - ERROR - Error processing callback for node 69dc85085dbfa74e32f9a642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:55:40,325 - lava_callback - INFO - Received callback for node 69dc854f5dbfa74e32f9a678 INFO: 172.21.0.1:38700 - "POST /node/69dc854f5dbfa74e32f9a678 HTTP/1.0" 202 Accepted 2026-04-15 05:55:40,331 - lava_callback - INFO - Starting async job submit for node 69dc854f5dbfa74e32f9a678 2026-04-15 05:55:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,347 - lava_callback - DEBUG - Processing node 69dc854f5dbfa74e32f9a678: baseline-arm64-clabbe 2026-04-15 05:55:40,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc854f5dbfa74e32f9a678 2026-04-15 05:55:40,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:55:40,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:55:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc854f5dbfa74e32f9a678 HTTP/1.1" 200 None 2026-04-15 05:55:40,400 - lava_callback - ERROR - Error processing callback for node 69dc854f5dbfa74e32f9a678: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:56:40,405 - lava_callback - INFO - Received callback for node 69dc85915dbfa74e32f9a6d3 INFO: 172.21.0.1:49100 - "POST /node/69dc85915dbfa74e32f9a6d3 HTTP/1.0" 202 Accepted 2026-04-15 05:56:40,411 - lava_callback - INFO - Starting async job submit for node 69dc85915dbfa74e32f9a6d3 2026-04-15 05:56:40,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,427 - lava_callback - DEBUG - Processing node 69dc85915dbfa74e32f9a6d3: baseline-arm64-clabbe 2026-04-15 05:56:40,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85915dbfa74e32f9a6d3 2026-04-15 05:56:40,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:56:40,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:56:40,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85915dbfa74e32f9a6d3 HTTP/1.1" 200 None 2026-04-15 05:56:40,485 - lava_callback - ERROR - Error processing callback for node 69dc85915dbfa74e32f9a6d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:58:20,462 - lava_callback - INFO - Received callback for node 69dc85ed5dbfa74e32f9a71c INFO: 172.21.0.1:49992 - "POST /node/69dc85ed5dbfa74e32f9a71c HTTP/1.0" 202 Accepted 2026-04-15 05:58:20,468 - lava_callback - INFO - Starting async job submit for node 69dc85ed5dbfa74e32f9a71c 2026-04-15 05:58:20,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,484 - lava_callback - DEBUG - Processing node 69dc85ed5dbfa74e32f9a71c: baseline-arm64-clabbe 2026-04-15 05:58:20,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc85ed5dbfa74e32f9a71c 2026-04-15 05:58:20,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:58:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:58:20,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc85ed5dbfa74e32f9a71c HTTP/1.1" 200 None 2026-04-15 05:58:20,545 - lava_callback - ERROR - Error processing callback for node 69dc85ed5dbfa74e32f9a71c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK 2026-04-15 05:59:20,583 - lava_callback - INFO - Received callback for node 69dc86305dbfa74e32f9a771 INFO: 172.21.0.1:38004 - "POST /node/69dc86305dbfa74e32f9a771 HTTP/1.0" 202 Accepted 2026-04-15 05:59:20,589 - lava_callback - INFO - Starting async job submit for node 69dc86305dbfa74e32f9a771 2026-04-15 05:59:20,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,605 - lava_callback - DEBUG - Processing node 69dc86305dbfa74e32f9a771: baseline-arm64-clabbe 2026-04-15 05:59:20,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86305dbfa74e32f9a771 2026-04-15 05:59:20,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 05:59:20,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 05:59:20,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86305dbfa74e32f9a771 HTTP/1.1" 200 None 2026-04-15 05:59:20,656 - lava_callback - ERROR - Error processing callback for node 69dc86305dbfa74e32f9a771: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:00:40,615 - lava_callback - INFO - Received callback for node 69dc86775dbfa74e32f9a7ab INFO: 172.21.0.1:50132 - "POST /node/69dc86775dbfa74e32f9a7ab HTTP/1.0" 202 Accepted 2026-04-15 06:00:40,621 - lava_callback - INFO - Starting async job submit for node 69dc86775dbfa74e32f9a7ab 2026-04-15 06:00:40,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,638 - lava_callback - DEBUG - Processing node 69dc86775dbfa74e32f9a7ab: baseline-arm64-clabbe 2026-04-15 06:00:40,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86775dbfa74e32f9a7ab 2026-04-15 06:00:40,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 06:00:40,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:00:40,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86775dbfa74e32f9a7ab HTTP/1.1" 200 None 2026-04-15 06:00:40,684 - lava_callback - ERROR - Error processing callback for node 69dc86775dbfa74e32f9a7ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:01:40,623 - lava_callback - INFO - Received callback for node 69dc86c15dbfa74e32f9a7ed INFO: 172.21.0.1:44676 - "POST /node/69dc86c15dbfa74e32f9a7ed HTTP/1.0" 202 Accepted 2026-04-15 06:01:40,637 - lava_callback - INFO - Starting async job submit for node 69dc86c15dbfa74e32f9a7ed 2026-04-15 06:01:40,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,672 - lava_callback - DEBUG - Processing node 69dc86c15dbfa74e32f9a7ed: baseline-arm64-clabbe 2026-04-15 06:01:40,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc86c15dbfa74e32f9a7ed 2026-04-15 06:01:40,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 06:01:40,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:01:40,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc86c15dbfa74e32f9a7ed HTTP/1.1" 200 None 2026-04-15 06:01:40,745 - lava_callback - ERROR - Error processing callback for node 69dc86c15dbfa74e32f9a7ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:03:11,832 - lava_callback - INFO - Received callback for node 69dc87115dbfa74e32f9a84e INFO: 172.21.0.1:41798 - "POST /node/69dc87115dbfa74e32f9a84e HTTP/1.0" 202 Accepted 2026-04-15 06:03:11,838 - lava_callback - INFO - Starting async job submit for node 69dc87115dbfa74e32f9a84e 2026-04-15 06:03:11,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,860 - lava_callback - DEBUG - Processing node 69dc87115dbfa74e32f9a84e: baseline-arm64-baylibre 2026-04-15 06:03:11,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87115dbfa74e32f9a84e 2026-04-15 06:03:11,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:03:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:03:11,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87115dbfa74e32f9a84e HTTP/1.1" 200 None 2026-04-15 06:03:11,931 - lava_callback - ERROR - Error processing callback for node 69dc87115dbfa74e32f9a84e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:05:11,933 - lava_callback - INFO - Received callback for node 69dc87895dbfa74e32f9a88a INFO: 172.21.0.1:56420 - "POST /node/69dc87895dbfa74e32f9a88a HTTP/1.0" 202 Accepted 2026-04-15 06:05:11,938 - lava_callback - INFO - Starting async job submit for node 69dc87895dbfa74e32f9a88a 2026-04-15 06:05:11,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:11,956 - lava_callback - DEBUG - Processing node 69dc87895dbfa74e32f9a88a: baseline-arm64-baylibre 2026-04-15 06:05:11,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87895dbfa74e32f9a88a 2026-04-15 06:05:11,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:11,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:11,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:05:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:05:12,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87895dbfa74e32f9a88a HTTP/1.1" 200 None 2026-04-15 06:05:12,011 - lava_callback - ERROR - Error processing callback for node 69dc87895dbfa74e32f9a88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:06:11,922 - lava_callback - INFO - Received callback for node 69dc87d05dbfa74e32f9a8c4 INFO: 172.21.0.1:54634 - "POST /node/69dc87d05dbfa74e32f9a8c4 HTTP/1.0" 202 Accepted 2026-04-15 06:06:11,928 - lava_callback - INFO - Starting async job submit for node 69dc87d05dbfa74e32f9a8c4 2026-04-15 06:06:11,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:11,947 - lava_callback - DEBUG - Processing node 69dc87d05dbfa74e32f9a8c4: baseline-arm64-baylibre 2026-04-15 06:06:11,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc87d05dbfa74e32f9a8c4 2026-04-15 06:06:11,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:11,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:11,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:06:11,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:06:12,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc87d05dbfa74e32f9a8c4 HTTP/1.1" 200 None 2026-04-15 06:06:12,006 - lava_callback - ERROR - Error processing callback for node 69dc87d05dbfa74e32f9a8c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:07:32,045 - lava_callback - INFO - Received callback for node 69dc88135dbfa74e32f9a903 INFO: 172.21.0.1:53878 - "POST /node/69dc88135dbfa74e32f9a903 HTTP/1.0" 202 Accepted 2026-04-15 06:07:32,051 - lava_callback - INFO - Starting async job submit for node 69dc88135dbfa74e32f9a903 2026-04-15 06:07:32,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,074 - lava_callback - DEBUG - Processing node 69dc88135dbfa74e32f9a903: baseline-arm64-baylibre 2026-04-15 06:07:32,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc88135dbfa74e32f9a903 2026-04-15 06:07:32,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:07:32,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:07:32,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc88135dbfa74e32f9a903 HTTP/1.1" 200 None 2026-04-15 06:07:32,139 - lava_callback - ERROR - Error processing callback for node 69dc88135dbfa74e32f9a903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:09:52,177 - lava_callback - INFO - Received callback for node 69dc889b5dbfa74e32f9a9ac INFO: 172.21.0.1:53850 - "POST /node/69dc889b5dbfa74e32f9a9ac HTTP/1.0" 202 Accepted 2026-04-15 06:09:52,183 - lava_callback - INFO - Starting async job submit for node 69dc889b5dbfa74e32f9a9ac 2026-04-15 06:09:52,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,199 - lava_callback - DEBUG - Processing node 69dc889b5dbfa74e32f9a9ac: baseline-arm64-baylibre 2026-04-15 06:09:52,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc889b5dbfa74e32f9a9ac 2026-04-15 06:09:52,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:09:52,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:09:52,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc889b5dbfa74e32f9a9ac HTTP/1.1" 200 None 2026-04-15 06:09:52,256 - lava_callback - ERROR - Error processing callback for node 69dc889b5dbfa74e32f9a9ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:11:12,279 - lava_callback - INFO - Received callback for node 69dc88f55dbfa74e32f9a9e5 INFO: 172.21.0.1:34318 - "POST /node/69dc88f55dbfa74e32f9a9e5 HTTP/1.0" 202 Accepted 2026-04-15 06:11:12,284 - lava_callback - INFO - Starting async job submit for node 69dc88f55dbfa74e32f9a9e5 2026-04-15 06:11:12,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,301 - lava_callback - DEBUG - Processing node 69dc88f55dbfa74e32f9a9e5: baseline-arm64-baylibre 2026-04-15 06:11:12,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc88f55dbfa74e32f9a9e5 2026-04-15 06:11:12,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:11:12,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:11:12,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc88f55dbfa74e32f9a9e5 HTTP/1.1" 200 None 2026-04-15 06:11:12,351 - lava_callback - ERROR - Error processing callback for node 69dc88f55dbfa74e32f9a9e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:12:32,338 - lava_callback - INFO - Received callback for node 69dc893b5dbfa74e32f9aa1e INFO: 172.21.0.1:53980 - "POST /node/69dc893b5dbfa74e32f9aa1e HTTP/1.0" 202 Accepted 2026-04-15 06:12:32,347 - lava_callback - INFO - Starting async job submit for node 69dc893b5dbfa74e32f9aa1e 2026-04-15 06:12:32,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,366 - lava_callback - DEBUG - Processing node 69dc893b5dbfa74e32f9aa1e: baseline-arm64-baylibre 2026-04-15 06:12:32,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc893b5dbfa74e32f9aa1e 2026-04-15 06:12:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:12:32,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:12:32,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc893b5dbfa74e32f9aa1e HTTP/1.1" 200 None 2026-04-15 06:12:32,431 - lava_callback - ERROR - Error processing callback for node 69dc893b5dbfa74e32f9aa1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:13:12,276 - lava_callback - INFO - Received callback for node 69dc89755dbfa74e32f9aa83 INFO: 172.21.0.1:43534 - "POST /node/69dc89755dbfa74e32f9aa83 HTTP/1.0" 202 Accepted 2026-04-15 06:13:12,282 - lava_callback - INFO - Starting async job submit for node 69dc89755dbfa74e32f9aa83 2026-04-15 06:13:12,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,301 - lava_callback - DEBUG - Processing node 69dc89755dbfa74e32f9aa83: baseline-arm64-baylibre 2026-04-15 06:13:12,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc89755dbfa74e32f9aa83 2026-04-15 06:13:12,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-15 06:13:12,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:13:12,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc89755dbfa74e32f9aa83 HTTP/1.1" 200 None 2026-04-15 06:13:12,352 - lava_callback - ERROR - Error processing callback for node 69dc89755dbfa74e32f9aa83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET /node/69876aaee31b58f834f19719%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET /node/6986fe426e077e4126a7dbb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:37:53,769 - lava_callback - INFO - Received callback for node 69dc8f3f5dbfa74e32f9aace INFO: 172.21.0.1:47624 - "POST /node/69dc8f3f5dbfa74e32f9aace HTTP/1.0" 202 Accepted 2026-04-15 06:37:53,774 - lava_callback - INFO - Starting async job submit for node 69dc8f3f5dbfa74e32f9aace 2026-04-15 06:37:53,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,799 - lava_callback - DEBUG - Processing node 69dc8f3f5dbfa74e32f9aace: baseline-arm-baylibre 2026-04-15 06:37:53,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f3f5dbfa74e32f9aace 2026-04-15 06:37:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:37:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:37:53,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f3f5dbfa74e32f9aace HTTP/1.1" 200 None 2026-04-15 06:37:53,854 - lava_callback - ERROR - Error processing callback for node 69dc8f3f5dbfa74e32f9aace: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET /node/6993536e523507f3806a7f05%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:38:53,682 - lava_callback - INFO - Received callback for node 69dc8f795dbfa74e32f9aae1 INFO: 172.21.0.1:35376 - "POST /node/69dc8f795dbfa74e32f9aae1 HTTP/1.0" 202 Accepted 2026-04-15 06:38:53,687 - lava_callback - INFO - Starting async job submit for node 69dc8f795dbfa74e32f9aae1 2026-04-15 06:38:53,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,703 - lava_callback - DEBUG - Processing node 69dc8f795dbfa74e32f9aae1: baseline-arm-baylibre 2026-04-15 06:38:53,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f795dbfa74e32f9aae1 2026-04-15 06:38:53,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:38:53,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:38:53,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f795dbfa74e32f9aae1 HTTP/1.1" 200 None 2026-04-15 06:38:53,761 - lava_callback - ERROR - Error processing callback for node 69dc8f795dbfa74e32f9aae1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET /node/69bd094505e4bbd6ba635697%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:39:33,715 - lava_callback - INFO - Received callback for node 69dc8f985dbfa74e32f9aaec INFO: 172.21.0.1:47732 - "POST /node/69dc8f985dbfa74e32f9aaec HTTP/1.0" 202 Accepted 2026-04-15 06:39:33,724 - lava_callback - INFO - Starting async job submit for node 69dc8f985dbfa74e32f9aaec 2026-04-15 06:39:33,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,746 - lava_callback - DEBUG - Processing node 69dc8f985dbfa74e32f9aaec: baseline-arm-baylibre 2026-04-15 06:39:33,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8f985dbfa74e32f9aaec 2026-04-15 06:39:33,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:39:33,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:39:33,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8f985dbfa74e32f9aaec HTTP/1.1" 200 None 2026-04-15 06:39:33,805 - lava_callback - ERROR - Error processing callback for node 69dc8f985dbfa74e32f9aaec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:40:13,737 - lava_callback - INFO - Received callback for node 69dc8fb85dbfa74e32f9ab21 INFO: 172.21.0.1:53220 - "POST /node/69dc8fb85dbfa74e32f9ab21 HTTP/1.0" 202 Accepted 2026-04-15 06:40:13,742 - lava_callback - INFO - Starting async job submit for node 69dc8fb85dbfa74e32f9ab21 2026-04-15 06:40:13,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,758 - lava_callback - DEBUG - Processing node 69dc8fb85dbfa74e32f9ab21: baseline-arm-baylibre 2026-04-15 06:40:13,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8fb85dbfa74e32f9ab21 2026-04-15 06:40:13,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:40:13,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:13,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8fb85dbfa74e32f9ab21 HTTP/1.1" 200 None 2026-04-15 06:40:13,818 - lava_callback - ERROR - Error processing callback for node 69dc8fb85dbfa74e32f9ab21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /node/693f17d524745582e399b298%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:40:33,708 - lava_callback - INFO - Received callback for node 69dc8fdd5dbfa74e32f9ab46 INFO: 172.21.0.1:59506 - "POST /node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.0" 202 Accepted 2026-04-15 06:40:33,714 - lava_callback - INFO - Starting async job submit for node 69dc8fdd5dbfa74e32f9ab46 2026-04-15 06:40:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,730 - lava_callback - DEBUG - Processing node 69dc8fdd5dbfa74e32f9ab46: baseline-arm-baylibre 2026-04-15 06:40:33,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc8fdd5dbfa74e32f9ab46 2026-04-15 06:40:33,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:40:33,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:40:33,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc8fdd5dbfa74e32f9ab46 HTTP/1.1" 200 None 2026-04-15 06:40:33,777 - lava_callback - ERROR - Error processing callback for node 69dc8fdd5dbfa74e32f9ab46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:42:13,899 - lava_callback - INFO - Received callback for node 69dc903f5dbfa74e32f9abab INFO: 172.21.0.1:37534 - "POST /node/69dc903f5dbfa74e32f9abab HTTP/1.0" 202 Accepted 2026-04-15 06:42:13,905 - lava_callback - INFO - Starting async job submit for node 69dc903f5dbfa74e32f9abab 2026-04-15 06:42:13,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,921 - lava_callback - DEBUG - Processing node 69dc903f5dbfa74e32f9abab: baseline-arm-baylibre 2026-04-15 06:42:13,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc903f5dbfa74e32f9abab 2026-04-15 06:42:13,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:42:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:13,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc903f5dbfa74e32f9abab HTTP/1.1" 200 None 2026-04-15 06:42:13,976 - lava_callback - ERROR - Error processing callback for node 69dc903f5dbfa74e32f9abab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET /node/693f4bdf8b4d8f471e43d2c2%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:42:53,867 - lava_callback - INFO - Received callback for node 69dc905f5dbfa74e32f9abd8 INFO: 172.21.0.1:55314 - "POST /node/69dc905f5dbfa74e32f9abd8 HTTP/1.0" 202 Accepted 2026-04-15 06:42:53,873 - lava_callback - INFO - Starting async job submit for node 69dc905f5dbfa74e32f9abd8 2026-04-15 06:42:53,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,890 - lava_callback - DEBUG - Processing node 69dc905f5dbfa74e32f9abd8: baseline-arm-baylibre 2026-04-15 06:42:53,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc905f5dbfa74e32f9abd8 2026-04-15 06:42:53,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:42:53,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:42:53,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc905f5dbfa74e32f9abd8 HTTP/1.1" 200 None 2026-04-15 06:42:53,968 - lava_callback - ERROR - Error processing callback for node 69dc905f5dbfa74e32f9abd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:43:33,926 - lava_callback - INFO - Received callback for node 69dc90825dbfa74e32f9abf1 INFO: 172.21.0.1:57764 - "POST /node/69dc90825dbfa74e32f9abf1 HTTP/1.0" 202 Accepted 2026-04-15 06:43:33,935 - lava_callback - INFO - Starting async job submit for node 69dc90825dbfa74e32f9abf1 2026-04-15 06:43:33,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:33,952 - lava_callback - DEBUG - Processing node 69dc90825dbfa74e32f9abf1: baseline-arm-baylibre 2026-04-15 06:43:33,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc90825dbfa74e32f9abf1 2026-04-15 06:43:33,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:33,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:33,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:43:33,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc90825dbfa74e32f9abf1 HTTP/1.1" 200 None 2026-04-15 06:43:34,005 - lava_callback - ERROR - Error processing callback for node 69dc90825dbfa74e32f9abf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:43:53,902 - lava_callback - INFO - Received callback for node 69dc90a15dbfa74e32f9ac05 INFO: 172.21.0.1:50688 - "POST /node/69dc90a15dbfa74e32f9ac05 HTTP/1.0" 202 Accepted 2026-04-15 06:43:53,908 - lava_callback - INFO - Starting async job submit for node 69dc90a15dbfa74e32f9ac05 2026-04-15 06:43:53,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,924 - lava_callback - DEBUG - Processing node 69dc90a15dbfa74e32f9ac05: baseline-arm-baylibre 2026-04-15 06:43:53,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc90a15dbfa74e32f9ac05 2026-04-15 06:43:53,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:43:53,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:43:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc90a15dbfa74e32f9ac05 HTTP/1.1" 200 None 2026-04-15 06:43:53,976 - lava_callback - ERROR - Error processing callback for node 69dc90a15dbfa74e32f9ac05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:45:42,536 - lava_callback - INFO - Received callback for node 69dc91075dbfa74e32f9ac57 INFO: 172.21.0.1:39824 - "POST /node/69dc91075dbfa74e32f9ac57 HTTP/1.0" 202 Accepted 2026-04-15 06:45:42,542 - lava_callback - INFO - Starting async job submit for node 69dc91075dbfa74e32f9ac57 2026-04-15 06:45:42,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,558 - lava_callback - DEBUG - Processing node 69dc91075dbfa74e32f9ac57: baseline-arm-clabbe 2026-04-15 06:45:42,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91075dbfa74e32f9ac57 2026-04-15 06:45:42,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:45:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:45:42,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91075dbfa74e32f9ac57 HTTP/1.1" 200 None 2026-04-15 06:45:42,620 - lava_callback - ERROR - Error processing callback for node 69dc91075dbfa74e32f9ac57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:46:14,131 - lava_callback - INFO - Received callback for node 69dc91255dbfa74e32f9ac7b INFO: 172.21.0.1:35526 - "POST /node/69dc91255dbfa74e32f9ac7b HTTP/1.0" 202 Accepted 2026-04-15 06:46:14,136 - lava_callback - INFO - Starting async job submit for node 69dc91255dbfa74e32f9ac7b 2026-04-15 06:46:14,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,152 - lava_callback - DEBUG - Processing node 69dc91255dbfa74e32f9ac7b: baseline-arm-baylibre 2026-04-15 06:46:14,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91255dbfa74e32f9ac7b 2026-04-15 06:46:14,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:46:14,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:14,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91255dbfa74e32f9ac7b HTTP/1.1" 200 None 2026-04-15 06:46:14,207 - lava_callback - ERROR - Error processing callback for node 69dc91255dbfa74e32f9ac7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:46:34,060 - lava_callback - INFO - Received callback for node 69dc91435dbfa74e32f9acaf INFO: 172.21.0.1:35774 - "POST /node/69dc91435dbfa74e32f9acaf HTTP/1.0" 202 Accepted 2026-04-15 06:46:34,065 - lava_callback - INFO - Starting async job submit for node 69dc91435dbfa74e32f9acaf 2026-04-15 06:46:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,082 - lava_callback - DEBUG - Processing node 69dc91435dbfa74e32f9acaf: baseline-arm-baylibre 2026-04-15 06:46:34,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91435dbfa74e32f9acaf 2026-04-15 06:46:34,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:46:34,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:46:34,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91435dbfa74e32f9acaf HTTP/1.1" 200 None 2026-04-15 06:46:34,139 - lava_callback - ERROR - Error processing callback for node 69dc91435dbfa74e32f9acaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET /node/698b8d5f0a16aea5a0dc8dd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET /node/6991f78701ff1e8e0859d3b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40018 - "GET /node/693ae3a2fee8383e92b641aa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET /node/693f58570d8ce4018da8b56f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:48:34,212 - lava_callback - INFO - Received callback for node 69dc91b85dbfa74e32f9ad3c INFO: 172.21.0.1:44814 - "POST /node/69dc91b85dbfa74e32f9ad3c HTTP/1.0" 202 Accepted 2026-04-15 06:48:34,217 - lava_callback - INFO - Starting async job submit for node 69dc91b85dbfa74e32f9ad3c 2026-04-15 06:48:34,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,241 - lava_callback - DEBUG - Processing node 69dc91b85dbfa74e32f9ad3c: baseline-arm-baylibre 2026-04-15 06:48:34,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91b85dbfa74e32f9ad3c 2026-04-15 06:48:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:48:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:48:34,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91b85dbfa74e32f9ad3c HTTP/1.1" 200 None 2026-04-15 06:48:34,297 - lava_callback - ERROR - Error processing callback for node 69dc91b85dbfa74e32f9ad3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:49:14,272 - lava_callback - INFO - Received callback for node 69dc91da5dbfa74e32f9ad76 INFO: 172.21.0.1:50156 - "POST /node/69dc91da5dbfa74e32f9ad76 HTTP/1.0" 202 Accepted 2026-04-15 06:49:14,277 - lava_callback - INFO - Starting async job submit for node 69dc91da5dbfa74e32f9ad76 2026-04-15 06:49:14,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,293 - lava_callback - DEBUG - Processing node 69dc91da5dbfa74e32f9ad76: baseline-arm-baylibre 2026-04-15 06:49:14,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91da5dbfa74e32f9ad76 2026-04-15 06:49:14,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:49:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91da5dbfa74e32f9ad76 HTTP/1.1" 200 None 2026-04-15 06:49:14,357 - lava_callback - ERROR - Error processing callback for node 69dc91da5dbfa74e32f9ad76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:49:42,672 - lava_callback - INFO - Received callback for node 69dc91f75dbfa74e32f9adb5 INFO: 172.21.0.1:36120 - "POST /node/69dc91f75dbfa74e32f9adb5 HTTP/1.0" 202 Accepted 2026-04-15 06:49:42,679 - lava_callback - INFO - Starting async job submit for node 69dc91f75dbfa74e32f9adb5 2026-04-15 06:49:42,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,695 - lava_callback - DEBUG - Processing node 69dc91f75dbfa74e32f9adb5: baseline-arm-clabbe 2026-04-15 06:49:42,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc91f75dbfa74e32f9adb5 2026-04-15 06:49:42,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:49:42,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:49:42,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc91f75dbfa74e32f9adb5 HTTP/1.1" 200 None 2026-04-15 06:49:42,764 - lava_callback - ERROR - Error processing callback for node 69dc91f75dbfa74e32f9adb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36122 - "GET /node/698f87313013abef95d0234c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36130 - "GET /node/6953789e31522df6df79e986%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:50:14,272 - lava_callback - INFO - Received callback for node 69dc92185dbfa74e32f9adc3 INFO: 172.21.0.1:43598 - "POST /node/69dc92185dbfa74e32f9adc3 HTTP/1.0" 202 Accepted 2026-04-15 06:50:14,278 - lava_callback - INFO - Starting async job submit for node 69dc92185dbfa74e32f9adc3 2026-04-15 06:50:14,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,294 - lava_callback - DEBUG - Processing node 69dc92185dbfa74e32f9adc3: baseline-arm-baylibre 2026-04-15 06:50:14,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92185dbfa74e32f9adc3 2026-04-15 06:50:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:50:14,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:14,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92185dbfa74e32f9adc3 HTTP/1.1" 200 None 2026-04-15 06:50:14,364 - lava_callback - ERROR - Error processing callback for node 69dc92185dbfa74e32f9adc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET /node/698f868a3013abef95d02170%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43254 - "GET /node/693e3edf407f32424eb5ce5b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:50:54,345 - lava_callback - INFO - Received callback for node 69dc923c5dbfa74e32f9add2 INFO: 172.21.0.1:41296 - "POST /node/69dc923c5dbfa74e32f9add2 HTTP/1.0" 202 Accepted 2026-04-15 06:50:54,350 - lava_callback - INFO - Starting async job submit for node 69dc923c5dbfa74e32f9add2 2026-04-15 06:50:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,367 - lava_callback - DEBUG - Processing node 69dc923c5dbfa74e32f9add2: baseline-arm-baylibre 2026-04-15 06:50:54,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc923c5dbfa74e32f9add2 2026-04-15 06:50:54,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:50:54,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:50:54,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc923c5dbfa74e32f9add2 HTTP/1.1" 200 None 2026-04-15 06:50:54,428 - lava_callback - ERROR - Error processing callback for node 69dc923c5dbfa74e32f9add2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:51:14,330 - lava_callback - INFO - Received callback for node 69dc925c5dbfa74e32f9adf6 INFO: 172.21.0.1:41634 - "POST /node/69dc925c5dbfa74e32f9adf6 HTTP/1.0" 202 Accepted 2026-04-15 06:51:14,339 - lava_callback - INFO - Starting async job submit for node 69dc925c5dbfa74e32f9adf6 2026-04-15 06:51:14,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,357 - lava_callback - DEBUG - Processing node 69dc925c5dbfa74e32f9adf6: baseline-arm-baylibre 2026-04-15 06:51:14,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc925c5dbfa74e32f9adf6 2026-04-15 06:51:14,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:51:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:51:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc925c5dbfa74e32f9adf6 HTTP/1.1" 200 None 2026-04-15 06:51:14,421 - lava_callback - ERROR - Error processing callback for node 69dc925c5dbfa74e32f9adf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET /node/6992eebe31166481c8dda08c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:52:42,848 - lava_callback - INFO - Received callback for node 69dc92b75dbfa74e32f9ae6b INFO: 172.21.0.1:48352 - "POST /node/69dc92b75dbfa74e32f9ae6b HTTP/1.0" 202 Accepted 2026-04-15 06:52:42,855 - lava_callback - INFO - Starting async job submit for node 69dc92b75dbfa74e32f9ae6b 2026-04-15 06:52:42,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,871 - lava_callback - DEBUG - Processing node 69dc92b75dbfa74e32f9ae6b: baseline-arm-clabbe 2026-04-15 06:52:42,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92b75dbfa74e32f9ae6b 2026-04-15 06:52:42,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:52:42,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:52:42,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92b75dbfa74e32f9ae6b HTTP/1.1" 200 None 2026-04-15 06:52:42,921 - lava_callback - ERROR - Error processing callback for node 69dc92b75dbfa74e32f9ae6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:53:22,782 - lava_callback - INFO - Received callback for node 69dc92d85dbfa74e32f9ae9a INFO: 172.21.0.1:41444 - "POST /node/69dc92d85dbfa74e32f9ae9a HTTP/1.0" 202 Accepted 2026-04-15 06:53:22,788 - lava_callback - INFO - Starting async job submit for node 69dc92d85dbfa74e32f9ae9a 2026-04-15 06:53:22,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,804 - lava_callback - DEBUG - Processing node 69dc92d85dbfa74e32f9ae9a: baseline-arm-clabbe 2026-04-15 06:53:22,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92d85dbfa74e32f9ae9a 2026-04-15 06:53:22,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:53:22,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:53:22,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92d85dbfa74e32f9ae9a HTTP/1.1" 200 None 2026-04-15 06:53:22,860 - lava_callback - ERROR - Error processing callback for node 69dc92d85dbfa74e32f9ae9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41454 - "GET /node/6985ea5671989fb14149cb75%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41460 - "GET /node/69876d86e31b58f834f19d47%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:54:02,886 - lava_callback - INFO - Received callback for node 69dc92fb5dbfa74e32f9aebc INFO: 172.21.0.1:33870 - "POST /node/69dc92fb5dbfa74e32f9aebc HTTP/1.0" 202 Accepted 2026-04-15 06:54:02,891 - lava_callback - INFO - Starting async job submit for node 69dc92fb5dbfa74e32f9aebc 2026-04-15 06:54:02,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,907 - lava_callback - DEBUG - Processing node 69dc92fb5dbfa74e32f9aebc: baseline-arm-clabbe 2026-04-15 06:54:02,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc92fb5dbfa74e32f9aebc 2026-04-15 06:54:02,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:54:02,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:02,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc92fb5dbfa74e32f9aebc HTTP/1.1" 200 None 2026-04-15 06:54:02,970 - lava_callback - ERROR - Error processing callback for node 69dc92fb5dbfa74e32f9aebc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:54:22,815 - lava_callback - INFO - Received callback for node 69dc93185dbfa74e32f9aed2 INFO: 172.21.0.1:59364 - "POST /node/69dc93185dbfa74e32f9aed2 HTTP/1.0" 202 Accepted 2026-04-15 06:54:22,824 - lava_callback - INFO - Starting async job submit for node 69dc93185dbfa74e32f9aed2 2026-04-15 06:54:22,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,846 - lava_callback - DEBUG - Processing node 69dc93185dbfa74e32f9aed2: baseline-arm-clabbe 2026-04-15 06:54:22,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93185dbfa74e32f9aed2 2026-04-15 06:54:22,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:54:22,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:54:22,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93185dbfa74e32f9aed2 HTTP/1.1" 200 None 2026-04-15 06:54:22,909 - lava_callback - ERROR - Error processing callback for node 69dc93185dbfa74e32f9aed2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET /node/698937a785773790cd34cdb1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54316 - "GET /node/698a9aadd9a1cfa777a24bab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:55:02,863 - lava_callback - INFO - Received callback for node 69dc93335dbfa74e32f9af0b INFO: 172.21.0.1:40724 - "POST /node/69dc93335dbfa74e32f9af0b HTTP/1.0" 202 Accepted 2026-04-15 06:55:02,869 - lava_callback - INFO - Starting async job submit for node 69dc93335dbfa74e32f9af0b 2026-04-15 06:55:02,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,892 - lava_callback - DEBUG - Processing node 69dc93335dbfa74e32f9af0b: baseline-arm-clabbe 2026-04-15 06:55:02,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93335dbfa74e32f9af0b 2026-04-15 06:55:02,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:55:02,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:02,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93335dbfa74e32f9af0b HTTP/1.1" 200 None 2026-04-15 06:55:02,977 - lava_callback - ERROR - Error processing callback for node 69dc93335dbfa74e32f9af0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET /node/6988bc5c9fc35f969e1ecda7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:55:22,891 - lava_callback - INFO - Received callback for node 69dc934d5dbfa74e32f9af58 INFO: 172.21.0.1:33288 - "POST /node/69dc934d5dbfa74e32f9af58 HTTP/1.0" 202 Accepted 2026-04-15 06:55:22,897 - lava_callback - INFO - Starting async job submit for node 69dc934d5dbfa74e32f9af58 2026-04-15 06:55:22,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,913 - lava_callback - DEBUG - Processing node 69dc934d5dbfa74e32f9af58: baseline-arm-clabbe 2026-04-15 06:55:22,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc934d5dbfa74e32f9af58 2026-04-15 06:55:22,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:55:22,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:55:22,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc934d5dbfa74e32f9af58 HTTP/1.1" 200 None 2026-04-15 06:55:22,965 - lava_callback - ERROR - Error processing callback for node 69dc934d5dbfa74e32f9af58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:56:02,926 - lava_callback - INFO - Received callback for node 69dc936d5dbfa74e32f9af7f INFO: 172.21.0.1:41274 - "POST /node/69dc936d5dbfa74e32f9af7f HTTP/1.0" 202 Accepted 2026-04-15 06:56:02,931 - lava_callback - INFO - Starting async job submit for node 69dc936d5dbfa74e32f9af7f 2026-04-15 06:56:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,947 - lava_callback - DEBUG - Processing node 69dc936d5dbfa74e32f9af7f: baseline-arm-clabbe 2026-04-15 06:56:02,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc936d5dbfa74e32f9af7f 2026-04-15 06:56:02,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:56:02,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:02,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc936d5dbfa74e32f9af7f HTTP/1.1" 200 None 2026-04-15 06:56:02,996 - lava_callback - ERROR - Error processing callback for node 69dc936d5dbfa74e32f9af7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:56:22,959 - lava_callback - INFO - Received callback for node 69dc93905dbfa74e32f9afa8 INFO: 172.21.0.1:54654 - "POST /node/69dc93905dbfa74e32f9afa8 HTTP/1.0" 202 Accepted 2026-04-15 06:56:22,966 - lava_callback - INFO - Starting async job submit for node 69dc93905dbfa74e32f9afa8 2026-04-15 06:56:22,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:22,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:22,985 - lava_callback - DEBUG - Processing node 69dc93905dbfa74e32f9afa8: baseline-arm-clabbe 2026-04-15 06:56:22,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93905dbfa74e32f9afa8 2026-04-15 06:56:22,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:22,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:23,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:23,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:56:23,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:56:23,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93905dbfa74e32f9afa8 HTTP/1.1" 200 None 2026-04-15 06:56:23,033 - lava_callback - ERROR - Error processing callback for node 69dc93905dbfa74e32f9afa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET /node/699358e2523507f3806a953d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48860 - "GET /node/695323b831522df6df79b357%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 06:57:02,992 - lava_callback - INFO - Received callback for node 69dc93b15dbfa74e32f9afbf INFO: 172.21.0.1:48864 - "POST /node/69dc93b15dbfa74e32f9afbf HTTP/1.0" 202 Accepted 2026-04-15 06:57:02,998 - lava_callback - INFO - Starting async job submit for node 69dc93b15dbfa74e32f9afbf 2026-04-15 06:57:02,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,017 - lava_callback - DEBUG - Processing node 69dc93b15dbfa74e32f9afbf: baseline-arm-clabbe 2026-04-15 06:57:03,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93b15dbfa74e32f9afbf 2026-04-15 06:57:03,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 06:57:03,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:03,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93b15dbfa74e32f9afbf HTTP/1.1" 200 None 2026-04-15 06:57:03,079 - lava_callback - ERROR - Error processing callback for node 69dc93b15dbfa74e32f9afbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:57:34,764 - lava_callback - INFO - Received callback for node 69dc93d15dbfa74e32f9afda INFO: 172.21.0.1:59814 - "POST /node/69dc93d15dbfa74e32f9afda HTTP/1.0" 202 Accepted 2026-04-15 06:57:34,770 - lava_callback - INFO - Starting async job submit for node 69dc93d15dbfa74e32f9afda 2026-04-15 06:57:34,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,785 - lava_callback - DEBUG - Processing node 69dc93d15dbfa74e32f9afda: baseline-arm-baylibre 2026-04-15 06:57:34,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93d15dbfa74e32f9afda 2026-04-15 06:57:34,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:57:34,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:57:34,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93d15dbfa74e32f9afda HTTP/1.1" 200 None 2026-04-15 06:57:34,837 - lava_callback - ERROR - Error processing callback for node 69dc93d15dbfa74e32f9afda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:58:03,083 - lava_callback - INFO - Received callback for node 69dc93f75dbfa74e32f9aff6 INFO: 172.21.0.1:43412 - "POST /node/69dc93f75dbfa74e32f9aff6 HTTP/1.0" 202 Accepted 2026-04-15 06:58:03,088 - lava_callback - INFO - Starting async job submit for node 69dc93f75dbfa74e32f9aff6 2026-04-15 06:58:03,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,105 - lava_callback - DEBUG - Processing node 69dc93f75dbfa74e32f9aff6: baseline-arm-clabbe 2026-04-15 06:58:03,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc93f75dbfa74e32f9aff6 2026-04-15 06:58:03,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:58:03,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:03,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc93f75dbfa74e32f9aff6 HTTP/1.1" 200 None 2026-04-15 06:58:03,154 - lava_callback - ERROR - Error processing callback for node 69dc93f75dbfa74e32f9aff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:58:43,071 - lava_callback - INFO - Received callback for node 69dc941b5dbfa74e32f9b002 INFO: 172.21.0.1:60820 - "POST /node/69dc941b5dbfa74e32f9b002 HTTP/1.0" 202 Accepted 2026-04-15 06:58:43,077 - lava_callback - INFO - Starting async job submit for node 69dc941b5dbfa74e32f9b002 2026-04-15 06:58:43,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,092 - lava_callback - DEBUG - Processing node 69dc941b5dbfa74e32f9b002: baseline-arm-clabbe 2026-04-15 06:58:43,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc941b5dbfa74e32f9b002 2026-04-15 06:58:43,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:58:43,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:58:43,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc941b5dbfa74e32f9b002 HTTP/1.1" 200 None 2026-04-15 06:58:43,146 - lava_callback - ERROR - Error processing callback for node 69dc941b5dbfa74e32f9b002: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK 2026-04-15 06:59:23,100 - lava_callback - INFO - Received callback for node 69dc943f5dbfa74e32f9b02b INFO: 172.21.0.1:57082 - "POST /node/69dc943f5dbfa74e32f9b02b HTTP/1.0" 202 Accepted 2026-04-15 06:59:23,108 - lava_callback - INFO - Starting async job submit for node 69dc943f5dbfa74e32f9b02b 2026-04-15 06:59:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,124 - lava_callback - DEBUG - Processing node 69dc943f5dbfa74e32f9b02b: baseline-arm-clabbe 2026-04-15 06:59:23,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc943f5dbfa74e32f9b02b 2026-04-15 06:59:23,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 06:59:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 06:59:23,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc943f5dbfa74e32f9b02b HTTP/1.1" 200 None 2026-04-15 06:59:23,176 - lava_callback - ERROR - Error processing callback for node 69dc943f5dbfa74e32f9b02b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:00:03,113 - lava_callback - INFO - Received callback for node 69dc94635dbfa74e32f9b046 INFO: 172.21.0.1:56834 - "POST /node/69dc94635dbfa74e32f9b046 HTTP/1.0" 202 Accepted 2026-04-15 07:00:03,119 - lava_callback - INFO - Starting async job submit for node 69dc94635dbfa74e32f9b046 2026-04-15 07:00:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,143 - lava_callback - DEBUG - Processing node 69dc94635dbfa74e32f9b046: baseline-arm-clabbe 2026-04-15 07:00:03,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94635dbfa74e32f9b046 2026-04-15 07:00:03,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:00:03,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:03,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94635dbfa74e32f9b046 HTTP/1.1" 200 None 2026-04-15 07:00:03,201 - lava_callback - ERROR - Error processing callback for node 69dc94635dbfa74e32f9b046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56838 - "GET /node/6951454c55ab4e5dcfcc0962%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:00:23,158 - lava_callback - INFO - Received callback for node 69dc94845dbfa74e32f9b072 INFO: 172.21.0.1:54582 - "POST /node/69dc94845dbfa74e32f9b072 HTTP/1.0" 202 Accepted 2026-04-15 07:00:23,163 - lava_callback - INFO - Starting async job submit for node 69dc94845dbfa74e32f9b072 2026-04-15 07:00:23,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,180 - lava_callback - DEBUG - Processing node 69dc94845dbfa74e32f9b072: baseline-arm-clabbe 2026-04-15 07:00:23,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94845dbfa74e32f9b072 2026-04-15 07:00:23,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:00:23,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:00:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94845dbfa74e32f9b072 HTTP/1.1" 200 None 2026-04-15 07:00:23,230 - lava_callback - ERROR - Error processing callback for node 69dc94845dbfa74e32f9b072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:01:03,163 - lava_callback - INFO - Received callback for node 69dc94a55dbfa74e32f9b08e INFO: 172.21.0.1:52666 - "POST /node/69dc94a55dbfa74e32f9b08e HTTP/1.0" 202 Accepted 2026-04-15 07:01:03,168 - lava_callback - INFO - Starting async job submit for node 69dc94a55dbfa74e32f9b08e 2026-04-15 07:01:03,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,194 - lava_callback - DEBUG - Processing node 69dc94a55dbfa74e32f9b08e: baseline-arm-clabbe 2026-04-15 07:01:03,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94a55dbfa74e32f9b08e 2026-04-15 07:01:03,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:01:03,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:03,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94a55dbfa74e32f9b08e HTTP/1.1" 200 None 2026-04-15 07:01:03,255 - lava_callback - ERROR - Error processing callback for node 69dc94a55dbfa74e32f9b08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET /node/698a7f2bd9a1cfa777a229a5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59036 - "GET /node/69522ba95318368af0c48ecb%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 07:01:43,190 - lava_callback - INFO - Received callback for node 69dc94c65dbfa74e32f9b0af INFO: 172.21.0.1:59044 - "POST /node/69dc94c65dbfa74e32f9b0af HTTP/1.0" 202 Accepted 2026-04-15 07:01:43,198 - lava_callback - INFO - Starting async job submit for node 69dc94c65dbfa74e32f9b0af 2026-04-15 07:01:43,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,216 - lava_callback - DEBUG - Processing node 69dc94c65dbfa74e32f9b0af: baseline-arm-clabbe 2026-04-15 07:01:43,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94c65dbfa74e32f9b0af 2026-04-15 07:01:43,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:01:43,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:01:43,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94c65dbfa74e32f9b0af HTTP/1.1" 200 None 2026-04-15 07:01:43,296 - lava_callback - ERROR - Error processing callback for node 69dc94c65dbfa74e32f9b0af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:02:03,175 - lava_callback - INFO - Received callback for node 69dc94e35dbfa74e32f9b0d0 INFO: 172.21.0.1:39364 - "POST /node/69dc94e35dbfa74e32f9b0d0 HTTP/1.0" 202 Accepted 2026-04-15 07:02:03,187 - lava_callback - INFO - Starting async job submit for node 69dc94e35dbfa74e32f9b0d0 2026-04-15 07:02:03,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,218 - lava_callback - DEBUG - Processing node 69dc94e35dbfa74e32f9b0d0: baseline-arm-clabbe 2026-04-15 07:02:03,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc94e35dbfa74e32f9b0d0 2026-04-15 07:02:03,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:02:03,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:03,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc94e35dbfa74e32f9b0d0 HTTP/1.1" 200 None 2026-04-15 07:02:03,285 - lava_callback - ERROR - Error processing callback for node 69dc94e35dbfa74e32f9b0d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:02:43,246 - lava_callback - INFO - Received callback for node 69dc95015dbfa74e32f9b105 INFO: 172.21.0.1:42106 - "POST /node/69dc95015dbfa74e32f9b105 HTTP/1.0" 202 Accepted 2026-04-15 07:02:43,251 - lava_callback - INFO - Starting async job submit for node 69dc95015dbfa74e32f9b105 2026-04-15 07:02:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,266 - lava_callback - DEBUG - Processing node 69dc95015dbfa74e32f9b105: baseline-arm-clabbe 2026-04-15 07:02:43,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95015dbfa74e32f9b105 2026-04-15 07:02:43,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:02:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:02:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95015dbfa74e32f9b105 HTTP/1.1" 200 None 2026-04-15 07:02:43,321 - lava_callback - ERROR - Error processing callback for node 69dc95015dbfa74e32f9b105: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:03:23,213 - lava_callback - INFO - Received callback for node 69dc95265dbfa74e32f9b144 INFO: 172.21.0.1:47590 - "POST /node/69dc95265dbfa74e32f9b144 HTTP/1.0" 202 Accepted 2026-04-15 07:03:23,219 - lava_callback - INFO - Starting async job submit for node 69dc95265dbfa74e32f9b144 2026-04-15 07:03:23,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,238 - lava_callback - DEBUG - Processing node 69dc95265dbfa74e32f9b144: baseline-arm-clabbe 2026-04-15 07:03:23,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95265dbfa74e32f9b144 2026-04-15 07:03:23,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:03:23,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:23,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95265dbfa74e32f9b144 HTTP/1.1" 200 None 2026-04-15 07:03:23,299 - lava_callback - ERROR - Error processing callback for node 69dc95265dbfa74e32f9b144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:03:43,265 - lava_callback - INFO - Received callback for node 69dc95475dbfa74e32f9b15f INFO: 172.21.0.1:49206 - "POST /node/69dc95475dbfa74e32f9b15f HTTP/1.0" 202 Accepted 2026-04-15 07:03:43,270 - lava_callback - INFO - Starting async job submit for node 69dc95475dbfa74e32f9b15f 2026-04-15 07:03:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,293 - lava_callback - DEBUG - Processing node 69dc95475dbfa74e32f9b15f: baseline-arm-clabbe 2026-04-15 07:03:43,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95475dbfa74e32f9b15f 2026-04-15 07:03:43,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:03:43,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:03:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95475dbfa74e32f9b15f HTTP/1.1" 200 None 2026-04-15 07:03:43,361 - lava_callback - ERROR - Error processing callback for node 69dc95475dbfa74e32f9b15f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:04:23,242 - lava_callback - INFO - Received callback for node 69dc95645dbfa74e32f9b18f INFO: 172.21.0.1:39538 - "POST /node/69dc95645dbfa74e32f9b18f HTTP/1.0" 202 Accepted 2026-04-15 07:04:23,250 - lava_callback - INFO - Starting async job submit for node 69dc95645dbfa74e32f9b18f 2026-04-15 07:04:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,271 - lava_callback - DEBUG - Processing node 69dc95645dbfa74e32f9b18f: baseline-arm-clabbe 2026-04-15 07:04:23,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95645dbfa74e32f9b18f 2026-04-15 07:04:23,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:04:23,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:23,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95645dbfa74e32f9b18f HTTP/1.1" 200 None 2026-04-15 07:04:23,341 - lava_callback - ERROR - Error processing callback for node 69dc95645dbfa74e32f9b18f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:04:43,304 - lava_callback - INFO - Received callback for node 69dc95865dbfa74e32f9b1a0 INFO: 172.21.0.1:38824 - "POST /node/69dc95865dbfa74e32f9b1a0 HTTP/1.0" 202 Accepted 2026-04-15 07:04:43,310 - lava_callback - INFO - Starting async job submit for node 69dc95865dbfa74e32f9b1a0 2026-04-15 07:04:43,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,325 - lava_callback - DEBUG - Processing node 69dc95865dbfa74e32f9b1a0: baseline-arm-clabbe 2026-04-15 07:04:43,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95865dbfa74e32f9b1a0 2026-04-15 07:04:43,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:04:43,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:04:43,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95865dbfa74e32f9b1a0 HTTP/1.1" 200 None 2026-04-15 07:04:43,378 - lava_callback - ERROR - Error processing callback for node 69dc95865dbfa74e32f9b1a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:05:23,327 - lava_callback - INFO - Received callback for node 69dc95a15dbfa74e32f9b1e1 INFO: 172.21.0.1:54116 - "POST /node/69dc95a15dbfa74e32f9b1e1 HTTP/1.0" 202 Accepted 2026-04-15 07:05:23,333 - lava_callback - INFO - Starting async job submit for node 69dc95a15dbfa74e32f9b1e1 2026-04-15 07:05:23,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,348 - lava_callback - DEBUG - Processing node 69dc95a15dbfa74e32f9b1e1: baseline-arm-clabbe 2026-04-15 07:05:23,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95a15dbfa74e32f9b1e1 2026-04-15 07:05:23,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:05:23,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:23,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95a15dbfa74e32f9b1e1 HTTP/1.1" 200 None 2026-04-15 07:05:23,397 - lava_callback - ERROR - Error processing callback for node 69dc95a15dbfa74e32f9b1e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:05:43,350 - lava_callback - INFO - Received callback for node 69dc95c15dbfa74e32f9b211 INFO: 172.21.0.1:36328 - "POST /node/69dc95c15dbfa74e32f9b211 HTTP/1.0" 202 Accepted 2026-04-15 07:05:43,356 - lava_callback - INFO - Starting async job submit for node 69dc95c15dbfa74e32f9b211 2026-04-15 07:05:43,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,372 - lava_callback - DEBUG - Processing node 69dc95c15dbfa74e32f9b211: baseline-arm-clabbe 2026-04-15 07:05:43,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95c15dbfa74e32f9b211 2026-04-15 07:05:43,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:05:43,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:05:43,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95c15dbfa74e32f9b211 HTTP/1.1" 200 None 2026-04-15 07:05:43,422 - lava_callback - ERROR - Error processing callback for node 69dc95c15dbfa74e32f9b211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:06:23,331 - lava_callback - INFO - Received callback for node 69dc95e35dbfa74e32f9b236 INFO: 172.21.0.1:35108 - "POST /node/69dc95e35dbfa74e32f9b236 HTTP/1.0" 202 Accepted 2026-04-15 07:06:23,337 - lava_callback - INFO - Starting async job submit for node 69dc95e35dbfa74e32f9b236 2026-04-15 07:06:23,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,357 - lava_callback - DEBUG - Processing node 69dc95e35dbfa74e32f9b236: baseline-arm-clabbe 2026-04-15 07:06:23,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc95e35dbfa74e32f9b236 2026-04-15 07:06:23,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 07:06:23,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:06:23,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc95e35dbfa74e32f9b236 HTTP/1.1" 200 None 2026-04-15 07:06:23,426 - lava_callback - ERROR - Error processing callback for node 69dc95e35dbfa74e32f9b236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET /node/691a0af0eaa94778a74d5ac1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:13:35,644 - lava_callback - INFO - Received callback for node 69dc97915dbfa74e32f9b452 INFO: 172.21.0.1:53566 - "POST /node/69dc97915dbfa74e32f9b452 HTTP/1.0" 202 Accepted 2026-04-15 07:13:35,650 - lava_callback - INFO - Starting async job submit for node 69dc97915dbfa74e32f9b452 2026-04-15 07:13:35,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,665 - lava_callback - DEBUG - Processing node 69dc97915dbfa74e32f9b452: baseline-arm64-baylibre 2026-04-15 07:13:35,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc97915dbfa74e32f9b452 2026-04-15 07:13:35,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:13:35,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:13:35,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc97915dbfa74e32f9b452 HTTP/1.1" 200 None 2026-04-15 07:13:35,741 - lava_callback - ERROR - Error processing callback for node 69dc97915dbfa74e32f9b452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:14:35,645 - lava_callback - INFO - Received callback for node 69dc97d25dbfa74e32f9b4b9 INFO: 172.21.0.1:57420 - "POST /node/69dc97d25dbfa74e32f9b4b9 HTTP/1.0" 202 Accepted 2026-04-15 07:14:35,651 - lava_callback - INFO - Starting async job submit for node 69dc97d25dbfa74e32f9b4b9 2026-04-15 07:14:35,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,668 - lava_callback - DEBUG - Processing node 69dc97d25dbfa74e32f9b4b9: baseline-arm64-baylibre 2026-04-15 07:14:35,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc97d25dbfa74e32f9b4b9 2026-04-15 07:14:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:14:35,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:14:35,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc97d25dbfa74e32f9b4b9 HTTP/1.1" 200 None 2026-04-15 07:14:35,743 - lava_callback - ERROR - Error processing callback for node 69dc97d25dbfa74e32f9b4b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:16:55,710 - lava_callback - INFO - Received callback for node 69dc98605dbfa74e32f9b539 INFO: 172.21.0.1:48422 - "POST /node/69dc98605dbfa74e32f9b539 HTTP/1.0" 202 Accepted 2026-04-15 07:16:55,717 - lava_callback - INFO - Starting async job submit for node 69dc98605dbfa74e32f9b539 2026-04-15 07:16:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,732 - lava_callback - DEBUG - Processing node 69dc98605dbfa74e32f9b539: baseline-arm64-baylibre 2026-04-15 07:16:55,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98605dbfa74e32f9b539 2026-04-15 07:16:55,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:16:55,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:16:55,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98605dbfa74e32f9b539 HTTP/1.1" 200 None 2026-04-15 07:16:55,785 - lava_callback - ERROR - Error processing callback for node 69dc98605dbfa74e32f9b539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:17:55,786 - lava_callback - INFO - Received callback for node 69dc98a25dbfa74e32f9b58c INFO: 172.21.0.1:60646 - "POST /node/69dc98a25dbfa74e32f9b58c HTTP/1.0" 202 Accepted 2026-04-15 07:17:55,795 - lava_callback - INFO - Starting async job submit for node 69dc98a25dbfa74e32f9b58c 2026-04-15 07:17:55,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,822 - lava_callback - DEBUG - Processing node 69dc98a25dbfa74e32f9b58c: baseline-arm64-baylibre 2026-04-15 07:17:55,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98a25dbfa74e32f9b58c 2026-04-15 07:17:55,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:17:55,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:17:55,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98a25dbfa74e32f9b58c HTTP/1.1" 200 None 2026-04-15 07:17:55,884 - lava_callback - ERROR - Error processing callback for node 69dc98a25dbfa74e32f9b58c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 07:19:15,946 - lava_callback - INFO - Received callback for node 69dc98e95dbfa74e32f9b5c8 INFO: 172.21.0.1:36054 - "POST /node/69dc98e95dbfa74e32f9b5c8 HTTP/1.0" 202 Accepted 2026-04-15 07:19:15,952 - lava_callback - INFO - Starting async job submit for node 69dc98e95dbfa74e32f9b5c8 2026-04-15 07:19:15,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:15,968 - lava_callback - DEBUG - Processing node 69dc98e95dbfa74e32f9b5c8: baseline-arm64-baylibre 2026-04-15 07:19:15,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc98e95dbfa74e32f9b5c8 2026-04-15 07:19:15,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:15,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:19:15,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:19:16,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc98e95dbfa74e32f9b5c8 HTTP/1.1" 200 None 2026-04-15 07:19:16,021 - lava_callback - ERROR - Error processing callback for node 69dc98e95dbfa74e32f9b5c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 07:20:15,887 - lava_callback - INFO - Received callback for node 69dc992e5dbfa74e32f9b616 INFO: 172.21.0.1:34024 - "POST /node/69dc992e5dbfa74e32f9b616 HTTP/1.0" 202 Accepted 2026-04-15 07:20:15,894 - lava_callback - INFO - Starting async job submit for node 69dc992e5dbfa74e32f9b616 2026-04-15 07:20:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,917 - lava_callback - DEBUG - Processing node 69dc992e5dbfa74e32f9b616: baseline-arm64-baylibre 2026-04-15 07:20:15,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc992e5dbfa74e32f9b616 2026-04-15 07:20:15,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:20:15,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:20:15,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc992e5dbfa74e32f9b616 HTTP/1.1" 200 None 2026-04-15 07:20:15,980 - lava_callback - ERROR - Error processing callback for node 69dc992e5dbfa74e32f9b616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:21:43,950 - lava_callback - INFO - Received callback for node 69dc997b5dbfa74e32f9b64f INFO: 172.21.0.1:58114 - "POST /node/69dc997b5dbfa74e32f9b64f HTTP/1.0" 202 Accepted 2026-04-15 07:21:43,956 - lava_callback - INFO - Starting async job submit for node 69dc997b5dbfa74e32f9b64f 2026-04-15 07:21:43,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:43,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:43,974 - lava_callback - DEBUG - Processing node 69dc997b5dbfa74e32f9b64f: baseline-arm64-clabbe 2026-04-15 07:21:43,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc997b5dbfa74e32f9b64f 2026-04-15 07:21:43,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:43,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:43,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:44,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:21:44,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:21:44,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc997b5dbfa74e32f9b64f HTTP/1.1" 200 None 2026-04-15 07:21:44,046 - lava_callback - ERROR - Error processing callback for node 69dc997b5dbfa74e32f9b64f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:23:03,954 - lava_callback - INFO - Received callback for node 69dc99c55dbfa74e32f9b675 INFO: 172.21.0.1:43098 - "POST /node/69dc99c55dbfa74e32f9b675 HTTP/1.0" 202 Accepted 2026-04-15 07:23:03,962 - lava_callback - INFO - Starting async job submit for node 69dc99c55dbfa74e32f9b675 2026-04-15 07:23:03,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:03,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:03,979 - lava_callback - DEBUG - Processing node 69dc99c55dbfa74e32f9b675: baseline-arm64-clabbe 2026-04-15 07:23:03,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc99c55dbfa74e32f9b675 2026-04-15 07:23:03,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:03,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:03,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:04,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:23:04,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:23:04,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc99c55dbfa74e32f9b675 HTTP/1.1" 200 None 2026-04-15 07:23:04,042 - lava_callback - ERROR - Error processing callback for node 69dc99c55dbfa74e32f9b675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:24:04,083 - lava_callback - INFO - Received callback for node 69dc9a075dbfa74e32f9b6c9 INFO: 172.21.0.1:53272 - "POST /node/69dc9a075dbfa74e32f9b6c9 HTTP/1.0" 202 Accepted 2026-04-15 07:24:04,089 - lava_callback - INFO - Starting async job submit for node 69dc9a075dbfa74e32f9b6c9 2026-04-15 07:24:04,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,105 - lava_callback - DEBUG - Processing node 69dc9a075dbfa74e32f9b6c9: baseline-arm64-clabbe 2026-04-15 07:24:04,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a075dbfa74e32f9b6c9 2026-04-15 07:24:04,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:24:04,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:24:04,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a075dbfa74e32f9b6c9 HTTP/1.1" 200 None 2026-04-15 07:24:04,167 - lava_callback - ERROR - Error processing callback for node 69dc9a075dbfa74e32f9b6c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:25:04,052 - lava_callback - INFO - Received callback for node 69dc9a4c5dbfa74e32f9b711 INFO: 172.21.0.1:40378 - "POST /node/69dc9a4c5dbfa74e32f9b711 HTTP/1.0" 202 Accepted 2026-04-15 07:25:04,058 - lava_callback - INFO - Starting async job submit for node 69dc9a4c5dbfa74e32f9b711 2026-04-15 07:25:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,076 - lava_callback - DEBUG - Processing node 69dc9a4c5dbfa74e32f9b711: baseline-arm64-clabbe 2026-04-15 07:25:04,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a4c5dbfa74e32f9b711 2026-04-15 07:25:04,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:25:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:25:04,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a4c5dbfa74e32f9b711 HTTP/1.1" 200 None 2026-04-15 07:25:04,124 - lava_callback - ERROR - Error processing callback for node 69dc9a4c5dbfa74e32f9b711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:26:24,145 - lava_callback - INFO - Received callback for node 69dc9a965dbfa74e32f9b742 INFO: 172.21.0.1:39370 - "POST /node/69dc9a965dbfa74e32f9b742 HTTP/1.0" 202 Accepted 2026-04-15 07:26:24,151 - lava_callback - INFO - Starting async job submit for node 69dc9a965dbfa74e32f9b742 2026-04-15 07:26:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,172 - lava_callback - DEBUG - Processing node 69dc9a965dbfa74e32f9b742: baseline-arm64-clabbe 2026-04-15 07:26:24,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9a965dbfa74e32f9b742 2026-04-15 07:26:24,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:26:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:26:24,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9a965dbfa74e32f9b742 HTTP/1.1" 200 None 2026-04-15 07:26:24,223 - lava_callback - ERROR - Error processing callback for node 69dc9a965dbfa74e32f9b742: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:27:44,122 - lava_callback - INFO - Received callback for node 69dc9ade5dbfa74e32f9b76f INFO: 172.21.0.1:39434 - "POST /node/69dc9ade5dbfa74e32f9b76f HTTP/1.0" 202 Accepted 2026-04-15 07:27:44,127 - lava_callback - INFO - Starting async job submit for node 69dc9ade5dbfa74e32f9b76f 2026-04-15 07:27:44,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,144 - lava_callback - DEBUG - Processing node 69dc9ade5dbfa74e32f9b76f: baseline-arm64-clabbe 2026-04-15 07:27:44,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ade5dbfa74e32f9b76f 2026-04-15 07:27:44,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:27:44,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:27:44,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ade5dbfa74e32f9b76f HTTP/1.1" 200 None 2026-04-15 07:27:44,199 - lava_callback - ERROR - Error processing callback for node 69dc9ade5dbfa74e32f9b76f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:28:44,175 - lava_callback - INFO - Received callback for node 69dc9b205dbfa74e32f9b7d8 INFO: 172.21.0.1:39970 - "POST /node/69dc9b205dbfa74e32f9b7d8 HTTP/1.0" 202 Accepted 2026-04-15 07:28:44,180 - lava_callback - INFO - Starting async job submit for node 69dc9b205dbfa74e32f9b7d8 2026-04-15 07:28:44,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,209 - lava_callback - DEBUG - Processing node 69dc9b205dbfa74e32f9b7d8: baseline-arm64-clabbe 2026-04-15 07:28:44,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9b205dbfa74e32f9b7d8 2026-04-15 07:28:44,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 07:28:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:28:44,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9b205dbfa74e32f9b7d8 HTTP/1.1" 200 None 2026-04-15 07:28:44,258 - lava_callback - ERROR - Error processing callback for node 69dc9b205dbfa74e32f9b7d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:29:56,524 - lava_callback - INFO - Received callback for node 69dc9b645dbfa74e32f9b7fd INFO: 172.21.0.1:45206 - "POST /node/69dc9b645dbfa74e32f9b7fd HTTP/1.0" 202 Accepted 2026-04-15 07:29:56,530 - lava_callback - INFO - Starting async job submit for node 69dc9b645dbfa74e32f9b7fd 2026-04-15 07:29:56,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:29:56,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,551 - lava_callback - DEBUG - Processing node 69dc9b645dbfa74e32f9b7fd: baseline-arm64-baylibre 2026-04-15 07:29:56,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9b645dbfa74e32f9b7fd 2026-04-15 07:29:56,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:29:56,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:29:56,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9b645dbfa74e32f9b7fd HTTP/1.1" 200 None 2026-04-15 07:29:56,631 - lava_callback - ERROR - Error processing callback for node 69dc9b645dbfa74e32f9b7fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:30:56,449 - lava_callback - INFO - Received callback for node 69dc9ba65dbfa74e32f9b82e INFO: 172.21.0.1:32992 - "POST /node/69dc9ba65dbfa74e32f9b82e HTTP/1.0" 202 Accepted 2026-04-15 07:30:56,458 - lava_callback - INFO - Starting async job submit for node 69dc9ba65dbfa74e32f9b82e 2026-04-15 07:30:56,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,476 - lava_callback - DEBUG - Processing node 69dc9ba65dbfa74e32f9b82e: baseline-arm64-baylibre 2026-04-15 07:30:56,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ba65dbfa74e32f9b82e 2026-04-15 07:30:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:30:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:30:56,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:30:56,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ba65dbfa74e32f9b82e HTTP/1.1" 200 None 2026-04-15 07:30:56,548 - lava_callback - ERROR - Error processing callback for node 69dc9ba65dbfa74e32f9b82e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:32:16,604 - lava_callback - INFO - Received callback for node 69dc9bec5dbfa74e32f9b882 INFO: 172.21.0.1:51804 - "POST /node/69dc9bec5dbfa74e32f9b882 HTTP/1.0" 202 Accepted 2026-04-15 07:32:16,610 - lava_callback - INFO - Starting async job submit for node 69dc9bec5dbfa74e32f9b882 2026-04-15 07:32:16,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,626 - lava_callback - DEBUG - Processing node 69dc9bec5dbfa74e32f9b882: baseline-arm64-baylibre 2026-04-15 07:32:16,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9bec5dbfa74e32f9b882 2026-04-15 07:32:16,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:32:16,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:32:16,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9bec5dbfa74e32f9b882 HTTP/1.1" 200 None 2026-04-15 07:32:16,677 - lava_callback - ERROR - Error processing callback for node 69dc9bec5dbfa74e32f9b882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:33:16,546 - lava_callback - INFO - Received callback for node 69dc9c315dbfa74e32f9b8d7 INFO: 172.21.0.1:52714 - "POST /node/69dc9c315dbfa74e32f9b8d7 HTTP/1.0" 202 Accepted 2026-04-15 07:33:16,552 - lava_callback - INFO - Starting async job submit for node 69dc9c315dbfa74e32f9b8d7 2026-04-15 07:33:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,567 - lava_callback - DEBUG - Processing node 69dc9c315dbfa74e32f9b8d7: baseline-arm64-baylibre 2026-04-15 07:33:16,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9c315dbfa74e32f9b8d7 2026-04-15 07:33:16,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:33:16,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:33:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9c315dbfa74e32f9b8d7 HTTP/1.1" 200 None 2026-04-15 07:33:16,641 - lava_callback - ERROR - Error processing callback for node 69dc9c315dbfa74e32f9b8d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:34:36,728 - lava_callback - INFO - Received callback for node 69dc9c775dbfa74e32f9b90e INFO: 172.21.0.1:43904 - "POST /node/69dc9c775dbfa74e32f9b90e HTTP/1.0" 202 Accepted 2026-04-15 07:34:36,734 - lava_callback - INFO - Starting async job submit for node 69dc9c775dbfa74e32f9b90e 2026-04-15 07:34:36,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,751 - lava_callback - DEBUG - Processing node 69dc9c775dbfa74e32f9b90e: baseline-arm64-baylibre 2026-04-15 07:34:36,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9c775dbfa74e32f9b90e 2026-04-15 07:34:36,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:34:36,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:34:36,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9c775dbfa74e32f9b90e HTTP/1.1" 200 None 2026-04-15 07:34:36,803 - lava_callback - ERROR - Error processing callback for node 69dc9c775dbfa74e32f9b90e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:35:36,926 - lava_callback - INFO - Received callback for node 69dc9cb95dbfa74e32f9b95a INFO: 172.21.0.1:48338 - "POST /node/69dc9cb95dbfa74e32f9b95a HTTP/1.0" 202 Accepted 2026-04-15 07:35:36,936 - lava_callback - INFO - Starting async job submit for node 69dc9cb95dbfa74e32f9b95a 2026-04-15 07:35:36,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:36,953 - lava_callback - DEBUG - Processing node 69dc9cb95dbfa74e32f9b95a: baseline-arm64-baylibre 2026-04-15 07:35:36,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9cb95dbfa74e32f9b95a 2026-04-15 07:35:36,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:35:36,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:35:37,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9cb95dbfa74e32f9b95a HTTP/1.1" 200 None 2026-04-15 07:35:37,016 - lava_callback - ERROR - Error processing callback for node 69dc9cb95dbfa74e32f9b95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:36:44,594 - lava_callback - INFO - Received callback for node 69dc9cfd5dbfa74e32f9b9e3 INFO: 172.21.0.1:50490 - "POST /node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.0" 202 Accepted 2026-04-15 07:36:44,601 - lava_callback - INFO - Starting async job submit for node 69dc9cfd5dbfa74e32f9b9e3 2026-04-15 07:36:44,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,629 - lava_callback - DEBUG - Processing node 69dc9cfd5dbfa74e32f9b9e3: baseline-arm64-clabbe 2026-04-15 07:36:44,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9cfd5dbfa74e32f9b9e3 2026-04-15 07:36:44,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:36:44,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:36:44,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9cfd5dbfa74e32f9b9e3 HTTP/1.1" 200 None 2026-04-15 07:36:44,681 - lava_callback - ERROR - Error processing callback for node 69dc9cfd5dbfa74e32f9b9e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:37:36,843 - lava_callback - INFO - Received callback for node 69dc9d3d5dbfa74e32f9ba2d INFO: 172.21.0.1:60376 - "POST /node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.0" 202 Accepted 2026-04-15 07:37:36,849 - lava_callback - INFO - Starting async job submit for node 69dc9d3d5dbfa74e32f9ba2d 2026-04-15 07:37:36,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,869 - lava_callback - DEBUG - Processing node 69dc9d3d5dbfa74e32f9ba2d: baseline-arm64-baylibre 2026-04-15 07:37:36,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9d3d5dbfa74e32f9ba2d 2026-04-15 07:37:36,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:37:36,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:37:36,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9d3d5dbfa74e32f9ba2d HTTP/1.1" 200 None 2026-04-15 07:37:36,929 - lava_callback - ERROR - Error processing callback for node 69dc9d3d5dbfa74e32f9ba2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:39:04,652 - lava_callback - INFO - Received callback for node 69dc9d8a5dbfa74e32f9ba68 INFO: 172.21.0.1:38302 - "POST /node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.0" 202 Accepted 2026-04-15 07:39:04,657 - lava_callback - INFO - Starting async job submit for node 69dc9d8a5dbfa74e32f9ba68 2026-04-15 07:39:04,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,674 - lava_callback - DEBUG - Processing node 69dc9d8a5dbfa74e32f9ba68: baseline-arm64-clabbe 2026-04-15 07:39:04,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9d8a5dbfa74e32f9ba68 2026-04-15 07:39:04,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:39:04,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:39:04,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9d8a5dbfa74e32f9ba68 HTTP/1.1" 200 None 2026-04-15 07:39:04,731 - lava_callback - ERROR - Error processing callback for node 69dc9d8a5dbfa74e32f9ba68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:40:04,672 - lava_callback - INFO - Received callback for node 69dc9dcf5dbfa74e32f9bac1 INFO: 172.21.0.1:52380 - "POST /node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.0" 202 Accepted 2026-04-15 07:40:04,678 - lava_callback - INFO - Starting async job submit for node 69dc9dcf5dbfa74e32f9bac1 2026-04-15 07:40:04,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,695 - lava_callback - DEBUG - Processing node 69dc9dcf5dbfa74e32f9bac1: baseline-arm64-clabbe 2026-04-15 07:40:04,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9dcf5dbfa74e32f9bac1 2026-04-15 07:40:04,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:40:04,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:40:04,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9dcf5dbfa74e32f9bac1 HTTP/1.1" 200 None 2026-04-15 07:40:04,754 - lava_callback - ERROR - Error processing callback for node 69dc9dcf5dbfa74e32f9bac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:41:24,743 - lava_callback - INFO - Received callback for node 69dc9e0e5dbfa74e32f9bb21 INFO: 172.21.0.1:43748 - "POST /node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.0" 202 Accepted 2026-04-15 07:41:24,749 - lava_callback - INFO - Starting async job submit for node 69dc9e0e5dbfa74e32f9bb21 2026-04-15 07:41:24,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,765 - lava_callback - DEBUG - Processing node 69dc9e0e5dbfa74e32f9bb21: baseline-arm64-clabbe 2026-04-15 07:41:24,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e0e5dbfa74e32f9bb21 2026-04-15 07:41:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:41:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:41:24,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e0e5dbfa74e32f9bb21 HTTP/1.1" 200 None 2026-04-15 07:41:24,812 - lava_callback - ERROR - Error processing callback for node 69dc9e0e5dbfa74e32f9bb21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:42:24,789 - lava_callback - INFO - Received callback for node 69dc9e555dbfa74e32f9bb62 INFO: 172.21.0.1:53056 - "POST /node/69dc9e555dbfa74e32f9bb62 HTTP/1.0" 202 Accepted 2026-04-15 07:42:24,794 - lava_callback - INFO - Starting async job submit for node 69dc9e555dbfa74e32f9bb62 2026-04-15 07:42:24,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,816 - lava_callback - DEBUG - Processing node 69dc9e555dbfa74e32f9bb62: baseline-arm64-clabbe 2026-04-15 07:42:24,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e555dbfa74e32f9bb62 2026-04-15 07:42:24,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:42:24,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:42:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e555dbfa74e32f9bb62 HTTP/1.1" 200 None 2026-04-15 07:42:24,871 - lava_callback - ERROR - Error processing callback for node 69dc9e555dbfa74e32f9bb62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:43:44,809 - lava_callback - INFO - Received callback for node 69dc9e9b5dbfa74e32f9bba3 INFO: 172.21.0.1:56368 - "POST /node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.0" 202 Accepted 2026-04-15 07:43:44,815 - lava_callback - INFO - Starting async job submit for node 69dc9e9b5dbfa74e32f9bba3 2026-04-15 07:43:44,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,834 - lava_callback - DEBUG - Processing node 69dc9e9b5dbfa74e32f9bba3: baseline-arm64-clabbe 2026-04-15 07:43:44,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9e9b5dbfa74e32f9bba3 2026-04-15 07:43:44,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:43:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:43:44,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9e9b5dbfa74e32f9bba3 HTTP/1.1" 200 None 2026-04-15 07:43:44,887 - lava_callback - ERROR - Error processing callback for node 69dc9e9b5dbfa74e32f9bba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:44:44,911 - lava_callback - INFO - Received callback for node 69dc9edf5dbfa74e32f9bc00 INFO: 172.21.0.1:36604 - "POST /node/69dc9edf5dbfa74e32f9bc00 HTTP/1.0" 202 Accepted 2026-04-15 07:44:44,917 - lava_callback - INFO - Starting async job submit for node 69dc9edf5dbfa74e32f9bc00 2026-04-15 07:44:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:44,959 - lava_callback - DEBUG - Processing node 69dc9edf5dbfa74e32f9bc00: baseline-arm64-clabbe 2026-04-15 07:44:44,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9edf5dbfa74e32f9bc00 2026-04-15 07:44:44,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:44,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:44,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:44:44,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:44:45,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9edf5dbfa74e32f9bc00 HTTP/1.1" 200 None 2026-04-15 07:44:45,015 - lava_callback - ERROR - Error processing callback for node 69dc9edf5dbfa74e32f9bc00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:46:04,955 - lava_callback - INFO - Received callback for node 69dc9f275dbfa74e32f9bc42 INFO: 172.21.0.1:41336 - "POST /node/69dc9f275dbfa74e32f9bc42 HTTP/1.0" 202 Accepted 2026-04-15 07:46:04,960 - lava_callback - INFO - Starting async job submit for node 69dc9f275dbfa74e32f9bc42 2026-04-15 07:46:04,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:04,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:04,977 - lava_callback - DEBUG - Processing node 69dc9f275dbfa74e32f9bc42: baseline-arm64-clabbe 2026-04-15 07:46:04,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9f275dbfa74e32f9bc42 2026-04-15 07:46:04,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:04,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:46:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:46:05,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9f275dbfa74e32f9bc42 HTTP/1.1" 200 None 2026-04-15 07:46:05,047 - lava_callback - ERROR - Error processing callback for node 69dc9f275dbfa74e32f9bc42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:47:05,033 - lava_callback - INFO - Received callback for node 69dc9f6c5dbfa74e32f9bc82 INFO: 172.21.0.1:47444 - "POST /node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.0" 202 Accepted 2026-04-15 07:47:05,039 - lava_callback - INFO - Starting async job submit for node 69dc9f6c5dbfa74e32f9bc82 2026-04-15 07:47:05,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,055 - lava_callback - DEBUG - Processing node 69dc9f6c5dbfa74e32f9bc82: baseline-arm64-clabbe 2026-04-15 07:47:05,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9f6c5dbfa74e32f9bc82 2026-04-15 07:47:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:47:05,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:47:05,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9f6c5dbfa74e32f9bc82 HTTP/1.1" 200 None 2026-04-15 07:47:05,104 - lava_callback - ERROR - Error processing callback for node 69dc9f6c5dbfa74e32f9bc82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:48:05,107 - lava_callback - INFO - Received callback for node 69dc9fb05dbfa74e32f9bce9 INFO: 172.21.0.1:44092 - "POST /node/69dc9fb05dbfa74e32f9bce9 HTTP/1.0" 202 Accepted 2026-04-15 07:48:05,113 - lava_callback - INFO - Starting async job submit for node 69dc9fb05dbfa74e32f9bce9 2026-04-15 07:48:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,128 - lava_callback - DEBUG - Processing node 69dc9fb05dbfa74e32f9bce9: baseline-arm64-clabbe 2026-04-15 07:48:05,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9fb05dbfa74e32f9bce9 2026-04-15 07:48:05,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:48:05,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:48:05,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9fb05dbfa74e32f9bce9 HTTP/1.1" 200 None 2026-04-15 07:48:05,176 - lava_callback - ERROR - Error processing callback for node 69dc9fb05dbfa74e32f9bce9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:49:25,124 - lava_callback - INFO - Received callback for node 69dc9ff45dbfa74e32f9bd2d INFO: 172.21.0.1:45496 - "POST /node/69dc9ff45dbfa74e32f9bd2d HTTP/1.0" 202 Accepted 2026-04-15 07:49:25,129 - lava_callback - INFO - Starting async job submit for node 69dc9ff45dbfa74e32f9bd2d 2026-04-15 07:49:25,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,145 - lava_callback - DEBUG - Processing node 69dc9ff45dbfa74e32f9bd2d: baseline-arm64-clabbe 2026-04-15 07:49:25,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dc9ff45dbfa74e32f9bd2d 2026-04-15 07:49:25,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:49:25,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:49:25,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dc9ff45dbfa74e32f9bd2d HTTP/1.1" 200 None 2026-04-15 07:49:25,200 - lava_callback - ERROR - Error processing callback for node 69dc9ff45dbfa74e32f9bd2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:50:25,169 - lava_callback - INFO - Received callback for node 69dca03a5dbfa74e32f9bd77 INFO: 172.21.0.1:56662 - "POST /node/69dca03a5dbfa74e32f9bd77 HTTP/1.0" 202 Accepted 2026-04-15 07:50:25,175 - lava_callback - INFO - Starting async job submit for node 69dca03a5dbfa74e32f9bd77 2026-04-15 07:50:25,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,191 - lava_callback - DEBUG - Processing node 69dca03a5dbfa74e32f9bd77: baseline-arm64-clabbe 2026-04-15 07:50:25,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca03a5dbfa74e32f9bd77 2026-04-15 07:50:25,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:50:25,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:50:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca03a5dbfa74e32f9bd77 HTTP/1.1" 200 None 2026-04-15 07:50:25,245 - lava_callback - ERROR - Error processing callback for node 69dca03a5dbfa74e32f9bd77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:51:45,271 - lava_callback - INFO - Received callback for node 69dca0845dbfa74e32f9bdbd INFO: 172.21.0.1:60734 - "POST /node/69dca0845dbfa74e32f9bdbd HTTP/1.0" 202 Accepted 2026-04-15 07:51:45,279 - lava_callback - INFO - Starting async job submit for node 69dca0845dbfa74e32f9bdbd 2026-04-15 07:51:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,312 - lava_callback - DEBUG - Processing node 69dca0845dbfa74e32f9bdbd: baseline-arm64-clabbe 2026-04-15 07:51:45,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0845dbfa74e32f9bdbd 2026-04-15 07:51:45,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:51:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:51:45,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0845dbfa74e32f9bdbd HTTP/1.1" 200 None 2026-04-15 07:51:45,371 - lava_callback - ERROR - Error processing callback for node 69dca0845dbfa74e32f9bdbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:52:45,278 - lava_callback - INFO - Received callback for node 69dca0c55dbfa74e32f9be0f INFO: 172.21.0.1:60398 - "POST /node/69dca0c55dbfa74e32f9be0f HTTP/1.0" 202 Accepted 2026-04-15 07:52:45,288 - lava_callback - INFO - Starting async job submit for node 69dca0c55dbfa74e32f9be0f 2026-04-15 07:52:45,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,317 - lava_callback - DEBUG - Processing node 69dca0c55dbfa74e32f9be0f: baseline-arm64-clabbe 2026-04-15 07:52:45,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0c55dbfa74e32f9be0f 2026-04-15 07:52:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 07:52:45,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:52:45,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0c55dbfa74e32f9be0f HTTP/1.1" 200 None 2026-04-15 07:52:45,374 - lava_callback - ERROR - Error processing callback for node 69dca0c55dbfa74e32f9be0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:53:37,660 - lava_callback - INFO - Received callback for node 69dca0fb5dbfa74e32f9be49 INFO: 172.21.0.1:34822 - "POST /node/69dca0fb5dbfa74e32f9be49 HTTP/1.0" 202 Accepted 2026-04-15 07:53:37,666 - lava_callback - INFO - Starting async job submit for node 69dca0fb5dbfa74e32f9be49 2026-04-15 07:53:37,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,682 - lava_callback - DEBUG - Processing node 69dca0fb5dbfa74e32f9be49: baseline-arm-baylibre 2026-04-15 07:53:37,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca0fb5dbfa74e32f9be49 2026-04-15 07:53:37,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:53:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:53:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca0fb5dbfa74e32f9be49 HTTP/1.1" 200 None 2026-04-15 07:53:37,730 - lava_callback - ERROR - Error processing callback for node 69dca0fb5dbfa74e32f9be49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:54:17,735 - lava_callback - INFO - Received callback for node 69dca11f5dbfa74e32f9be5d INFO: 172.21.0.1:60650 - "POST /node/69dca11f5dbfa74e32f9be5d HTTP/1.0" 202 Accepted 2026-04-15 07:54:17,741 - lava_callback - INFO - Starting async job submit for node 69dca11f5dbfa74e32f9be5d 2026-04-15 07:54:17,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,757 - lava_callback - DEBUG - Processing node 69dca11f5dbfa74e32f9be5d: baseline-arm-baylibre 2026-04-15 07:54:17,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca11f5dbfa74e32f9be5d 2026-04-15 07:54:17,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:54:17,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:17,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca11f5dbfa74e32f9be5d HTTP/1.1" 200 None 2026-04-15 07:54:17,804 - lava_callback - ERROR - Error processing callback for node 69dca11f5dbfa74e32f9be5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:54:57,795 - lava_callback - INFO - Received callback for node 69dca13e5dbfa74e32f9be88 INFO: 172.21.0.1:48356 - "POST /node/69dca13e5dbfa74e32f9be88 HTTP/1.0" 202 Accepted 2026-04-15 07:54:57,801 - lava_callback - INFO - Starting async job submit for node 69dca13e5dbfa74e32f9be88 2026-04-15 07:54:57,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,818 - lava_callback - DEBUG - Processing node 69dca13e5dbfa74e32f9be88: baseline-arm-baylibre 2026-04-15 07:54:57,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca13e5dbfa74e32f9be88 2026-04-15 07:54:57,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:54:57,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:54:57,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca13e5dbfa74e32f9be88 HTTP/1.1" 200 None 2026-04-15 07:54:57,900 - lava_callback - ERROR - Error processing callback for node 69dca13e5dbfa74e32f9be88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:55:25,416 - lava_callback - INFO - Received callback for node 69dca15f5dbfa74e32f9bea3 INFO: 172.21.0.1:52734 - "POST /node/69dca15f5dbfa74e32f9bea3 HTTP/1.0" 202 Accepted 2026-04-15 07:55:25,422 - lava_callback - INFO - Starting async job submit for node 69dca15f5dbfa74e32f9bea3 2026-04-15 07:55:25,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,439 - lava_callback - DEBUG - Processing node 69dca15f5dbfa74e32f9bea3: baseline-arm-clabbe 2026-04-15 07:55:25,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca15f5dbfa74e32f9bea3 2026-04-15 07:55:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:55:25,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:55:25,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca15f5dbfa74e32f9bea3 HTTP/1.1" 200 None 2026-04-15 07:55:25,503 - lava_callback - ERROR - Error processing callback for node 69dca15f5dbfa74e32f9bea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:56:05,386 - lava_callback - INFO - Received callback for node 69dca1815dbfa74e32f9bec7 INFO: 172.21.0.1:58898 - "POST /node/69dca1815dbfa74e32f9bec7 HTTP/1.0" 202 Accepted 2026-04-15 07:56:05,392 - lava_callback - INFO - Starting async job submit for node 69dca1815dbfa74e32f9bec7 2026-04-15 07:56:05,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,407 - lava_callback - DEBUG - Processing node 69dca1815dbfa74e32f9bec7: baseline-arm-clabbe 2026-04-15 07:56:05,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1815dbfa74e32f9bec7 2026-04-15 07:56:05,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:56:05,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:05,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1815dbfa74e32f9bec7 HTTP/1.1" 200 None 2026-04-15 07:56:05,456 - lava_callback - ERROR - Error processing callback for node 69dca1815dbfa74e32f9bec7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:56:25,470 - lava_callback - INFO - Received callback for node 69dca1a55dbfa74e32f9bed9 INFO: 172.21.0.1:58808 - "POST /node/69dca1a55dbfa74e32f9bed9 HTTP/1.0" 202 Accepted 2026-04-15 07:56:25,478 - lava_callback - INFO - Starting async job submit for node 69dca1a55dbfa74e32f9bed9 2026-04-15 07:56:25,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,513 - lava_callback - DEBUG - Processing node 69dca1a55dbfa74e32f9bed9: baseline-arm-clabbe 2026-04-15 07:56:25,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1a55dbfa74e32f9bed9 2026-04-15 07:56:25,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:56:25,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:56:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1a55dbfa74e32f9bed9 HTTP/1.1" 200 None 2026-04-15 07:56:25,565 - lava_callback - ERROR - Error processing callback for node 69dca1a55dbfa74e32f9bed9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:05,431 - lava_callback - INFO - Received callback for node 69dca1c15dbfa74e32f9bef0 INFO: 172.21.0.1:37442 - "POST /node/69dca1c15dbfa74e32f9bef0 HTTP/1.0" 202 Accepted 2026-04-15 07:57:05,440 - lava_callback - INFO - Starting async job submit for node 69dca1c15dbfa74e32f9bef0 2026-04-15 07:57:05,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,477 - lava_callback - DEBUG - Processing node 69dca1c15dbfa74e32f9bef0: baseline-arm-clabbe 2026-04-15 07:57:05,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1c15dbfa74e32f9bef0 2026-04-15 07:57:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:05,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:05,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1c15dbfa74e32f9bef0 HTTP/1.1" 200 None 2026-04-15 07:57:05,541 - lava_callback - ERROR - Error processing callback for node 69dca1c15dbfa74e32f9bef0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:45,525 - lava_callback - INFO - Received callback for node 69dca1e45dbfa74e32f9bf1d INFO: 172.21.0.1:44514 - "POST /node/69dca1e45dbfa74e32f9bf1d HTTP/1.0" 202 Accepted 2026-04-15 07:57:45,531 - lava_callback - INFO - Starting async job submit for node 69dca1e45dbfa74e32f9bf1d 2026-04-15 07:57:45,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,553 - lava_callback - DEBUG - Processing node 69dca1e45dbfa74e32f9bf1d: baseline-arm-clabbe 2026-04-15 07:57:45,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca1e45dbfa74e32f9bf1d 2026-04-15 07:57:45,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:45,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:45,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca1e45dbfa74e32f9bf1d HTTP/1.1" 200 None 2026-04-15 07:57:45,603 - lava_callback - ERROR - Error processing callback for node 69dca1e45dbfa74e32f9bf1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:57:57,981 - lava_callback - INFO - Received callback for node 69dca2025dbfa74e32f9bf34 INFO: 172.21.0.1:44706 - "POST /node/69dca2025dbfa74e32f9bf34 HTTP/1.0" 202 Accepted 2026-04-15 07:57:57,989 - lava_callback - INFO - Starting async job submit for node 69dca2025dbfa74e32f9bf34 2026-04-15 07:57:57,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,012 - lava_callback - DEBUG - Processing node 69dca2025dbfa74e32f9bf34: baseline-arm-baylibre 2026-04-15 07:57:58,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2025dbfa74e32f9bf34 2026-04-15 07:57:58,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:57:58,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:57:58,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2025dbfa74e32f9bf34 HTTP/1.1" 200 None 2026-04-15 07:57:58,068 - lava_callback - ERROR - Error processing callback for node 69dca2025dbfa74e32f9bf34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-04-15 07:58:45,591 - lava_callback - INFO - Received callback for node 69dca2275dbfa74e32f9bf5e INFO: 172.21.0.1:47554 - "POST /node/69dca2275dbfa74e32f9bf5e HTTP/1.0" 202 Accepted 2026-04-15 07:58:45,597 - lava_callback - INFO - Starting async job submit for node 69dca2275dbfa74e32f9bf5e 2026-04-15 07:58:45,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,613 - lava_callback - DEBUG - Processing node 69dca2275dbfa74e32f9bf5e: baseline-arm-clabbe 2026-04-15 07:58:45,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2275dbfa74e32f9bf5e 2026-04-15 07:58:45,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:58:45,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:45,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2275dbfa74e32f9bf5e HTTP/1.1" 200 None 2026-04-15 07:58:45,687 - lava_callback - ERROR - Error processing callback for node 69dca2275dbfa74e32f9bf5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:58:57,975 - lava_callback - INFO - Received callback for node 69dca2405dbfa74e32f9bf95 INFO: 172.21.0.1:44832 - "POST /node/69dca2405dbfa74e32f9bf95 HTTP/1.0" 202 Accepted 2026-04-15 07:58:57,981 - lava_callback - INFO - Starting async job submit for node 69dca2405dbfa74e32f9bf95 2026-04-15 07:58:57,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:57,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:57,997 - lava_callback - DEBUG - Processing node 69dca2405dbfa74e32f9bf95: baseline-arm-baylibre 2026-04-15 07:58:57,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2405dbfa74e32f9bf95 2026-04-15 07:58:57,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:58:58,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:58:58,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2405dbfa74e32f9bf95 HTTP/1.1" 200 None 2026-04-15 07:58:58,078 - lava_callback - ERROR - Error processing callback for node 69dca2405dbfa74e32f9bf95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK 2026-04-15 07:59:45,573 - lava_callback - INFO - Received callback for node 69dca2645dbfa74e32f9bfbe INFO: 172.21.0.1:50204 - "POST /node/69dca2645dbfa74e32f9bfbe HTTP/1.0" 202 Accepted 2026-04-15 07:59:45,582 - lava_callback - INFO - Starting async job submit for node 69dca2645dbfa74e32f9bfbe 2026-04-15 07:59:45,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,599 - lava_callback - DEBUG - Processing node 69dca2645dbfa74e32f9bfbe: baseline-arm-clabbe 2026-04-15 07:59:45,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2645dbfa74e32f9bfbe 2026-04-15 07:59:45,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 07:59:45,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 07:59:45,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2645dbfa74e32f9bfbe HTTP/1.1" 200 None 2026-04-15 07:59:45,661 - lava_callback - ERROR - Error processing callback for node 69dca2645dbfa74e32f9bfbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:00:25,594 - lava_callback - INFO - Received callback for node 69dca2865dbfa74e32f9bfd4 INFO: 172.21.0.1:41370 - "POST /node/69dca2865dbfa74e32f9bfd4 HTTP/1.0" 202 Accepted 2026-04-15 08:00:25,600 - lava_callback - INFO - Starting async job submit for node 69dca2865dbfa74e32f9bfd4 2026-04-15 08:00:25,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,624 - lava_callback - DEBUG - Processing node 69dca2865dbfa74e32f9bfd4: baseline-arm-clabbe 2026-04-15 08:00:25,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2865dbfa74e32f9bfd4 2026-04-15 08:00:25,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:00:25,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:25,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2865dbfa74e32f9bfd4 HTTP/1.1" 200 None 2026-04-15 08:00:25,692 - lava_callback - ERROR - Error processing callback for node 69dca2865dbfa74e32f9bfd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:00:38,118 - lava_callback - INFO - Received callback for node 69dca2a35dbfa74e32f9bffa INFO: 172.21.0.1:48600 - "POST /node/69dca2a35dbfa74e32f9bffa HTTP/1.0" 202 Accepted 2026-04-15 08:00:38,128 - lava_callback - INFO - Starting async job submit for node 69dca2a35dbfa74e32f9bffa 2026-04-15 08:00:38,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,145 - lava_callback - DEBUG - Processing node 69dca2a35dbfa74e32f9bffa: baseline-arm-baylibre 2026-04-15 08:00:38,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2a35dbfa74e32f9bffa 2026-04-15 08:00:38,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:00:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:00:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2a35dbfa74e32f9bffa HTTP/1.1" 200 None 2026-04-15 08:00:38,206 - lava_callback - ERROR - Error processing callback for node 69dca2a35dbfa74e32f9bffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:01:25,709 - lava_callback - INFO - Received callback for node 69dca2cc5dbfa74e32f9c008 INFO: 172.21.0.1:60914 - "POST /node/69dca2cc5dbfa74e32f9c008 HTTP/1.0" 202 Accepted 2026-04-15 08:01:25,715 - lava_callback - INFO - Starting async job submit for node 69dca2cc5dbfa74e32f9c008 2026-04-15 08:01:25,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,731 - lava_callback - DEBUG - Processing node 69dca2cc5dbfa74e32f9c008: baseline-arm-clabbe 2026-04-15 08:01:25,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2cc5dbfa74e32f9c008 2026-04-15 08:01:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:01:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:01:25,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2cc5dbfa74e32f9c008 HTTP/1.1" 200 None 2026-04-15 08:01:25,778 - lava_callback - ERROR - Error processing callback for node 69dca2cc5dbfa74e32f9c008: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:05,581 - lava_callback - INFO - Received callback for node 69dca2ec5dbfa74e32f9c016 INFO: 172.21.0.1:34426 - "POST /node/69dca2ec5dbfa74e32f9c016 HTTP/1.0" 202 Accepted 2026-04-15 08:02:05,590 - lava_callback - INFO - Starting async job submit for node 69dca2ec5dbfa74e32f9c016 2026-04-15 08:02:05,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,607 - lava_callback - DEBUG - Processing node 69dca2ec5dbfa74e32f9c016: baseline-arm-clabbe 2026-04-15 08:02:05,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca2ec5dbfa74e32f9c016 2026-04-15 08:02:05,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:05,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:05,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca2ec5dbfa74e32f9c016 HTTP/1.1" 200 None 2026-04-15 08:02:05,675 - lava_callback - ERROR - Error processing callback for node 69dca2ec5dbfa74e32f9c016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:45,654 - lava_callback - INFO - Received callback for node 69dca3105dbfa74e32f9c03d INFO: 172.21.0.1:36698 - "POST /node/69dca3105dbfa74e32f9c03d HTTP/1.0" 202 Accepted 2026-04-15 08:02:45,660 - lava_callback - INFO - Starting async job submit for node 69dca3105dbfa74e32f9c03d 2026-04-15 08:02:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,676 - lava_callback - DEBUG - Processing node 69dca3105dbfa74e32f9c03d: baseline-arm-clabbe 2026-04-15 08:02:45,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3105dbfa74e32f9c03d 2026-04-15 08:02:45,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:45,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3105dbfa74e32f9c03d HTTP/1.1" 200 None 2026-04-15 08:02:45,728 - lava_callback - ERROR - Error processing callback for node 69dca3105dbfa74e32f9c03d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:02:58,215 - lava_callback - INFO - Received callback for node 69dca32c5dbfa74e32f9c048 INFO: 172.21.0.1:46024 - "POST /node/69dca32c5dbfa74e32f9c048 HTTP/1.0" 202 Accepted 2026-04-15 08:02:58,224 - lava_callback - INFO - Starting async job submit for node 69dca32c5dbfa74e32f9c048 2026-04-15 08:02:58,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,247 - lava_callback - DEBUG - Processing node 69dca32c5dbfa74e32f9c048: baseline-arm-baylibre 2026-04-15 08:02:58,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca32c5dbfa74e32f9c048 2026-04-15 08:02:58,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:02:58,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:02:58,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca32c5dbfa74e32f9c048 HTTP/1.1" 200 None 2026-04-15 08:02:58,310 - lava_callback - ERROR - Error processing callback for node 69dca32c5dbfa74e32f9c048: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:03:45,756 - lava_callback - INFO - Received callback for node 69dca3505dbfa74e32f9c071 INFO: 172.21.0.1:39748 - "POST /node/69dca3505dbfa74e32f9c071 HTTP/1.0" 202 Accepted 2026-04-15 08:03:45,762 - lava_callback - INFO - Starting async job submit for node 69dca3505dbfa74e32f9c071 2026-04-15 08:03:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,778 - lava_callback - DEBUG - Processing node 69dca3505dbfa74e32f9c071: baseline-arm-clabbe 2026-04-15 08:03:45,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3505dbfa74e32f9c071 2026-04-15 08:03:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:03:45,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:03:45,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3505dbfa74e32f9c071 HTTP/1.1" 200 None 2026-04-15 08:03:45,828 - lava_callback - ERROR - Error processing callback for node 69dca3505dbfa74e32f9c071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:04:18,515 - lava_callback - INFO - Received callback for node 69dca36f5dbfa74e32f9c08e INFO: 172.21.0.1:44252 - "POST /node/69dca36f5dbfa74e32f9c08e HTTP/1.0" 202 Accepted 2026-04-15 08:04:18,520 - lava_callback - INFO - Starting async job submit for node 69dca36f5dbfa74e32f9c08e 2026-04-15 08:04:18,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,536 - lava_callback - DEBUG - Processing node 69dca36f5dbfa74e32f9c08e: baseline-arm-baylibre 2026-04-15 08:04:18,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca36f5dbfa74e32f9c08e 2026-04-15 08:04:18,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:04:18,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca36f5dbfa74e32f9c08e HTTP/1.1" 200 None 2026-04-15 08:04:18,593 - lava_callback - ERROR - Error processing callback for node 69dca36f5dbfa74e32f9c08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:04:38,311 - lava_callback - INFO - Received callback for node 69dca38d5dbfa74e32f9c0c2 INFO: 172.21.0.1:46230 - "POST /node/69dca38d5dbfa74e32f9c0c2 HTTP/1.0" 202 Accepted 2026-04-15 08:04:38,317 - lava_callback - INFO - Starting async job submit for node 69dca38d5dbfa74e32f9c0c2 2026-04-15 08:04:38,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,333 - lava_callback - DEBUG - Processing node 69dca38d5dbfa74e32f9c0c2: baseline-arm-baylibre 2026-04-15 08:04:38,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca38d5dbfa74e32f9c0c2 2026-04-15 08:04:38,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:04:38,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:04:38,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca38d5dbfa74e32f9c0c2 HTTP/1.1" 200 None 2026-04-15 08:04:38,384 - lava_callback - ERROR - Error processing callback for node 69dca38d5dbfa74e32f9c0c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:05:18,352 - lava_callback - INFO - Received callback for node 69dca3ac5dbfa74e32f9c0f3 INFO: 172.21.0.1:55130 - "POST /node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.0" 202 Accepted 2026-04-15 08:05:18,361 - lava_callback - INFO - Starting async job submit for node 69dca3ac5dbfa74e32f9c0f3 2026-04-15 08:05:18,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,376 - lava_callback - DEBUG - Processing node 69dca3ac5dbfa74e32f9c0f3: baseline-arm-baylibre 2026-04-15 08:05:18,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3ac5dbfa74e32f9c0f3 2026-04-15 08:05:18,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:05:18,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:18,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3ac5dbfa74e32f9c0f3 HTTP/1.1" 200 None 2026-04-15 08:05:18,432 - lava_callback - ERROR - Error processing callback for node 69dca3ac5dbfa74e32f9c0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:05:45,837 - lava_callback - INFO - Received callback for node 69dca3d05dbfa74e32f9c10f INFO: 172.21.0.1:37456 - "POST /node/69dca3d05dbfa74e32f9c10f HTTP/1.0" 202 Accepted 2026-04-15 08:05:45,842 - lava_callback - INFO - Starting async job submit for node 69dca3d05dbfa74e32f9c10f 2026-04-15 08:05:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,863 - lava_callback - DEBUG - Processing node 69dca3d05dbfa74e32f9c10f: baseline-arm-clabbe 2026-04-15 08:05:45,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3d05dbfa74e32f9c10f 2026-04-15 08:05:45,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:05:45,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:05:45,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3d05dbfa74e32f9c10f HTTP/1.1" 200 None 2026-04-15 08:05:45,912 - lava_callback - ERROR - Error processing callback for node 69dca3d05dbfa74e32f9c10f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:06:25,836 - lava_callback - INFO - Received callback for node 69dca3f45dbfa74e32f9c11e INFO: 172.21.0.1:48340 - "POST /node/69dca3f45dbfa74e32f9c11e HTTP/1.0" 202 Accepted 2026-04-15 08:06:25,842 - lava_callback - INFO - Starting async job submit for node 69dca3f45dbfa74e32f9c11e 2026-04-15 08:06:25,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,864 - lava_callback - DEBUG - Processing node 69dca3f45dbfa74e32f9c11e: baseline-arm-clabbe 2026-04-15 08:06:25,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca3f45dbfa74e32f9c11e 2026-04-15 08:06:25,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:06:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:25,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca3f45dbfa74e32f9c11e HTTP/1.1" 200 None 2026-04-15 08:06:25,912 - lava_callback - ERROR - Error processing callback for node 69dca3f45dbfa74e32f9c11e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:06:58,418 - lava_callback - INFO - Received callback for node 69dca4165dbfa74e32f9c12c INFO: 172.21.0.1:34134 - "POST /node/69dca4165dbfa74e32f9c12c HTTP/1.0" 202 Accepted 2026-04-15 08:06:58,427 - lava_callback - INFO - Starting async job submit for node 69dca4165dbfa74e32f9c12c 2026-04-15 08:06:58,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,464 - lava_callback - DEBUG - Processing node 69dca4165dbfa74e32f9c12c: baseline-arm-baylibre 2026-04-15 08:06:58,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4165dbfa74e32f9c12c 2026-04-15 08:06:58,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:06:58,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:06:58,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4165dbfa74e32f9c12c HTTP/1.1" 200 None 2026-04-15 08:06:58,541 - lava_callback - ERROR - Error processing callback for node 69dca4165dbfa74e32f9c12c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:07:38,437 - lava_callback - INFO - Received callback for node 69dca4385dbfa74e32f9c147 INFO: 172.21.0.1:36320 - "POST /node/69dca4385dbfa74e32f9c147 HTTP/1.0" 202 Accepted 2026-04-15 08:07:38,444 - lava_callback - INFO - Starting async job submit for node 69dca4385dbfa74e32f9c147 2026-04-15 08:07:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,461 - lava_callback - DEBUG - Processing node 69dca4385dbfa74e32f9c147: baseline-arm-baylibre 2026-04-15 08:07:38,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4385dbfa74e32f9c147 2026-04-15 08:07:38,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:07:38,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:07:38,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4385dbfa74e32f9c147 HTTP/1.1" 200 None 2026-04-15 08:07:38,521 - lava_callback - ERROR - Error processing callback for node 69dca4385dbfa74e32f9c147: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:08:05,938 - lava_callback - INFO - Received callback for node 69dca45c5dbfa74e32f9c158 INFO: 172.21.0.1:52212 - "POST /node/69dca45c5dbfa74e32f9c158 HTTP/1.0" 202 Accepted 2026-04-15 08:08:05,944 - lava_callback - INFO - Starting async job submit for node 69dca45c5dbfa74e32f9c158 2026-04-15 08:08:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:05,961 - lava_callback - DEBUG - Processing node 69dca45c5dbfa74e32f9c158: baseline-arm-clabbe 2026-04-15 08:08:05,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca45c5dbfa74e32f9c158 2026-04-15 08:08:05,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:05,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:08:05,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:06,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca45c5dbfa74e32f9c158 HTTP/1.1" 200 None 2026-04-15 08:08:06,024 - lava_callback - ERROR - Error processing callback for node 69dca45c5dbfa74e32f9c158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:08:45,906 - lava_callback - INFO - Received callback for node 69dca4795dbfa74e32f9c173 INFO: 172.21.0.1:51284 - "POST /node/69dca4795dbfa74e32f9c173 HTTP/1.0" 202 Accepted 2026-04-15 08:08:45,911 - lava_callback - INFO - Starting async job submit for node 69dca4795dbfa74e32f9c173 2026-04-15 08:08:45,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,928 - lava_callback - DEBUG - Processing node 69dca4795dbfa74e32f9c173: baseline-arm-clabbe 2026-04-15 08:08:45,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4795dbfa74e32f9c173 2026-04-15 08:08:45,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:08:45,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:08:45,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4795dbfa74e32f9c173 HTTP/1.1" 200 None 2026-04-15 08:08:45,981 - lava_callback - ERROR - Error processing callback for node 69dca4795dbfa74e32f9c173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:09:05,965 - lava_callback - INFO - Received callback for node 69dca4985dbfa74e32f9c1a6 INFO: 172.21.0.1:44230 - "POST /node/69dca4985dbfa74e32f9c1a6 HTTP/1.0" 202 Accepted 2026-04-15 08:09:05,971 - lava_callback - INFO - Starting async job submit for node 69dca4985dbfa74e32f9c1a6 2026-04-15 08:09:05,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:05,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:05,992 - lava_callback - DEBUG - Processing node 69dca4985dbfa74e32f9c1a6: baseline-arm-clabbe 2026-04-15 08:09:05,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4985dbfa74e32f9c1a6 2026-04-15 08:09:05,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:06,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:09:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4985dbfa74e32f9c1a6 HTTP/1.1" 200 None 2026-04-15 08:09:06,050 - lava_callback - ERROR - Error processing callback for node 69dca4985dbfa74e32f9c1a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:09:45,961 - lava_callback - INFO - Received callback for node 69dca4bc5dbfa74e32f9c1e0 INFO: 172.21.0.1:48702 - "POST /node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.0" 202 Accepted 2026-04-15 08:09:45,968 - lava_callback - INFO - Starting async job submit for node 69dca4bc5dbfa74e32f9c1e0 2026-04-15 08:09:45,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:45,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:45,989 - lava_callback - DEBUG - Processing node 69dca4bc5dbfa74e32f9c1e0: baseline-arm-clabbe 2026-04-15 08:09:45,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4bc5dbfa74e32f9c1e0 2026-04-15 08:09:45,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:46,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:09:46,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:09:46,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4bc5dbfa74e32f9c1e0 HTTP/1.1" 200 None 2026-04-15 08:09:46,049 - lava_callback - ERROR - Error processing callback for node 69dca4bc5dbfa74e32f9c1e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:10:06,014 - lava_callback - INFO - Received callback for node 69dca4da5dbfa74e32f9c210 INFO: 172.21.0.1:43858 - "POST /node/69dca4da5dbfa74e32f9c210 HTTP/1.0" 202 Accepted 2026-04-15 08:10:06,020 - lava_callback - INFO - Starting async job submit for node 69dca4da5dbfa74e32f9c210 2026-04-15 08:10:06,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,036 - lava_callback - DEBUG - Processing node 69dca4da5dbfa74e32f9c210: baseline-arm-clabbe 2026-04-15 08:10:06,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4da5dbfa74e32f9c210 2026-04-15 08:10:06,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:10:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:06,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4da5dbfa74e32f9c210 HTTP/1.1" 200 None 2026-04-15 08:10:06,083 - lava_callback - ERROR - Error processing callback for node 69dca4da5dbfa74e32f9c210: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:10:46,049 - lava_callback - INFO - Received callback for node 69dca4fb5dbfa74e32f9c22e INFO: 172.21.0.1:55006 - "POST /node/69dca4fb5dbfa74e32f9c22e HTTP/1.0" 202 Accepted 2026-04-15 08:10:46,055 - lava_callback - INFO - Starting async job submit for node 69dca4fb5dbfa74e32f9c22e 2026-04-15 08:10:46,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,070 - lava_callback - DEBUG - Processing node 69dca4fb5dbfa74e32f9c22e: baseline-arm-clabbe 2026-04-15 08:10:46,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca4fb5dbfa74e32f9c22e 2026-04-15 08:10:46,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:10:46,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:10:46,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca4fb5dbfa74e32f9c22e HTTP/1.1" 200 None 2026-04-15 08:10:46,130 - lava_callback - ERROR - Error processing callback for node 69dca4fb5dbfa74e32f9c22e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /node/698f5af23013abef95cf7751%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-15 08:11:26,133 - lava_callback - INFO - Received callback for node 69dca51e5dbfa74e32f9c246 INFO: 172.21.0.1:41506 - "POST /node/69dca51e5dbfa74e32f9c246 HTTP/1.0" 202 Accepted 2026-04-15 08:11:26,138 - lava_callback - INFO - Starting async job submit for node 69dca51e5dbfa74e32f9c246 2026-04-15 08:11:26,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,160 - lava_callback - DEBUG - Processing node 69dca51e5dbfa74e32f9c246: baseline-arm-clabbe 2026-04-15 08:11:26,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca51e5dbfa74e32f9c246 2026-04-15 08:11:26,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:11:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:26,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca51e5dbfa74e32f9c246 HTTP/1.1" 200 None 2026-04-15 08:11:26,222 - lava_callback - ERROR - Error processing callback for node 69dca51e5dbfa74e32f9c246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:11:46,078 - lava_callback - INFO - Received callback for node 69dca53e5dbfa74e32f9c268 INFO: 172.21.0.1:52206 - "POST /node/69dca53e5dbfa74e32f9c268 HTTP/1.0" 202 Accepted 2026-04-15 08:11:46,087 - lava_callback - INFO - Starting async job submit for node 69dca53e5dbfa74e32f9c268 2026-04-15 08:11:46,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,106 - lava_callback - DEBUG - Processing node 69dca53e5dbfa74e32f9c268: baseline-arm-clabbe 2026-04-15 08:11:46,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca53e5dbfa74e32f9c268 2026-04-15 08:11:46,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:11:46,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:11:46,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca53e5dbfa74e32f9c268 HTTP/1.1" 200 None 2026-04-15 08:11:46,165 - lava_callback - ERROR - Error processing callback for node 69dca53e5dbfa74e32f9c268: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40650 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:12:26,152 - lava_callback - INFO - Received callback for node 69dca5625dbfa74e32f9c27f INFO: 172.21.0.1:39078 - "POST /node/69dca5625dbfa74e32f9c27f HTTP/1.0" 202 Accepted 2026-04-15 08:12:26,160 - lava_callback - INFO - Starting async job submit for node 69dca5625dbfa74e32f9c27f 2026-04-15 08:12:26,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,187 - lava_callback - DEBUG - Processing node 69dca5625dbfa74e32f9c27f: baseline-arm-clabbe 2026-04-15 08:12:26,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca5625dbfa74e32f9c27f 2026-04-15 08:12:26,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f380f16ca753839b342e HTTP/1.1" 200 None 2026-04-15 08:12:26,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:12:26,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca5625dbfa74e32f9c27f HTTP/1.1" 200 None 2026-04-15 08:12:26,258 - lava_callback - ERROR - Error processing callback for node 69dca5625dbfa74e32f9c27f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]