INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:35:21,196 - lava_callback - INFO - Received callback for node 69e3b2417f5347282fbdbcbe 2026-04-18 16:35:21,203 - lava_callback - INFO - Starting async job submit for node 69e3b2417f5347282fbdbcbe INFO: 172.21.0.1:33350 - "POST /node/69e3b2417f5347282fbdbcbe HTTP/1.0" 202 Accepted 2026-04-18 16:35:21,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:35:21,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b2417f5347282fbdbcbe HTTP/1.1" 200 None 2026-04-18 16:35:21,269 - lava_callback - DEBUG - Processing node 69e3b2417f5347282fbdbcbe: baseline-arm 2026-04-18 16:35:21,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:35:21,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:35:21,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b2417f5347282fbdbcbe/log.txt.gz 2026-04-18 16:35:21,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:35:22,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:35:22,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b2417f5347282fbdbcbe/lava-logs.yaml 2026-04-18 16:35:22,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:35:22,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:35:22,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b2417f5347282fbdbcbe/lava_callback.json.gz 2026-04-18 16:35:22,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:35:22,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b2417f5347282fbdbcbe HTTP/1.1" 200 None 2026-04-18 16:35:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:35:22,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af027f5347282fbdbc7e HTTP/1.1" 200 None 2026-04-18 16:35:22,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:35:22,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b2417f5347282fbdbcbe HTTP/1.1" 200 None 2026-04-18 16:35:22,316 - lava_callback - INFO - Completed processing callback for node 69e3b2417f5347282fbdbcbe INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:35:52,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:35:52,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:41:02,773 - lava_callback - INFO - Received callback for node 69e111112eed175ae971a5ce INFO: 172.21.0.1:50714 - "POST /node/69e111112eed175ae971a5ce HTTP/1.0" 202 Accepted 2026-04-18 16:41:02,782 - lava_callback - INFO - Starting async job submit for node 69e111112eed175ae971a5ce 2026-04-18 16:41:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:02,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111112eed175ae971a5ce HTTP/1.1" 200 None 2026-04-18 16:41:02,800 - lava_callback - DEBUG - Processing node 69e111112eed175ae971a5ce: baseline-arm-baylibre 2026-04-18 16:41:02,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e111112eed175ae971a5ce 2026-04-18 16:41:02,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:02,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111112eed175ae971a5ce HTTP/1.1" 200 None 2026-04-18 16:41:02,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:02,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:41:02,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:02,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111112eed175ae971a5ce HTTP/1.1" 200 None 2026-04-18 16:41:02,863 - lava_callback - ERROR - Error processing callback for node 69e111112eed175ae971a5ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:41:42,417 - lava_callback - INFO - Received callback for node 69e1113b2eed175ae971a5dc INFO: 172.21.0.1:43516 - "POST /node/69e1113b2eed175ae971a5dc HTTP/1.0" 202 Accepted 2026-04-18 16:41:42,427 - lava_callback - INFO - Starting async job submit for node 69e1113b2eed175ae971a5dc 2026-04-18 16:41:42,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:42,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1113b2eed175ae971a5dc HTTP/1.1" 200 None 2026-04-18 16:41:42,455 - lava_callback - DEBUG - Processing node 69e1113b2eed175ae971a5dc: baseline-arm-baylibre 2026-04-18 16:41:42,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1113b2eed175ae971a5dc 2026-04-18 16:41:42,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1113b2eed175ae971a5dc HTTP/1.1" 200 None 2026-04-18 16:41:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:41:42,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:41:42,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1113b2eed175ae971a5dc HTTP/1.1" 200 None 2026-04-18 16:41:42,553 - lava_callback - ERROR - Error processing callback for node 69e1113b2eed175ae971a5dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:42:22,506 - lava_callback - INFO - Received callback for node 69e111622eed175ae971a5ea INFO: 172.21.0.1:36720 - "POST /node/69e111622eed175ae971a5ea HTTP/1.0" 202 Accepted 2026-04-18 16:42:22,514 - lava_callback - INFO - Starting async job submit for node 69e111622eed175ae971a5ea 2026-04-18 16:42:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:22,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111622eed175ae971a5ea HTTP/1.1" 200 None 2026-04-18 16:42:22,545 - lava_callback - DEBUG - Processing node 69e111622eed175ae971a5ea: baseline-arm-baylibre 2026-04-18 16:42:22,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e111622eed175ae971a5ea 2026-04-18 16:42:22,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:22,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111622eed175ae971a5ea HTTP/1.1" 200 None 2026-04-18 16:42:22,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:22,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:42:22,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:22,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111622eed175ae971a5ea HTTP/1.1" 200 None 2026-04-18 16:42:22,620 - lava_callback - ERROR - Error processing callback for node 69e111622eed175ae971a5ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:42:41,782 - lava_callback - INFO - Received callback for node 69e3b4777f5347282fbde3eb INFO: 172.21.0.1:46706 - "POST /node/69e3b4777f5347282fbde3eb HTTP/1.0" 202 Accepted 2026-04-18 16:42:41,788 - lava_callback - INFO - Starting async job submit for node 69e3b4777f5347282fbde3eb 2026-04-18 16:42:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:41,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4777f5347282fbde3eb HTTP/1.1" 200 None 2026-04-18 16:42:41,806 - lava_callback - DEBUG - Processing node 69e3b4777f5347282fbde3eb: baseline-arm 2026-04-18 16:42:41,811 - lava_callback - WARNING - Failed to upload log 2026-04-18 16:42:41,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:42:41,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:42:41,945 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4777f5347282fbde3eb/lava-logs.yaml 2026-04-18 16:42:41,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:42:42,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:42:42,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4777f5347282fbde3eb/lava_callback.json.gz 2026-04-18 16:42:42,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:42,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4777f5347282fbde3eb HTTP/1.1" 200 None 2026-04-18 16:42:42,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:42,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:42:42,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:42,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4777f5347282fbde3eb HTTP/1.1" 200 None 2026-04-18 16:42:42,159 - lava_callback - INFO - Completed processing callback for node 69e3b4777f5347282fbde3eb INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:42:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:42:52,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:02,473 - lava_callback - INFO - Received callback for node 69e1118a2eed175ae971a5f8 INFO: 172.21.0.1:54738 - "POST /node/69e1118a2eed175ae971a5f8 HTTP/1.0" 202 Accepted 2026-04-18 16:43:02,478 - lava_callback - INFO - Starting async job submit for node 69e1118a2eed175ae971a5f8 2026-04-18 16:43:02,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:02,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1118a2eed175ae971a5f8 HTTP/1.1" 200 None 2026-04-18 16:43:02,495 - lava_callback - DEBUG - Processing node 69e1118a2eed175ae971a5f8: baseline-arm-baylibre 2026-04-18 16:43:02,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1118a2eed175ae971a5f8 2026-04-18 16:43:02,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:02,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1118a2eed175ae971a5f8 HTTP/1.1" 200 None 2026-04-18 16:43:02,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:02,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:43:02,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:02,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1118a2eed175ae971a5f8 HTTP/1.1" 200 None 2026-04-18 16:43:02,547 - lava_callback - ERROR - Error processing callback for node 69e1118a2eed175ae971a5f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:43:03,761 - lava_callback - INFO - Received callback for node 69e3b4787f5347282fbde3ee INFO: 172.21.0.1:54750 - "POST /node/69e3b4787f5347282fbde3ee HTTP/1.0" 202 Accepted 2026-04-18 16:43:03,809 - lava_callback - INFO - Starting async job submit for node 69e3b4787f5347282fbde3ee 2026-04-18 16:43:03,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:03,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4787f5347282fbde3ee HTTP/1.1" 200 None 2026-04-18 16:43:03,844 - lava_callback - DEBUG - Processing node 69e3b4787f5347282fbde3ee: baseline-arm 2026-04-18 16:43:03,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:04,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:04,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4787f5347282fbde3ee/log.txt.gz 2026-04-18 16:43:04,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:04,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:04,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4787f5347282fbde3ee/lava-logs.yaml 2026-04-18 16:43:04,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:04,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:04,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4787f5347282fbde3ee/lava_callback.json.gz 2026-04-18 16:43:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:04,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4787f5347282fbde3ee HTTP/1.1" 200 None 2026-04-18 16:43:04,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:04,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:43:04,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:04,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4787f5347282fbde3ee HTTP/1.1" 200 None 2026-04-18 16:43:04,546 - lava_callback - INFO - Completed processing callback for node 69e3b4787f5347282fbde3ee INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:22,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:43:26,218 - lava_callback - INFO - Received callback for node 69e3b47b7f5347282fbde3f7 INFO: 172.21.0.1:48164 - "POST /node/69e3b47b7f5347282fbde3f7 HTTP/1.0" 202 Accepted 2026-04-18 16:43:26,266 - lava_callback - INFO - Starting async job submit for node 69e3b47b7f5347282fbde3f7 2026-04-18 16:43:26,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:26,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b47b7f5347282fbde3f7 HTTP/1.1" 200 None 2026-04-18 16:43:26,299 - lava_callback - DEBUG - Processing node 69e3b47b7f5347282fbde3f7: baseline-arm 2026-04-18 16:43:26,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:26,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:26,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47b7f5347282fbde3f7/log.txt.gz INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:26,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:26,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:26,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47b7f5347282fbde3f7/lava-logs.yaml 2026-04-18 16:43:26,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:26,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:26,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47b7f5347282fbde3f7/lava_callback.json.gz 2026-04-18 16:43:26,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:26,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b47b7f5347282fbde3f7 HTTP/1.1" 200 None 2026-04-18 16:43:26,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:26,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:43:26,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:26,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b47b7f5347282fbde3f7 HTTP/1.1" 200 None 2026-04-18 16:43:26,931 - lava_callback - INFO - Completed processing callback for node 69e3b47b7f5347282fbde3f7 INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:42,683 - lava_callback - INFO - Received callback for node 69e111b12eed175ae971a606 INFO: 172.21.0.1:57416 - "POST /node/69e111b12eed175ae971a606 HTTP/1.0" 202 Accepted 2026-04-18 16:43:42,689 - lava_callback - INFO - Starting async job submit for node 69e111b12eed175ae971a606 2026-04-18 16:43:42,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:42,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111b12eed175ae971a606 HTTP/1.1" 200 None 2026-04-18 16:43:42,705 - lava_callback - DEBUG - Processing node 69e111b12eed175ae971a606: baseline-arm-baylibre 2026-04-18 16:43:42,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e111b12eed175ae971a606 2026-04-18 16:43:42,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:42,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111b12eed175ae971a606 HTTP/1.1" 200 None 2026-04-18 16:43:42,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:43:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:42,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111b12eed175ae971a606 HTTP/1.1" 200 None 2026-04-18 16:43:42,757 - lava_callback - ERROR - Error processing callback for node 69e111b12eed175ae971a606: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:51,164 - lava_callback - INFO - Received callback for node 69e3b4767f5347282fbde3e8 INFO: 172.21.0.1:58298 - "POST /node/69e3b4767f5347282fbde3e8 HTTP/1.0" 202 Accepted 2026-04-18 16:43:51,169 - lava_callback - INFO - Starting async job submit for node 69e3b4767f5347282fbde3e8 2026-04-18 16:43:51,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:51,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4767f5347282fbde3e8 HTTP/1.1" 200 None 2026-04-18 16:43:51,206 - lava_callback - DEBUG - Processing node 69e3b4767f5347282fbde3e8: baseline-arm 2026-04-18 16:43:51,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:51,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:51,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4767f5347282fbde3e8/log.txt.gz 2026-04-18 16:43:51,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:51,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:51,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4767f5347282fbde3e8/lava-logs.yaml 2026-04-18 16:43:51,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:51,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:51,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4767f5347282fbde3e8/lava_callback.json.gz 2026-04-18 16:43:51,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:51,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4767f5347282fbde3e8 HTTP/1.1" 200 None 2026-04-18 16:43:51,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:51,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:43:51,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:51,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4767f5347282fbde3e8 HTTP/1.1" 200 None 2026-04-18 16:43:51,978 - lava_callback - INFO - Completed processing callback for node 69e3b4767f5347282fbde3e8 2026-04-18 16:43:52,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:52,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:43:52,699 - lava_callback - INFO - Received callback for node 69e3b47a7f5347282fbde3f4 INFO: 172.21.0.1:58302 - "POST /node/69e3b47a7f5347282fbde3f4 HTTP/1.0" 202 Accepted 2026-04-18 16:43:52,705 - lava_callback - INFO - Starting async job submit for node 69e3b47a7f5347282fbde3f4 2026-04-18 16:43:52,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:52,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b47a7f5347282fbde3f4 HTTP/1.1" 200 None 2026-04-18 16:43:52,742 - lava_callback - DEBUG - Processing node 69e3b47a7f5347282fbde3f4: baseline-arm 2026-04-18 16:43:52,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:53,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:53,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47a7f5347282fbde3f4/log.txt.gz 2026-04-18 16:43:53,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:53,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:53,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47a7f5347282fbde3f4/lava-logs.yaml 2026-04-18 16:43:53,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:43:53,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:43:53,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b47a7f5347282fbde3f4/lava_callback.json.gz 2026-04-18 16:43:53,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:53,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b47a7f5347282fbde3f4 HTTP/1.1" 200 None 2026-04-18 16:43:53,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:53,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:43:53,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:43:53,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b47a7f5347282fbde3f4 HTTP/1.1" 200 None 2026-04-18 16:43:53,496 - lava_callback - INFO - Completed processing callback for node 69e3b47a7f5347282fbde3f4 INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:43:59,962 - lava_callback - INFO - Received callback for node 69e3b4987f5347282fbde481 INFO: 172.21.0.1:41204 - "POST /node/69e3b4987f5347282fbde481 HTTP/1.0" 202 Accepted 2026-04-18 16:43:59,968 - lava_callback - INFO - Starting async job submit for node 69e3b4987f5347282fbde481 2026-04-18 16:43:59,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:00,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4987f5347282fbde481 HTTP/1.1" 200 None 2026-04-18 16:44:00,004 - lava_callback - DEBUG - Processing node 69e3b4987f5347282fbde481: baseline-arm-pengutronix 2026-04-18 16:44:00,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:00,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:00,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4987f5347282fbde481/log.txt.gz 2026-04-18 16:44:00,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:00,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:00,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4987f5347282fbde481/lava-logs.yaml 2026-04-18 16:44:00,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:00,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:00,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4987f5347282fbde481/lava_callback.json.gz 2026-04-18 16:44:00,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:00,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4987f5347282fbde481 HTTP/1.1" 200 None 2026-04-18 16:44:00,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:00,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:00,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:00,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4987f5347282fbde481 HTTP/1.1" 200 None 2026-04-18 16:44:00,666 - lava_callback - INFO - Completed processing callback for node 69e3b4987f5347282fbde481 2026-04-18 16:44:01,209 - lava_callback - INFO - Received callback for node 69e3b4b97f5347282fbde4d1 INFO: 172.21.0.1:41218 - "POST /node/69e3b4b97f5347282fbde4d1 HTTP/1.0" 202 Accepted 2026-04-18 16:44:01,215 - lava_callback - INFO - Starting async job submit for node 69e3b4b97f5347282fbde4d1 2026-04-18 16:44:01,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:01,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b97f5347282fbde4d1 HTTP/1.1" 200 None 2026-04-18 16:44:01,234 - lava_callback - DEBUG - Processing node 69e3b4b97f5347282fbde4d1: baseline-arm 2026-04-18 16:44:01,239 - lava_callback - WARNING - Failed to upload log 2026-04-18 16:44:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:01,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:01,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4b97f5347282fbde4d1/lava-logs.yaml 2026-04-18 16:44:01,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:01,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:01,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4b97f5347282fbde4d1/lava_callback.json.gz 2026-04-18 16:44:01,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:01,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b97f5347282fbde4d1 HTTP/1.1" 200 None 2026-04-18 16:44:01,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:01,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:01,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:01,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b97f5347282fbde4d1 HTTP/1.1" 200 None 2026-04-18 16:44:01,478 - lava_callback - INFO - Completed processing callback for node 69e3b4b97f5347282fbde4d1 INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:44:09,671 - lava_callback - INFO - Received callback for node 69e3b49b7f5347282fbde48b INFO: 172.21.0.1:41228 - "POST /node/69e3b49b7f5347282fbde48b HTTP/1.0" 202 Accepted 2026-04-18 16:44:09,717 - lava_callback - INFO - Starting async job submit for node 69e3b49b7f5347282fbde48b 2026-04-18 16:44:09,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:09,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b49b7f5347282fbde48b HTTP/1.1" 200 None 2026-04-18 16:44:09,754 - lava_callback - DEBUG - Processing node 69e3b49b7f5347282fbde48b: baseline-arm-pengutronix 2026-04-18 16:44:09,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:09,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:09,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b49b7f5347282fbde48b/log.txt.gz 2026-04-18 16:44:10,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:10,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:10,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b49b7f5347282fbde48b/lava-logs.yaml 2026-04-18 16:44:10,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:10,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:10,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b49b7f5347282fbde48b/lava_callback.json.gz 2026-04-18 16:44:10,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b49b7f5347282fbde48b HTTP/1.1" 200 None 2026-04-18 16:44:10,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:10,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:10,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b49b7f5347282fbde48b HTTP/1.1" 200 None 2026-04-18 16:44:10,309 - lava_callback - INFO - Completed processing callback for node 69e3b49b7f5347282fbde48b INFO: 172.21.0.1:35454 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 16:44:15,311 - lava_callback - INFO - Received callback for node 69e3b4997f5347282fbde488 INFO: 172.21.0.1:35468 - "POST /node/69e3b4997f5347282fbde488 HTTP/1.0" 202 Accepted 2026-04-18 16:44:15,320 - lava_callback - INFO - Starting async job submit for node 69e3b4997f5347282fbde488 2026-04-18 16:44:15,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:15,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4997f5347282fbde488 HTTP/1.1" 200 None 2026-04-18 16:44:15,372 - lava_callback - DEBUG - Processing node 69e3b4997f5347282fbde488: baseline-arm-pengutronix 2026-04-18 16:44:15,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:15,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:15,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4997f5347282fbde488/log.txt.gz 2026-04-18 16:44:15,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:15,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:15,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4997f5347282fbde488/lava-logs.yaml 2026-04-18 16:44:15,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:15,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:15,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e3b4997f5347282fbde488/lava_callback.json.gz 2026-04-18 16:44:15,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:15,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4997f5347282fbde488 HTTP/1.1" 200 None 2026-04-18 16:44:15,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:15,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:15,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:15,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4997f5347282fbde488 HTTP/1.1" 200 None 2026-04-18 16:44:15,986 - lava_callback - INFO - Completed processing callback for node 69e3b4997f5347282fbde488 2026-04-18 16:44:16,203 - lava_callback - INFO - Received callback for node 69e3b4877f5347282fbde416 INFO: 172.21.0.1:35482 - "POST /node/69e3b4877f5347282fbde416 HTTP/1.0" 202 Accepted 2026-04-18 16:44:16,211 - lava_callback - INFO - Starting async job submit for node 69e3b4877f5347282fbde416 2026-04-18 16:44:16,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:16,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4877f5347282fbde416 HTTP/1.1" 200 None 2026-04-18 16:44:16,267 - lava_callback - DEBUG - Processing node 69e3b4877f5347282fbde416: baseline-arm-broonie 2026-04-18 16:44:16,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:44:16,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:16,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4877f5347282fbde416/log.txt.gz 2026-04-18 16:44:16,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:16,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:16,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4877f5347282fbde416/lava-logs.yaml 2026-04-18 16:44:16,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:16,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:16,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4877f5347282fbde416/lava_callback.json.gz 2026-04-18 16:44:16,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:16,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4877f5347282fbde416 HTTP/1.1" 200 None 2026-04-18 16:44:16,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:16,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:16,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:16,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4877f5347282fbde416 HTTP/1.1" 200 None 2026-04-18 16:44:16,980 - lava_callback - INFO - Completed processing callback for node 69e3b4877f5347282fbde416 2026-04-18 16:44:17,696 - lava_callback - INFO - Received callback for node 69e3b4887f5347282fbde419 INFO: 172.21.0.1:35494 - "POST /node/69e3b4887f5347282fbde419 HTTP/1.0" 202 Accepted 2026-04-18 16:44:17,703 - lava_callback - INFO - Starting async job submit for node 69e3b4887f5347282fbde419 2026-04-18 16:44:17,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:17,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4887f5347282fbde419 HTTP/1.1" 200 None 2026-04-18 16:44:17,743 - lava_callback - DEBUG - Processing node 69e3b4887f5347282fbde419: baseline-arm-broonie 2026-04-18 16:44:17,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:18,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:18,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4887f5347282fbde419/log.txt.gz 2026-04-18 16:44:18,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:18,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:18,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4887f5347282fbde419/lava-logs.yaml 2026-04-18 16:44:18,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:18,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:18,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4887f5347282fbde419/lava_callback.json.gz 2026-04-18 16:44:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:18,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4887f5347282fbde419 HTTP/1.1" 200 None 2026-04-18 16:44:18,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:18,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:18,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:18,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4887f5347282fbde419 HTTP/1.1" 200 None 2026-04-18 16:44:18,530 - lava_callback - INFO - Completed processing callback for node 69e3b4887f5347282fbde419 2026-04-18 16:44:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-18 16:44:22,561 - lava_callback - INFO - Received callback for node 69e111d42eed175ae971a614 INFO: 172.21.0.1:41428 - "POST /node/69e111d42eed175ae971a614 HTTP/1.0" 202 Accepted 2026-04-18 16:44:22,566 - lava_callback - INFO - Starting async job submit for node 69e111d42eed175ae971a614 2026-04-18 16:44:22,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:22,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111d42eed175ae971a614 HTTP/1.1" 200 None 2026-04-18 16:44:22,582 - lava_callback - DEBUG - Processing node 69e111d42eed175ae971a614: baseline-arm-baylibre 2026-04-18 16:44:22,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e111d42eed175ae971a614 2026-04-18 16:44:22,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:22,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111d42eed175ae971a614 HTTP/1.1" 200 None 2026-04-18 16:44:22,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:22,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:44:22,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:22,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111d42eed175ae971a614 HTTP/1.1" 200 None 2026-04-18 16:44:22,632 - lava_callback - ERROR - Error processing callback for node 69e111d42eed175ae971a614: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:44:32,574 - lava_callback - INFO - Received callback for node 69e3b48a7f5347282fbde41c INFO: 172.21.0.1:46936 - "POST /node/69e3b48a7f5347282fbde41c HTTP/1.0" 202 Accepted 2026-04-18 16:44:32,580 - lava_callback - INFO - Starting async job submit for node 69e3b48a7f5347282fbde41c 2026-04-18 16:44:32,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:32,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b48a7f5347282fbde41c HTTP/1.1" 200 None 2026-04-18 16:44:32,640 - lava_callback - DEBUG - Processing node 69e3b48a7f5347282fbde41c: baseline-arm-broonie 2026-04-18 16:44:32,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:32,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:32,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b48a7f5347282fbde41c/log.txt.gz 2026-04-18 16:44:33,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:33,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:33,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b48a7f5347282fbde41c/lava-logs.yaml 2026-04-18 16:44:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:33,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:33,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b48a7f5347282fbde41c/lava_callback.json.gz 2026-04-18 16:44:33,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:33,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b48a7f5347282fbde41c HTTP/1.1" 200 None 2026-04-18 16:44:33,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:33,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:33,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:33,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b48a7f5347282fbde41c HTTP/1.1" 200 None 2026-04-18 16:44:33,484 - lava_callback - INFO - Completed processing callback for node 69e3b48a7f5347282fbde41c INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:44:52,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:52,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:44:52,818 - lava_callback - INFO - Received callback for node 69e3b4867f5347282fbde413 INFO: 172.21.0.1:37160 - "POST /node/69e3b4867f5347282fbde413 HTTP/1.0" 202 Accepted 2026-04-18 16:44:52,824 - lava_callback - INFO - Starting async job submit for node 69e3b4867f5347282fbde413 2026-04-18 16:44:52,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:52,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4867f5347282fbde413 HTTP/1.1" 200 None 2026-04-18 16:44:52,861 - lava_callback - DEBUG - Processing node 69e3b4867f5347282fbde413: baseline-arm-broonie 2026-04-18 16:44:53,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:53,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:53,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4867f5347282fbde413/log.txt.gz 2026-04-18 16:44:53,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:53,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:53,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4867f5347282fbde413/lava-logs.yaml 2026-04-18 16:44:53,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:53,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:53,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e3b4867f5347282fbde413/lava_callback.json.gz 2026-04-18 16:44:53,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:53,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4867f5347282fbde413 HTTP/1.1" 200 None 2026-04-18 16:44:53,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:53,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:53,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:53,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4867f5347282fbde413 HTTP/1.1" 200 None 2026-04-18 16:44:53,932 - lava_callback - INFO - Completed processing callback for node 69e3b4867f5347282fbde413 2026-04-18 16:44:55,223 - lava_callback - INFO - Received callback for node 69e3b4947f5347282fbde46d INFO: 172.21.0.1:37166 - "POST /node/69e3b4947f5347282fbde46d HTTP/1.0" 202 Accepted 2026-04-18 16:44:55,229 - lava_callback - INFO - Starting async job submit for node 69e3b4947f5347282fbde46d 2026-04-18 16:44:55,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:55,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4947f5347282fbde46d HTTP/1.1" 200 None 2026-04-18 16:44:55,267 - lava_callback - DEBUG - Processing node 69e3b4947f5347282fbde46d: baseline-arm-kontron 2026-04-18 16:44:55,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:55,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:55,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4947f5347282fbde46d/log.txt.gz 2026-04-18 16:44:55,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:55,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:55,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4947f5347282fbde46d/lava-logs.yaml 2026-04-18 16:44:55,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:55,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:55,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4947f5347282fbde46d/lava_callback.json.gz 2026-04-18 16:44:55,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:55,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4947f5347282fbde46d HTTP/1.1" 200 None 2026-04-18 16:44:55,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:56,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:56,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:56,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4947f5347282fbde46d HTTP/1.1" 200 None 2026-04-18 16:44:56,036 - lava_callback - INFO - Completed processing callback for node 69e3b4947f5347282fbde46d INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:44:56,534 - lava_callback - INFO - Received callback for node 69e3b4957f5347282fbde470 INFO: 172.21.0.1:37196 - "POST /node/69e3b4957f5347282fbde470 HTTP/1.0" 202 Accepted 2026-04-18 16:44:56,540 - lava_callback - INFO - Starting async job submit for node 69e3b4957f5347282fbde470 2026-04-18 16:44:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:56,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4957f5347282fbde470 HTTP/1.1" 200 None 2026-04-18 16:44:56,579 - lava_callback - DEBUG - Processing node 69e3b4957f5347282fbde470: baseline-arm-kontron 2026-04-18 16:44:56,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:57,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:57,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4957f5347282fbde470/log.txt.gz 2026-04-18 16:44:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:57,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:57,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4957f5347282fbde470/lava-logs.yaml 2026-04-18 16:44:57,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:44:57,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:44:57,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e3b4957f5347282fbde470/lava_callback.json.gz 2026-04-18 16:44:57,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:57,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4957f5347282fbde470 HTTP/1.1" 200 None 2026-04-18 16:44:57,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:57,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:44:57,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:44:57,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4957f5347282fbde470 HTTP/1.1" 200 None 2026-04-18 16:44:57,516 - lava_callback - INFO - Completed processing callback for node 69e3b4957f5347282fbde470 INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:45:09,946 - lava_callback - INFO - Received callback for node 69e1120a2eed175ae971a66a INFO: 172.21.0.1:42138 - "POST /node/69e1120a2eed175ae971a66a HTTP/1.0" 202 Accepted 2026-04-18 16:45:09,951 - lava_callback - INFO - Starting async job submit for node 69e1120a2eed175ae971a66a 2026-04-18 16:45:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:09,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120a2eed175ae971a66a HTTP/1.1" 200 None 2026-04-18 16:45:09,968 - lava_callback - DEBUG - Processing node 69e1120a2eed175ae971a66a: baseline-arm-clabbe 2026-04-18 16:45:09,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1120a2eed175ae971a66a 2026-04-18 16:45:09,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:09,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120a2eed175ae971a66a HTTP/1.1" 200 None 2026-04-18 16:45:09,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:09,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:45:09,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:10,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1120a2eed175ae971a66a HTTP/1.1" 200 None 2026-04-18 16:45:10,016 - lava_callback - ERROR - Error processing callback for node 69e1120a2eed175ae971a66a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:45:22,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:22,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:45:22,676 - lava_callback - INFO - Received callback for node 69e1121d2eed175ae971a6bd INFO: 172.21.0.1:55866 - "POST /node/69e1121d2eed175ae971a6bd HTTP/1.0" 202 Accepted 2026-04-18 16:45:22,682 - lava_callback - INFO - Starting async job submit for node 69e1121d2eed175ae971a6bd 2026-04-18 16:45:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:22,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121d2eed175ae971a6bd HTTP/1.1" 200 None 2026-04-18 16:45:22,699 - lava_callback - DEBUG - Processing node 69e1121d2eed175ae971a6bd: baseline-arm64-baylibre 2026-04-18 16:45:22,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1121d2eed175ae971a6bd 2026-04-18 16:45:22,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:22,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121d2eed175ae971a6bd HTTP/1.1" 200 None 2026-04-18 16:45:22,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:22,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:22,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1121d2eed175ae971a6bd HTTP/1.1" 200 None 2026-04-18 16:45:22,756 - lava_callback - ERROR - Error processing callback for node 69e1121d2eed175ae971a6bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:23,350 - lava_callback - INFO - Received callback for node 69e1121e2eed175ae971a6c0 INFO: 172.21.0.1:55876 - "POST /node/69e1121e2eed175ae971a6c0 HTTP/1.0" 202 Accepted 2026-04-18 16:45:23,356 - lava_callback - INFO - Starting async job submit for node 69e1121e2eed175ae971a6c0 2026-04-18 16:45:23,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:23,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121e2eed175ae971a6c0 HTTP/1.1" 200 None 2026-04-18 16:45:23,372 - lava_callback - DEBUG - Processing node 69e1121e2eed175ae971a6c0: baseline-arm64-baylibre 2026-04-18 16:45:23,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1121e2eed175ae971a6c0 2026-04-18 16:45:23,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:23,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121e2eed175ae971a6c0 HTTP/1.1" 200 None 2026-04-18 16:45:23,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:23,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:23,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:23,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1121e2eed175ae971a6c0 HTTP/1.1" 200 None 2026-04-18 16:45:23,419 - lava_callback - ERROR - Error processing callback for node 69e1121e2eed175ae971a6c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:24,036 - lava_callback - INFO - Received callback for node 69e1121f2eed175ae971a6c3 INFO: 172.21.0.1:55890 - "POST /node/69e1121f2eed175ae971a6c3 HTTP/1.0" 202 Accepted 2026-04-18 16:45:24,042 - lava_callback - INFO - Starting async job submit for node 69e1121f2eed175ae971a6c3 2026-04-18 16:45:24,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:24,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121f2eed175ae971a6c3 HTTP/1.1" 200 None 2026-04-18 16:45:24,058 - lava_callback - DEBUG - Processing node 69e1121f2eed175ae971a6c3: baseline-arm64-baylibre 2026-04-18 16:45:24,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1121f2eed175ae971a6c3 2026-04-18 16:45:24,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:24,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121f2eed175ae971a6c3 HTTP/1.1" 200 None 2026-04-18 16:45:24,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:24,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:24,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1121f2eed175ae971a6c3 HTTP/1.1" 200 None 2026-04-18 16:45:24,117 - lava_callback - ERROR - Error processing callback for node 69e1121f2eed175ae971a6c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:45:42,661 - lava_callback - INFO - Received callback for node 69e112212eed175ae971a6ca INFO: 172.21.0.1:43586 - "POST /node/69e112212eed175ae971a6ca HTTP/1.0" 202 Accepted 2026-04-18 16:45:42,667 - lava_callback - INFO - Starting async job submit for node 69e112212eed175ae971a6ca 2026-04-18 16:45:42,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:42,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112212eed175ae971a6ca HTTP/1.1" 200 None 2026-04-18 16:45:42,682 - lava_callback - DEBUG - Processing node 69e112212eed175ae971a6ca: baseline-arm64-baylibre 2026-04-18 16:45:42,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112212eed175ae971a6ca 2026-04-18 16:45:42,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:42,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112212eed175ae971a6ca HTTP/1.1" 200 None 2026-04-18 16:45:42,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:42,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:42,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112212eed175ae971a6ca HTTP/1.1" 200 None 2026-04-18 16:45:42,728 - lava_callback - ERROR - Error processing callback for node 69e112212eed175ae971a6ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:43,307 - lava_callback - INFO - Received callback for node 69e112232eed175ae971a6d1 INFO: 172.21.0.1:43602 - "POST /node/69e112232eed175ae971a6d1 HTTP/1.0" 202 Accepted 2026-04-18 16:45:43,313 - lava_callback - INFO - Starting async job submit for node 69e112232eed175ae971a6d1 2026-04-18 16:45:43,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:43,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112232eed175ae971a6d1 HTTP/1.1" 200 None 2026-04-18 16:45:43,331 - lava_callback - DEBUG - Processing node 69e112232eed175ae971a6d1: baseline-arm64-baylibre 2026-04-18 16:45:43,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112232eed175ae971a6d1 2026-04-18 16:45:43,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:43,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112232eed175ae971a6d1 HTTP/1.1" 200 None 2026-04-18 16:45:43,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112232eed175ae971a6d1 HTTP/1.1" 200 None 2026-04-18 16:45:43,380 - lava_callback - ERROR - Error processing callback for node 69e112232eed175ae971a6d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:43,998 - lava_callback - INFO - Received callback for node 69e112242eed175ae971a6d4 INFO: 172.21.0.1:43604 - "POST /node/69e112242eed175ae971a6d4 HTTP/1.0" 202 Accepted 2026-04-18 16:45:44,004 - lava_callback - INFO - Starting async job submit for node 69e112242eed175ae971a6d4 2026-04-18 16:45:44,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:44,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112242eed175ae971a6d4 HTTP/1.1" 200 None 2026-04-18 16:45:44,019 - lava_callback - DEBUG - Processing node 69e112242eed175ae971a6d4: baseline-arm64-baylibre 2026-04-18 16:45:44,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112242eed175ae971a6d4 2026-04-18 16:45:44,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:44,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112242eed175ae971a6d4 HTTP/1.1" 200 None 2026-04-18 16:45:44,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:44,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:44,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112242eed175ae971a6d4 HTTP/1.1" 200 None 2026-04-18 16:45:44,068 - lava_callback - ERROR - Error processing callback for node 69e112242eed175ae971a6d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:45:49,946 - lava_callback - INFO - Received callback for node 69e112342eed175ae971a6fa INFO: 172.21.0.1:52782 - "POST /node/69e112342eed175ae971a6fa HTTP/1.0" 202 Accepted 2026-04-18 16:45:49,952 - lava_callback - INFO - Starting async job submit for node 69e112342eed175ae971a6fa 2026-04-18 16:45:49,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:49,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112342eed175ae971a6fa HTTP/1.1" 200 None 2026-04-18 16:45:49,967 - lava_callback - DEBUG - Processing node 69e112342eed175ae971a6fa: baseline-arm64-clabbe 2026-04-18 16:45:49,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112342eed175ae971a6fa 2026-04-18 16:45:49,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:49,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112342eed175ae971a6fa HTTP/1.1" 200 None 2026-04-18 16:45:49,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:49,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:49,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112342eed175ae971a6fa HTTP/1.1" 200 None 2026-04-18 16:45:50,015 - lava_callback - ERROR - Error processing callback for node 69e112342eed175ae971a6fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:50,640 - lava_callback - INFO - Received callback for node 69e112362eed175ae971a6fd INFO: 172.21.0.1:52796 - "POST /node/69e112362eed175ae971a6fd HTTP/1.0" 202 Accepted 2026-04-18 16:45:50,647 - lava_callback - INFO - Starting async job submit for node 69e112362eed175ae971a6fd 2026-04-18 16:45:50,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:50,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112362eed175ae971a6fd HTTP/1.1" 200 None 2026-04-18 16:45:50,663 - lava_callback - DEBUG - Processing node 69e112362eed175ae971a6fd: baseline-arm64-clabbe 2026-04-18 16:45:50,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112362eed175ae971a6fd 2026-04-18 16:45:50,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:50,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112362eed175ae971a6fd HTTP/1.1" 200 None 2026-04-18 16:45:50,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:50,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:50,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112362eed175ae971a6fd HTTP/1.1" 200 None 2026-04-18 16:45:50,712 - lava_callback - ERROR - Error processing callback for node 69e112362eed175ae971a6fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:51,349 - lava_callback - INFO - Received callback for node 69e112372eed175ae971a721 INFO: 172.21.0.1:52800 - "POST /node/69e112372eed175ae971a721 HTTP/1.0" 202 Accepted 2026-04-18 16:45:51,354 - lava_callback - INFO - Starting async job submit for node 69e112372eed175ae971a721 2026-04-18 16:45:51,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:51,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112372eed175ae971a721 HTTP/1.1" 200 None 2026-04-18 16:45:51,370 - lava_callback - DEBUG - Processing node 69e112372eed175ae971a721: baseline-arm64-clabbe 2026-04-18 16:45:51,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112372eed175ae971a721 2026-04-18 16:45:51,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:51,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112372eed175ae971a721 HTTP/1.1" 200 None 2026-04-18 16:45:51,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:51,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:51,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:51,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112372eed175ae971a721 HTTP/1.1" 200 None 2026-04-18 16:45:51,422 - lava_callback - ERROR - Error processing callback for node 69e112372eed175ae971a721: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:52,036 - lava_callback - INFO - Received callback for node 69e112382eed175ae971a724 INFO: 172.21.0.1:52808 - "POST /node/69e112382eed175ae971a724 HTTP/1.0" 202 Accepted 2026-04-18 16:45:52,042 - lava_callback - INFO - Starting async job submit for node 69e112382eed175ae971a724 2026-04-18 16:45:52,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112382eed175ae971a724 HTTP/1.1" 200 None 2026-04-18 16:45:52,058 - lava_callback - DEBUG - Processing node 69e112382eed175ae971a724: baseline-arm64-clabbe 2026-04-18 16:45:52,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112382eed175ae971a724 2026-04-18 16:45:52,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112382eed175ae971a724 HTTP/1.1" 200 None 2026-04-18 16:45:52,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:52,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112382eed175ae971a724 HTTP/1.1" 200 None 2026-04-18 16:45:52,115 - lava_callback - ERROR - Error processing callback for node 69e112382eed175ae971a724: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:52,732 - lava_callback - INFO - Received callback for node 69e112392eed175ae971a72b INFO: 172.21.0.1:52824 - "POST /node/69e112392eed175ae971a72b HTTP/1.0" 202 Accepted 2026-04-18 16:45:52,737 - lava_callback - INFO - Starting async job submit for node 69e112392eed175ae971a72b 2026-04-18 16:45:52,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112392eed175ae971a72b HTTP/1.1" 200 None 2026-04-18 16:45:52,754 - lava_callback - DEBUG - Processing node 69e112392eed175ae971a72b: baseline-arm64-clabbe 2026-04-18 16:45:52,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e112392eed175ae971a72b 2026-04-18 16:45:52,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112392eed175ae971a72b HTTP/1.1" 200 None 2026-04-18 16:45:52,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:52,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:52,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112392eed175ae971a72b HTTP/1.1" 200 None 2026-04-18 16:45:52,809 - lava_callback - ERROR - Error processing callback for node 69e112392eed175ae971a72b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:53,416 - lava_callback - INFO - Received callback for node 69e1123b2eed175ae971a731 INFO: 172.21.0.1:52836 - "POST /node/69e1123b2eed175ae971a731 HTTP/1.0" 202 Accepted 2026-04-18 16:45:53,421 - lava_callback - INFO - Starting async job submit for node 69e1123b2eed175ae971a731 2026-04-18 16:45:53,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:53,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123b2eed175ae971a731 HTTP/1.1" 200 None 2026-04-18 16:45:53,438 - lava_callback - DEBUG - Processing node 69e1123b2eed175ae971a731: baseline-arm64-clabbe 2026-04-18 16:45:53,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1123b2eed175ae971a731 2026-04-18 16:45:53,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:53,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123b2eed175ae971a731 HTTP/1.1" 200 None 2026-04-18 16:45:53,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:53,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1123b2eed175ae971a731 HTTP/1.1" 200 None 2026-04-18 16:45:53,491 - lava_callback - ERROR - Error processing callback for node 69e1123b2eed175ae971a731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:45:54,080 - lava_callback - INFO - Received callback for node 69e1123a2eed175ae971a72e INFO: 172.21.0.1:52844 - "POST /node/69e1123a2eed175ae971a72e HTTP/1.0" 202 Accepted 2026-04-18 16:45:54,085 - lava_callback - INFO - Starting async job submit for node 69e1123a2eed175ae971a72e 2026-04-18 16:45:54,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:54,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123a2eed175ae971a72e HTTP/1.1" 200 None 2026-04-18 16:45:54,102 - lava_callback - DEBUG - Processing node 69e1123a2eed175ae971a72e: baseline-arm64-clabbe 2026-04-18 16:45:54,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1123a2eed175ae971a72e 2026-04-18 16:45:54,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:54,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123a2eed175ae971a72e HTTP/1.1" 200 None 2026-04-18 16:45:54,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:54,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 16:45:54,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1123a2eed175ae971a72e HTTP/1.1" 200 None 2026-04-18 16:45:54,157 - lava_callback - ERROR - Error processing callback for node 69e1123a2eed175ae971a72e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:45:56,826 - lava_callback - INFO - Received callback for node 69e3b4b27f5347282fbde4c2 INFO: 172.21.0.1:52860 - "POST /node/69e3b4b27f5347282fbde4c2 HTTP/1.0" 202 Accepted 2026-04-18 16:45:56,832 - lava_callback - INFO - Starting async job submit for node 69e3b4b27f5347282fbde4c2 2026-04-18 16:45:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b27f5347282fbde4c2 HTTP/1.1" 200 None 2026-04-18 16:45:56,871 - lava_callback - DEBUG - Processing node 69e3b4b27f5347282fbde4c2: ltp-dio 2026-04-18 16:45:57,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:45:57,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:45:57,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e3b4b27f5347282fbde4c2/log.txt.gz 2026-04-18 16:45:57,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:45:57,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:45:57,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e3b4b27f5347282fbde4c2/lava-logs.yaml 2026-04-18 16:45:57,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:45:58,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:45:58,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e3b4b27f5347282fbde4c2/lava_callback.json.gz 2026-04-18 16:45:58,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:58,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b27f5347282fbde4c2 HTTP/1.1" 200 None 2026-04-18 16:45:58,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:58,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:45:58,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:45:58,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b27f5347282fbde4c2 HTTP/1.1" 200 None 2026-04-18 16:45:58,295 - lava_callback - INFO - Completed processing callback for node 69e3b4b27f5347282fbde4c2 INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:46:22,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:46:22,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:47:12,801 - lava_callback - INFO - Received callback for node 69e3b4ab7f5347282fbde495 INFO: 172.21.0.1:33778 - "POST /node/69e3b4ab7f5347282fbde495 HTTP/1.0" 202 Accepted 2026-04-18 16:47:12,808 - lava_callback - INFO - Starting async job submit for node 69e3b4ab7f5347282fbde495 2026-04-18 16:47:12,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:12,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ab7f5347282fbde495 HTTP/1.1" 200 None 2026-04-18 16:47:12,848 - lava_callback - DEBUG - Processing node 69e3b4ab7f5347282fbde495: ltp-cap_bounds 2026-04-18 16:47:13,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:13,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:13,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e3b4ab7f5347282fbde495/log.txt.gz 2026-04-18 16:47:13,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:13,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:13,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e3b4ab7f5347282fbde495/lava-logs.yaml 2026-04-18 16:47:13,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:13,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:13,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e3b4ab7f5347282fbde495/lava_callback.json.gz 2026-04-18 16:47:14,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:14,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ab7f5347282fbde495 HTTP/1.1" 200 None 2026-04-18 16:47:14,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:14,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:47:14,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:14,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4ab7f5347282fbde495 HTTP/1.1" 200 None 2026-04-18 16:47:14,067 - lava_callback - INFO - Completed processing callback for node 69e3b4ab7f5347282fbde495 INFO: 172.21.0.1:33782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:47:22,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:22,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:47:39,343 - lava_callback - INFO - Received callback for node 69e3b4ac7f5347282fbde498 INFO: 172.21.0.1:41180 - "POST /node/69e3b4ac7f5347282fbde498 HTTP/1.0" 202 Accepted 2026-04-18 16:47:39,351 - lava_callback - INFO - Starting async job submit for node 69e3b4ac7f5347282fbde498 2026-04-18 16:47:39,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:39,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ac7f5347282fbde498 HTTP/1.1" 200 None 2026-04-18 16:47:39,396 - lava_callback - DEBUG - Processing node 69e3b4ac7f5347282fbde498: ltp-containers 2026-04-18 16:47:39,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:39,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:39,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e3b4ac7f5347282fbde498/log.txt.gz 2026-04-18 16:47:40,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:40,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:40,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e3b4ac7f5347282fbde498/lava-logs.yaml 2026-04-18 16:47:40,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:40,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:40,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e3b4ac7f5347282fbde498/lava_callback.json.gz 2026-04-18 16:47:40,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:40,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ac7f5347282fbde498 HTTP/1.1" 200 None 2026-04-18 16:47:40,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:40,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:47:40,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:40,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4ac7f5347282fbde498 HTTP/1.1" 200 None 2026-04-18 16:47:40,646 - lava_callback - INFO - Completed processing callback for node 69e3b4ac7f5347282fbde498 INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:47:52,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:52,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:47:52,812 - lava_callback - INFO - Received callback for node 69e3b4be7f5347282fbde4de INFO: 172.21.0.1:41240 - "POST /node/69e3b4be7f5347282fbde4de HTTP/1.0" 202 Accepted 2026-04-18 16:47:52,819 - lava_callback - INFO - Starting async job submit for node 69e3b4be7f5347282fbde4de 2026-04-18 16:47:52,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:52,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4be7f5347282fbde4de HTTP/1.1" 200 None 2026-04-18 16:47:52,870 - lava_callback - DEBUG - Processing node 69e3b4be7f5347282fbde4de: ltp-syscalls 2026-04-18 16:47:53,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:53,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:53,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e3b4be7f5347282fbde4de/log.txt.gz 2026-04-18 16:47:54,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:54,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:54,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e3b4be7f5347282fbde4de/lava-logs.yaml 2026-04-18 16:47:54,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:47:54,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:47:54,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e3b4be7f5347282fbde4de/lava_callback.json.gz 2026-04-18 16:47:54,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:54,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4be7f5347282fbde4de HTTP/1.1" 200 None 2026-04-18 16:47:54,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:54,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:47:54,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:47:54,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4be7f5347282fbde4de HTTP/1.1" 200 None 2026-04-18 16:47:54,453 - lava_callback - INFO - Completed processing callback for node 69e3b4be7f5347282fbde4de INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:48:12,836 - lava_callback - INFO - Received callback for node 69e3b4b07f5347282fbde4be INFO: 172.21.0.1:53820 - "POST /node/69e3b4b07f5347282fbde4be HTTP/1.0" 202 Accepted 2026-04-18 16:48:12,843 - lava_callback - INFO - Starting async job submit for node 69e3b4b07f5347282fbde4be 2026-04-18 16:48:12,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:12,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b07f5347282fbde4be HTTP/1.1" 200 None 2026-04-18 16:48:12,922 - lava_callback - DEBUG - Processing node 69e3b4b07f5347282fbde4be: ltp-cve 2026-04-18 16:48:13,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:13,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:13,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e3b4b07f5347282fbde4be/log.txt.gz 2026-04-18 16:48:13,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:13,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:13,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e3b4b07f5347282fbde4be/lava-logs.yaml 2026-04-18 16:48:13,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:13,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:13,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e3b4b07f5347282fbde4be/lava_callback.json.gz 2026-04-18 16:48:14,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:14,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b07f5347282fbde4be HTTP/1.1" 200 None 2026-04-18 16:48:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:14,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:48:14,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:14,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b07f5347282fbde4be HTTP/1.1" 200 None 2026-04-18 16:48:14,117 - lava_callback - INFO - Completed processing callback for node 69e3b4b07f5347282fbde4be INFO: 172.21.0.1:53832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:48:22,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:22,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:48:53,156 - lava_callback - INFO - Received callback for node 69e3b4b47f5347282fbde4c6 INFO: 172.21.0.1:50334 - "POST /node/69e3b4b47f5347282fbde4c6 HTTP/1.0" 202 Accepted 2026-04-18 16:48:53,162 - lava_callback - INFO - Starting async job submit for node 69e3b4b47f5347282fbde4c6 2026-04-18 16:48:53,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:53,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b47f5347282fbde4c6 HTTP/1.1" 200 None 2026-04-18 16:48:53,203 - lava_callback - DEBUG - Processing node 69e3b4b47f5347282fbde4c6: ltp-fs_bind 2026-04-18 16:48:53,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:53,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:53,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e3b4b47f5347282fbde4c6/log.txt.gz 2026-04-18 16:48:53,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:54,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:54,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e3b4b47f5347282fbde4c6/lava-logs.yaml 2026-04-18 16:48:54,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:48:54,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:48:54,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e3b4b47f5347282fbde4c6/lava_callback.json.gz 2026-04-18 16:48:54,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:54,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b47f5347282fbde4c6 HTTP/1.1" 200 None 2026-04-18 16:48:54,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:54,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:48:54,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:48:54,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b47f5347282fbde4c6 HTTP/1.1" 200 None 2026-04-18 16:48:54,256 - lava_callback - INFO - Completed processing callback for node 69e3b4b47f5347282fbde4c6 INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:49:22,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:22,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:49:26,813 - lava_callback - INFO - Received callback for node 69e3b60d7f5347282fbde614 INFO: 172.21.0.1:56600 - "POST /node/69e3b60d7f5347282fbde614 HTTP/1.0" 202 Accepted 2026-04-18 16:49:26,821 - lava_callback - INFO - Starting async job submit for node 69e3b60d7f5347282fbde614 2026-04-18 16:49:26,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:26,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b60d7f5347282fbde614 HTTP/1.1" 200 None 2026-04-18 16:49:26,843 - lava_callback - DEBUG - Processing node 69e3b60d7f5347282fbde614: baseline-arm 2026-04-18 16:49:26,850 - lava_callback - WARNING - Failed to upload log 2026-04-18 16:49:26,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:49:26,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:49:26,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b60d7f5347282fbde614/lava-logs.yaml 2026-04-18 16:49:26,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:49:27,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:49:27,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b60d7f5347282fbde614/lava_callback.json.gz 2026-04-18 16:49:27,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:27,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b60d7f5347282fbde614 HTTP/1.1" 200 None 2026-04-18 16:49:27,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:27,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:49:27,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:27,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b60d7f5347282fbde614 HTTP/1.1" 200 None 2026-04-18 16:49:27,093 - lava_callback - INFO - Completed processing callback for node 69e3b60d7f5347282fbde614 INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:49:50,128 - lava_callback - INFO - Received callback for node 69e113202eed175ae971a8a2 INFO: 172.21.0.1:60836 - "POST /node/69e113202eed175ae971a8a2 HTTP/1.0" 202 Accepted 2026-04-18 16:49:50,133 - lava_callback - INFO - Starting async job submit for node 69e113202eed175ae971a8a2 2026-04-18 16:49:50,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:50,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113202eed175ae971a8a2 HTTP/1.1" 200 None 2026-04-18 16:49:50,149 - lava_callback - DEBUG - Processing node 69e113202eed175ae971a8a2: baseline-arm-clabbe 2026-04-18 16:49:50,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e113202eed175ae971a8a2 2026-04-18 16:49:50,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113202eed175ae971a8a2 HTTP/1.1" 200 None 2026-04-18 16:49:50,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:50,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:49:50,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:50,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e113202eed175ae971a8a2 HTTP/1.1" 200 None 2026-04-18 16:49:50,197 - lava_callback - ERROR - Error processing callback for node 69e113202eed175ae971a8a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:49:52,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:49:52,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:51:13,051 - lava_callback - INFO - Received callback for node 69e3b4b57f5347282fbde4c9 INFO: 172.21.0.1:44982 - "POST /node/69e3b4b57f5347282fbde4c9 HTTP/1.0" 202 Accepted 2026-04-18 16:51:13,058 - lava_callback - INFO - Starting async job submit for node 69e3b4b57f5347282fbde4c9 2026-04-18 16:51:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:13,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b57f5347282fbde4c9 HTTP/1.1" 200 None 2026-04-18 16:51:13,120 - lava_callback - DEBUG - Processing node 69e3b4b57f5347282fbde4c9: ltp-fsx 2026-04-18 16:51:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:13,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:13,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e3b4b57f5347282fbde4c9/log.txt.gz 2026-04-18 16:51:13,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:13,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:14,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e3b4b57f5347282fbde4c9/lava-logs.yaml 2026-04-18 16:51:14,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:14,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:14,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e3b4b57f5347282fbde4c9/lava_callback.json.gz 2026-04-18 16:51:14,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:14,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b57f5347282fbde4c9 HTTP/1.1" 200 None 2026-04-18 16:51:14,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:14,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:51:14,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b57f5347282fbde4c9 HTTP/1.1" 200 None 2026-04-18 16:51:14,201 - lava_callback - INFO - Completed processing callback for node 69e3b4b57f5347282fbde4c9 INFO: 172.21.0.1:44992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:51:22,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:22,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:51:36,681 - lava_callback - INFO - Received callback for node 69e3b4b77f5347282fbde4cc INFO: 172.21.0.1:38182 - "POST /node/69e3b4b77f5347282fbde4cc HTTP/1.0" 202 Accepted 2026-04-18 16:51:36,689 - lava_callback - INFO - Starting async job submit for node 69e3b4b77f5347282fbde4cc 2026-04-18 16:51:36,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b77f5347282fbde4cc HTTP/1.1" 200 None 2026-04-18 16:51:36,751 - lava_callback - DEBUG - Processing node 69e3b4b77f5347282fbde4cc: ltp-input 2026-04-18 16:51:37,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:37,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:37,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e3b4b77f5347282fbde4cc/log.txt.gz 2026-04-18 16:51:37,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:37,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:37,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e3b4b77f5347282fbde4cc/lava-logs.yaml 2026-04-18 16:51:37,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:51:37,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:51:37,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e3b4b77f5347282fbde4cc/lava_callback.json.gz 2026-04-18 16:51:37,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:37,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b77f5347282fbde4cc HTTP/1.1" 200 None 2026-04-18 16:51:37,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:37,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:51:37,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:37,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b77f5347282fbde4cc HTTP/1.1" 200 None 2026-04-18 16:51:37,886 - lava_callback - INFO - Completed processing callback for node 69e3b4b77f5347282fbde4cc INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:51:52,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:51:52,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:52:53,051 - lava_callback - INFO - Received callback for node 69e3b4b87f5347282fbde4cf INFO: 172.21.0.1:56534 - "POST /node/69e3b4b87f5347282fbde4cf HTTP/1.0" 202 Accepted 2026-04-18 16:52:53,057 - lava_callback - INFO - Starting async job submit for node 69e3b4b87f5347282fbde4cf 2026-04-18 16:52:53,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:53,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b87f5347282fbde4cf HTTP/1.1" 200 None 2026-04-18 16:52:53,100 - lava_callback - DEBUG - Processing node 69e3b4b87f5347282fbde4cf: ltp-ipc 2026-04-18 16:52:53,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:53,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:53,553 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e3b4b87f5347282fbde4cf/log.txt.gz 2026-04-18 16:52:53,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:54,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:54,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e3b4b87f5347282fbde4cf/lava-logs.yaml 2026-04-18 16:52:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:54,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:54,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e3b4b87f5347282fbde4cf/lava_callback.json.gz 2026-04-18 16:52:54,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:54,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4b87f5347282fbde4cf HTTP/1.1" 200 None 2026-04-18 16:52:54,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:54,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:52:54,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:54,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4b87f5347282fbde4cf HTTP/1.1" 200 None 2026-04-18 16:52:54,272 - lava_callback - INFO - Completed processing callback for node 69e3b4b87f5347282fbde4cf 2026-04-18 16:52:54,684 - lava_callback - INFO - Received callback for node 69e3b4ba7f5347282fbde4d5 INFO: 172.21.0.1:56540 - "POST /node/69e3b4ba7f5347282fbde4d5 HTTP/1.0" 202 Accepted 2026-04-18 16:52:54,691 - lava_callback - INFO - Starting async job submit for node 69e3b4ba7f5347282fbde4d5 2026-04-18 16:52:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:54,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ba7f5347282fbde4d5 HTTP/1.1" 200 None 2026-04-18 16:52:54,732 - lava_callback - DEBUG - Processing node 69e3b4ba7f5347282fbde4d5: ltp-pty 2026-04-18 16:52:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:55,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:55,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e3b4ba7f5347282fbde4d5/log.txt.gz 2026-04-18 16:52:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:55,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:55,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e3b4ba7f5347282fbde4d5/lava-logs.yaml 2026-04-18 16:52:55,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:55,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:55,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e3b4ba7f5347282fbde4d5/lava_callback.json.gz 2026-04-18 16:52:55,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:55,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ba7f5347282fbde4d5 HTTP/1.1" 200 None 2026-04-18 16:52:55,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:55,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:52:55,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:55,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4ba7f5347282fbde4d5 HTTP/1.1" 200 None 2026-04-18 16:52:55,727 - lava_callback - INFO - Completed processing callback for node 69e3b4ba7f5347282fbde4d5 INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:52:56,969 - lava_callback - INFO - Received callback for node 69e3b2437f5347282fbdbcc1 INFO: 172.21.0.1:56568 - "POST /node/69e3b2437f5347282fbdbcc1 HTTP/1.0" 202 Accepted 2026-04-18 16:52:56,976 - lava_callback - INFO - Starting async job submit for node 69e3b2437f5347282fbdbcc1 2026-04-18 16:52:57,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:57,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b2437f5347282fbdbcc1 HTTP/1.1" 200 None 2026-04-18 16:52:57,051 - lava_callback - DEBUG - Processing node 69e3b2437f5347282fbdbcc1: ltp-smoke 2026-04-18 16:52:57,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:57,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:57,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b2437f5347282fbdbcc1/log.txt.gz 2026-04-18 16:52:57,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:58,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:58,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b2437f5347282fbdbcc1/lava-logs.yaml 2026-04-18 16:52:58,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:52:58,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:52:58,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b2437f5347282fbdbcc1/lava_callback.json.gz 2026-04-18 16:52:58,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:58,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b2437f5347282fbdbcc1 HTTP/1.1" 200 None 2026-04-18 16:52:58,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:58,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af027f5347282fbdbc7e HTTP/1.1" 200 None 2026-04-18 16:52:58,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:52:58,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b2437f5347282fbdbcc1 HTTP/1.1" 200 None 2026-04-18 16:52:58,540 - lava_callback - INFO - Completed processing callback for node 69e3b2437f5347282fbdbcc1 INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:53:10,239 - lava_callback - INFO - Received callback for node 69e113e72eed175ae971a907 INFO: 172.21.0.1:58886 - "POST /node/69e113e72eed175ae971a907 HTTP/1.0" 202 Accepted 2026-04-18 16:53:10,244 - lava_callback - INFO - Starting async job submit for node 69e113e72eed175ae971a907 2026-04-18 16:53:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:53:10,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113e72eed175ae971a907 HTTP/1.1" 200 None 2026-04-18 16:53:10,260 - lava_callback - DEBUG - Processing node 69e113e72eed175ae971a907: baseline-arm-clabbe 2026-04-18 16:53:10,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e113e72eed175ae971a907 2026-04-18 16:53:10,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:53:10,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113e72eed175ae971a907 HTTP/1.1" 200 None 2026-04-18 16:53:10,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:53:10,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:53:10,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:53:10,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e113e72eed175ae971a907 HTTP/1.1" 200 None 2026-04-18 16:53:10,312 - lava_callback - ERROR - Error processing callback for node 69e113e72eed175ae971a907: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:53:22,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:53:22,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:54:44,554 - lava_callback - INFO - Received callback for node 69e3b73d7f5347282fbde6db INFO: 172.21.0.1:50728 - "POST /node/69e3b73d7f5347282fbde6db HTTP/1.0" 202 Accepted 2026-04-18 16:54:44,562 - lava_callback - INFO - Starting async job submit for node 69e3b73d7f5347282fbde6db 2026-04-18 16:54:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:44,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73d7f5347282fbde6db HTTP/1.1" 200 None 2026-04-18 16:54:44,601 - lava_callback - DEBUG - Processing node 69e3b73d7f5347282fbde6db: baseline-x86 2026-04-18 16:54:44,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:54:45,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:54:45,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73d7f5347282fbde6db/log.txt.gz 2026-04-18 16:54:45,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:54:45,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:54:45,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73d7f5347282fbde6db/lava-logs.yaml 2026-04-18 16:54:45,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:54:45,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:54:45,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73d7f5347282fbde6db/lava_callback.json.gz 2026-04-18 16:54:45,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:45,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73d7f5347282fbde6db HTTP/1.1" 200 None 2026-04-18 16:54:45,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:45,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 16:54:45,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:45,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b73d7f5347282fbde6db HTTP/1.1" 200 None 2026-04-18 16:54:45,694 - lava_callback - INFO - Completed processing callback for node 69e3b73d7f5347282fbde6db INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:54:52,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:52,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:54:59,637 - lava_callback - INFO - Received callback for node 69e3b73b7f5347282fbde6d2 INFO: 172.21.0.1:48470 - "POST /node/69e3b73b7f5347282fbde6d2 HTTP/1.0" 202 Accepted 2026-04-18 16:54:59,644 - lava_callback - INFO - Starting async job submit for node 69e3b73b7f5347282fbde6d2 2026-04-18 16:54:59,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:54:59,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73b7f5347282fbde6d2 HTTP/1.1" 200 None 2026-04-18 16:54:59,680 - lava_callback - DEBUG - Processing node 69e3b73b7f5347282fbde6d2: baseline-x86 2026-04-18 16:54:59,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:00,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:00,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d2/log.txt.gz 2026-04-18 16:55:00,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:00,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:00,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d2/lava-logs.yaml 2026-04-18 16:55:00,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:00,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:00,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d2/lava_callback.json.gz 2026-04-18 16:55:00,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:00,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73b7f5347282fbde6d2 HTTP/1.1" 200 None 2026-04-18 16:55:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:00,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 16:55:00,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:00,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b73b7f5347282fbde6d2 HTTP/1.1" 200 None 2026-04-18 16:55:00,749 - lava_callback - INFO - Completed processing callback for node 69e3b73b7f5347282fbde6d2 INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:55:13,131 - lava_callback - INFO - Received callback for node 69e3b4bb7f5347282fbde4d8 INFO: 172.21.0.1:42454 - "POST /node/69e3b4bb7f5347282fbde4d8 HTTP/1.0" 202 Accepted 2026-04-18 16:55:13,138 - lava_callback - INFO - Starting async job submit for node 69e3b4bb7f5347282fbde4d8 2026-04-18 16:55:13,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:13,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bb7f5347282fbde4d8 HTTP/1.1" 200 None 2026-04-18 16:55:13,274 - lava_callback - DEBUG - Processing node 69e3b4bb7f5347282fbde4d8: ltp-sched 2026-04-18 16:55:13,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:13,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:13,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e3b4bb7f5347282fbde4d8/log.txt.gz 2026-04-18 16:55:14,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:14,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:14,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e3b4bb7f5347282fbde4d8/lava-logs.yaml 2026-04-18 16:55:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:14,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:14,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e3b4bb7f5347282fbde4d8/lava_callback.json.gz 2026-04-18 16:55:14,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:14,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bb7f5347282fbde4d8 HTTP/1.1" 200 None 2026-04-18 16:55:14,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:14,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:55:14,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:14,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4bb7f5347282fbde4d8 HTTP/1.1" 200 None 2026-04-18 16:55:14,563 - lava_callback - INFO - Completed processing callback for node 69e3b4bb7f5347282fbde4d8 INFO: 172.21.0.1:42460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:55:22,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:22,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:55:37,062 - lava_callback - INFO - Received callback for node 69e3b4bc7f5347282fbde4db INFO: 172.21.0.1:54058 - "POST /node/69e3b4bc7f5347282fbde4db HTTP/1.0" 202 Accepted 2026-04-18 16:55:37,072 - lava_callback - INFO - Starting async job submit for node 69e3b4bc7f5347282fbde4db 2026-04-18 16:55:37,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:37,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bc7f5347282fbde4db HTTP/1.1" 200 None 2026-04-18 16:55:37,141 - lava_callback - DEBUG - Processing node 69e3b4bc7f5347282fbde4db: ltp-smoke 2026-04-18 16:55:37,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:37,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:37,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b4bc7f5347282fbde4db/log.txt.gz 2026-04-18 16:55:37,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:38,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:38,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b4bc7f5347282fbde4db/lava-logs.yaml 2026-04-18 16:55:38,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:38,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:38,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3b4bc7f5347282fbde4db/lava_callback.json.gz 2026-04-18 16:55:38,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:38,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bc7f5347282fbde4db HTTP/1.1" 200 None 2026-04-18 16:55:38,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:38,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:55:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:38,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4bc7f5347282fbde4db HTTP/1.1" 200 None 2026-04-18 16:55:38,660 - lava_callback - INFO - Completed processing callback for node 69e3b4bc7f5347282fbde4db INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:55:52,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:52,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:55:58,086 - lava_callback - INFO - Received callback for node 69e3b73b7f5347282fbde6d5 INFO: 172.21.0.1:42564 - "POST /node/69e3b73b7f5347282fbde6d5 HTTP/1.0" 202 Accepted 2026-04-18 16:55:58,096 - lava_callback - INFO - Starting async job submit for node 69e3b73b7f5347282fbde6d5 2026-04-18 16:55:58,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:58,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73b7f5347282fbde6d5 HTTP/1.1" 200 None 2026-04-18 16:55:58,149 - lava_callback - DEBUG - Processing node 69e3b73b7f5347282fbde6d5: baseline-x86 2026-04-18 16:55:58,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:58,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:58,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d5/log.txt.gz 2026-04-18 16:55:58,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:59,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:59,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d5/lava-logs.yaml 2026-04-18 16:55:59,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:55:59,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:55:59,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73b7f5347282fbde6d5/lava_callback.json.gz 2026-04-18 16:55:59,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:59,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73b7f5347282fbde6d5 HTTP/1.1" 200 None 2026-04-18 16:55:59,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:59,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 16:55:59,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:55:59,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b73b7f5347282fbde6d5 HTTP/1.1" 200 None 2026-04-18 16:55:59,555 - lava_callback - INFO - Completed processing callback for node 69e3b73b7f5347282fbde6d5 INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:56:22,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:22,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:56:30,419 - lava_callback - INFO - Received callback for node 69e114b92eed175ae971a970 INFO: 172.21.0.1:34898 - "POST /node/69e114b92eed175ae971a970 HTTP/1.0" 202 Accepted 2026-04-18 16:56:30,426 - lava_callback - INFO - Starting async job submit for node 69e114b92eed175ae971a970 2026-04-18 16:56:30,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:30,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114b92eed175ae971a970 HTTP/1.1" 200 None 2026-04-18 16:56:30,458 - lava_callback - DEBUG - Processing node 69e114b92eed175ae971a970: baseline-arm-clabbe 2026-04-18 16:56:30,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e114b92eed175ae971a970 2026-04-18 16:56:30,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114b92eed175ae971a970 HTTP/1.1" 200 None 2026-04-18 16:56:30,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:30,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 16:56:30,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:30,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e114b92eed175ae971a970 HTTP/1.1" 200 None 2026-04-18 16:56:30,516 - lava_callback - ERROR - Error processing callback for node 69e114b92eed175ae971a970: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 16:56:32,201 - lava_callback - INFO - Received callback for node 69e3b73e7f5347282fbde6de INFO: 172.21.0.1:34906 - "POST /node/69e3b73e7f5347282fbde6de HTTP/1.0" 202 Accepted 2026-04-18 16:56:32,209 - lava_callback - INFO - Starting async job submit for node 69e3b73e7f5347282fbde6de 2026-04-18 16:56:32,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:32,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73e7f5347282fbde6de HTTP/1.1" 200 None 2026-04-18 16:56:32,246 - lava_callback - DEBUG - Processing node 69e3b73e7f5347282fbde6de: baseline-x86 2026-04-18 16:56:32,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:32,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:32,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73e7f5347282fbde6de/log.txt.gz 2026-04-18 16:56:32,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:33,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:33,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73e7f5347282fbde6de/lava-logs.yaml 2026-04-18 16:56:33,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:33,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:33,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73e7f5347282fbde6de/lava_callback.json.gz 2026-04-18 16:56:33,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:33,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73e7f5347282fbde6de HTTP/1.1" 200 None 2026-04-18 16:56:33,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:33,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 16:56:33,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:33,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b73e7f5347282fbde6de HTTP/1.1" 200 None 2026-04-18 16:56:33,264 - lava_callback - INFO - Completed processing callback for node 69e3b73e7f5347282fbde6de INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:56:52,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:52,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 16:56:53,169 - lava_callback - INFO - Received callback for node 69e3b4c17f5347282fbde4e6 INFO: 172.21.0.1:38998 - "POST /node/69e3b4c17f5347282fbde4e6 HTTP/1.0" 202 Accepted 2026-04-18 16:56:53,180 - lava_callback - INFO - Starting async job submit for node 69e3b4c17f5347282fbde4e6 2026-04-18 16:56:53,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:53,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4c17f5347282fbde4e6 HTTP/1.1" 200 None 2026-04-18 16:56:53,224 - lava_callback - DEBUG - Processing node 69e3b4c17f5347282fbde4e6: ltp-timers 2026-04-18 16:56:53,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:53,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:53,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e3b4c17f5347282fbde4e6/log.txt.gz 2026-04-18 16:56:53,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:54,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:54,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e3b4c17f5347282fbde4e6/lava-logs.yaml 2026-04-18 16:56:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:56:54,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:56:54,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e3b4c17f5347282fbde4e6/lava_callback.json.gz 2026-04-18 16:56:54,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:54,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4c17f5347282fbde4e6 HTTP/1.1" 200 None 2026-04-18 16:56:54,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:56:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:56:54,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4c17f5347282fbde4e6 HTTP/1.1" 200 None 2026-04-18 16:56:54,358 - lava_callback - INFO - Completed processing callback for node 69e3b4c17f5347282fbde4e6 INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:57:22,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:22,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:57:33,175 - lava_callback - INFO - Received callback for node 69e3b4bf7f5347282fbde4e3 INFO: 172.21.0.1:52922 - "POST /node/69e3b4bf7f5347282fbde4e3 HTTP/1.0" 202 Accepted 2026-04-18 16:57:33,182 - lava_callback - INFO - Starting async job submit for node 69e3b4bf7f5347282fbde4e3 2026-04-18 16:57:33,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:33,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bf7f5347282fbde4e3 HTTP/1.1" 200 None 2026-04-18 16:57:33,229 - lava_callback - DEBUG - Processing node 69e3b4bf7f5347282fbde4e3: ltp-syscalls-ipc 2026-04-18 16:57:33,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:57:33,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:57:33,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e3b4bf7f5347282fbde4e3/log.txt.gz 2026-04-18 16:57:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:57:34,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:57:34,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e3b4bf7f5347282fbde4e3/lava-logs.yaml 2026-04-18 16:57:34,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:57:34,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:57:34,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e3b4bf7f5347282fbde4e3/lava_callback.json.gz 2026-04-18 16:57:34,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:34,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4bf7f5347282fbde4e3 HTTP/1.1" 200 None 2026-04-18 16:57:34,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:34,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:57:34,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:34,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4bf7f5347282fbde4e3 HTTP/1.1" 200 None 2026-04-18 16:57:34,664 - lava_callback - INFO - Completed processing callback for node 69e3b4bf7f5347282fbde4e3 INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:57:52,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:57:52,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:59:01,033 - lava_callback - INFO - Received callback for node 69e3b4797f5347282fbde3f1 INFO: 172.21.0.1:41352 - "POST /node/69e3b4797f5347282fbde3f1 HTTP/1.0" 202 Accepted 2026-04-18 16:59:01,040 - lava_callback - INFO - Starting async job submit for node 69e3b4797f5347282fbde3f1 2026-04-18 16:59:01,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:01,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4797f5347282fbde3f1 HTTP/1.1" 200 None 2026-04-18 16:59:01,113 - lava_callback - DEBUG - Processing node 69e3b4797f5347282fbde3f1: baseline-arm 2026-04-18 16:59:01,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:01,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:01,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4797f5347282fbde3f1/log.txt.gz 2026-04-18 16:59:02,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:02,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:02,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4797f5347282fbde3f1/lava-logs.yaml 2026-04-18 16:59:02,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:02,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:02,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3b4797f5347282fbde3f1/lava_callback.json.gz DEBUG: Setup failed for 69e3b4797f5347282fbde3f1. Transitting job node result: incomplete -> fail 2026-04-18 16:59:02,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:02,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4797f5347282fbde3f1 HTTP/1.1" 200 None 2026-04-18 16:59:02,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:02,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:59:02,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:02,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4797f5347282fbde3f1 HTTP/1.1" 200 None 2026-04-18 16:59:02,773 - lava_callback - INFO - Completed processing callback for node 69e3b4797f5347282fbde3f1 INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:59:13,276 - lava_callback - INFO - Received callback for node 69e3b4c27f5347282fbde4e9 INFO: 172.21.0.1:43926 - "POST /node/69e3b4c27f5347282fbde4e9 HTTP/1.0" 202 Accepted 2026-04-18 16:59:13,282 - lava_callback - INFO - Starting async job submit for node 69e3b4c27f5347282fbde4e9 2026-04-18 16:59:13,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:13,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4c27f5347282fbde4e9 HTTP/1.1" 200 None 2026-04-18 16:59:13,324 - lava_callback - DEBUG - Processing node 69e3b4c27f5347282fbde4e9: ltp-watchqueue 2026-04-18 16:59:13,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:13,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:13,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e3b4c27f5347282fbde4e9/log.txt.gz 2026-04-18 16:59:13,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:14,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:14,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e3b4c27f5347282fbde4e9/lava-logs.yaml 2026-04-18 16:59:14,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 16:59:14,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 16:59:14,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e3b4c27f5347282fbde4e9/lava_callback.json.gz 2026-04-18 16:59:14,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:14,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4c27f5347282fbde4e9 HTTP/1.1" 200 None 2026-04-18 16:59:14,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:14,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 16:59:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:14,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4c27f5347282fbde4e9 HTTP/1.1" 200 None 2026-04-18 16:59:14,354 - lava_callback - INFO - Completed processing callback for node 69e3b4c27f5347282fbde4e9 INFO: 172.21.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK 2026-04-18 16:59:22,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 16:59:22,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:00:10,671 - lava_callback - INFO - Received callback for node 69e1158b2eed175ae971a9c7 INFO: 172.21.0.1:42942 - "POST /node/69e1158b2eed175ae971a9c7 HTTP/1.0" 202 Accepted 2026-04-18 17:00:10,676 - lava_callback - INFO - Starting async job submit for node 69e1158b2eed175ae971a9c7 2026-04-18 17:00:10,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:10,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1158b2eed175ae971a9c7 HTTP/1.1" 200 None 2026-04-18 17:00:10,692 - lava_callback - DEBUG - Processing node 69e1158b2eed175ae971a9c7: baseline-arm-clabbe 2026-04-18 17:00:10,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1158b2eed175ae971a9c7 2026-04-18 17:00:10,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:10,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1158b2eed175ae971a9c7 HTTP/1.1" 200 None 2026-04-18 17:00:10,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:10,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 17:00:10,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:10,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1158b2eed175ae971a9c7 HTTP/1.1" 200 None 2026-04-18 17:00:10,739 - lava_callback - ERROR - Error processing callback for node 69e1158b2eed175ae971a9c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:00:50,603 - lava_callback - INFO - Received callback for node 69e115b32eed175ae971a9d7 INFO: 172.21.0.1:53172 - "POST /node/69e115b32eed175ae971a9d7 HTTP/1.0" 202 Accepted 2026-04-18 17:00:50,609 - lava_callback - INFO - Starting async job submit for node 69e115b32eed175ae971a9d7 2026-04-18 17:00:50,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:50,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e115b32eed175ae971a9d7 HTTP/1.1" 200 None 2026-04-18 17:00:50,627 - lava_callback - DEBUG - Processing node 69e115b32eed175ae971a9d7: baseline-arm-clabbe 2026-04-18 17:00:50,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e115b32eed175ae971a9d7 2026-04-18 17:00:50,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:50,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e115b32eed175ae971a9d7 HTTP/1.1" 200 None 2026-04-18 17:00:50,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:50,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 17:00:50,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:00:50,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e115b32eed175ae971a9d7 HTTP/1.1" 200 None 2026-04-18 17:00:50,681 - lava_callback - ERROR - Error processing callback for node 69e115b32eed175ae971a9d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:01:30,698 - lava_callback - INFO - Received callback for node 69e115d92eed175ae971a9e7 INFO: 172.21.0.1:45784 - "POST /node/69e115d92eed175ae971a9e7 HTTP/1.0" 202 Accepted 2026-04-18 17:01:30,704 - lava_callback - INFO - Starting async job submit for node 69e115d92eed175ae971a9e7 2026-04-18 17:01:30,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:01:30,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e115d92eed175ae971a9e7 HTTP/1.1" 200 None 2026-04-18 17:01:30,720 - lava_callback - DEBUG - Processing node 69e115d92eed175ae971a9e7: baseline-arm-clabbe 2026-04-18 17:01:30,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e115d92eed175ae971a9e7 2026-04-18 17:01:30,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:01:30,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e115d92eed175ae971a9e7 HTTP/1.1" 200 None 2026-04-18 17:01:30,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:01:30,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 17:01:30,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:01:30,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e115d92eed175ae971a9e7 HTTP/1.1" 200 None 2026-04-18 17:01:30,782 - lava_callback - ERROR - Error processing callback for node 69e115d92eed175ae971a9e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:03:30,733 - lava_callback - INFO - Received callback for node 69e116522eed175ae971aa1b INFO: 172.21.0.1:47874 - "POST /node/69e116522eed175ae971aa1b HTTP/1.0" 202 Accepted 2026-04-18 17:03:30,739 - lava_callback - INFO - Starting async job submit for node 69e116522eed175ae971aa1b 2026-04-18 17:03:30,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:03:30,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e116522eed175ae971aa1b HTTP/1.1" 200 None 2026-04-18 17:03:30,754 - lava_callback - DEBUG - Processing node 69e116522eed175ae971aa1b: baseline-arm-clabbe 2026-04-18 17:03:30,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e116522eed175ae971aa1b 2026-04-18 17:03:30,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:03:30,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e116522eed175ae971aa1b HTTP/1.1" 200 None 2026-04-18 17:03:30,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:03:30,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 17:03:30,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:03:30,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e116522eed175ae971aa1b HTTP/1.1" 200 None 2026-04-18 17:03:30,812 - lava_callback - ERROR - Error processing callback for node 69e116522eed175ae971aa1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:04:10,674 - lava_callback - INFO - Received callback for node 69e1167a2eed175ae971aa27 INFO: 172.21.0.1:57354 - "POST /node/69e1167a2eed175ae971aa27 HTTP/1.0" 202 Accepted 2026-04-18 17:04:10,679 - lava_callback - INFO - Starting async job submit for node 69e1167a2eed175ae971aa27 2026-04-18 17:04:10,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:04:10,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1167a2eed175ae971aa27 HTTP/1.1" 200 None 2026-04-18 17:04:10,695 - lava_callback - DEBUG - Processing node 69e1167a2eed175ae971aa27: baseline-arm-clabbe 2026-04-18 17:04:10,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1167a2eed175ae971aa27 2026-04-18 17:04:10,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:04:10,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1167a2eed175ae971aa27 HTTP/1.1" 200 None 2026-04-18 17:04:10,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:04:10,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 17:04:10,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:04:10,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1167a2eed175ae971aa27 HTTP/1.1" 200 None 2026-04-18 17:04:10,753 - lava_callback - ERROR - Error processing callback for node 69e1167a2eed175ae971aa27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55128 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:05:33,176 - lava_callback - INFO - Received callback for node 69e3b4ad7f5347282fbde49b INFO: 172.21.0.1:40554 - "POST /node/69e3b4ad7f5347282fbde49b HTTP/1.0" 202 Accepted 2026-04-18 17:05:33,223 - lava_callback - INFO - Starting async job submit for node 69e3b4ad7f5347282fbde49b 2026-04-18 17:05:33,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:05:33,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ad7f5347282fbde49b HTTP/1.1" 200 None 2026-04-18 17:05:33,294 - lava_callback - DEBUG - Processing node 69e3b4ad7f5347282fbde49b: ltp-controllers 2026-04-18 17:05:33,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:05:33,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:05:33,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3b4ad7f5347282fbde49b/log.txt.gz 2026-04-18 17:05:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:05:33,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:05:33,735 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3b4ad7f5347282fbde49b/lava-logs.yaml 2026-04-18 17:05:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:05:33,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:05:33,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3b4ad7f5347282fbde49b/lava_callback.json.gz 2026-04-18 17:05:33,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:05:33,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b4ad7f5347282fbde49b HTTP/1.1" 200 None 2026-04-18 17:05:33,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:05:33,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 17:05:33,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:05:33,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b4ad7f5347282fbde49b HTTP/1.1" 200 None 2026-04-18 17:05:33,990 - lava_callback - INFO - Completed processing callback for node 69e3b4ad7f5347282fbde49b INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:05:52,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:05:52,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:10:29,168 - lava_callback - INFO - Received callback for node 69e3b73c7f5347282fbde6d8 INFO: 172.21.0.1:41640 - "POST /node/69e3b73c7f5347282fbde6d8 HTTP/1.0" 202 Accepted 2026-04-18 17:10:29,176 - lava_callback - INFO - Starting async job submit for node 69e3b73c7f5347282fbde6d8 2026-04-18 17:10:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:10:29,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73c7f5347282fbde6d8 HTTP/1.1" 200 None 2026-04-18 17:10:29,237 - lava_callback - DEBUG - Processing node 69e3b73c7f5347282fbde6d8: baseline-x86 2026-04-18 17:10:30,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:10:30,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:10:30,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73c7f5347282fbde6d8/log.txt.gz 2026-04-18 17:10:30,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:10:31,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:10:31,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73c7f5347282fbde6d8/lava-logs.yaml 2026-04-18 17:10:31,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:10:31,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:10:31,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3b73c7f5347282fbde6d8/lava_callback.json.gz DEBUG: Setup failed for 69e3b73c7f5347282fbde6d8. Transitting job node result: incomplete -> fail 2026-04-18 17:10:31,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:10:31,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3b73c7f5347282fbde6d8 HTTP/1.1" 200 None 2026-04-18 17:10:31,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:10:31,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 17:10:31,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:10:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3b73c7f5347282fbde6d8 HTTP/1.1" 200 None 2026-04-18 17:10:31,590 - lava_callback - INFO - Completed processing callback for node 69e3b73c7f5347282fbde6d8 INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:10:52,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:10:52,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:12:22,236 - lava_callback - INFO - Received callback for node 69e3bb667f5347282fbde958 INFO: 172.21.0.1:53854 - "POST /node/69e3bb667f5347282fbde958 HTTP/1.0" 202 Accepted 2026-04-18 17:12:22,242 - lava_callback - INFO - Starting async job submit for node 69e3bb667f5347282fbde958 2026-04-18 17:12:22,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:12:22,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bb667f5347282fbde958 HTTP/1.1" 200 None 2026-04-18 17:12:22,261 - lava_callback - DEBUG - Processing node 69e3bb667f5347282fbde958: baseline-arm 2026-04-18 17:12:22,266 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:12:22,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:12:22,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:12:22,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3bb667f5347282fbde958/lava-logs.yaml 2026-04-18 17:12:22,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:12:22,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:12:22,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3bb667f5347282fbde958/lava_callback.json.gz 2026-04-18 17:12:22,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:12:22,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bb667f5347282fbde958 HTTP/1.1" 200 None 2026-04-18 17:12:22,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:12:22,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 17:12:22,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:12:22,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bb667f5347282fbde958 HTTP/1.1" 200 None 2026-04-18 17:12:22,551 - lava_callback - INFO - Completed processing callback for node 69e3bb667f5347282fbde958 2026-04-18 17:12:22,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:12:22,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:14:04,319 - lava_callback - INFO - Received callback for node 69e118d62eed175ae971b115 INFO: 172.21.0.1:36016 - "POST /node/69e118d62eed175ae971b115 HTTP/1.0" 202 Accepted 2026-04-18 17:14:04,324 - lava_callback - INFO - Starting async job submit for node 69e118d62eed175ae971b115 2026-04-18 17:14:04,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:14:04,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118d62eed175ae971b115 HTTP/1.1" 200 None 2026-04-18 17:14:04,349 - lava_callback - DEBUG - Processing node 69e118d62eed175ae971b115: baseline-arm-baylibre 2026-04-18 17:14:04,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e118d62eed175ae971b115 2026-04-18 17:14:04,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:14:04,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118d62eed175ae971b115 HTTP/1.1" 200 None 2026-04-18 17:14:04,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:14:04,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:14:04,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:14:04,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118d62eed175ae971b115 HTTP/1.1" 200 None 2026-04-18 17:14:04,412 - lava_callback - ERROR - Error processing callback for node 69e118d62eed175ae971b115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET /node/69933e0431166481c8dedc13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54032 - "GET /node/693f98620d8ce4018da9867f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:16:04,247 - lava_callback - INFO - Received callback for node 69e1194b2eed175ae971b141 INFO: 172.21.0.1:34166 - "POST /node/69e1194b2eed175ae971b141 HTTP/1.0" 202 Accepted 2026-04-18 17:16:04,256 - lava_callback - INFO - Starting async job submit for node 69e1194b2eed175ae971b141 2026-04-18 17:16:04,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:04,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1194b2eed175ae971b141 HTTP/1.1" 200 None 2026-04-18 17:16:04,273 - lava_callback - DEBUG - Processing node 69e1194b2eed175ae971b141: baseline-arm-baylibre 2026-04-18 17:16:04,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1194b2eed175ae971b141 2026-04-18 17:16:04,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:04,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1194b2eed175ae971b141 HTTP/1.1" 200 None 2026-04-18 17:16:04,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:04,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:16:04,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:04,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1194b2eed175ae971b141 HTTP/1.1" 200 None 2026-04-18 17:16:04,334 - lava_callback - ERROR - Error processing callback for node 69e1194b2eed175ae971b141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34178 - "GET /node/693f92bb0d8ce4018da97b42%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:16:44,270 - lava_callback - INFO - Received callback for node 69e119732eed175ae971b151 INFO: 172.21.0.1:46384 - "POST /node/69e119732eed175ae971b151 HTTP/1.0" 202 Accepted 2026-04-18 17:16:44,276 - lava_callback - INFO - Starting async job submit for node 69e119732eed175ae971b151 2026-04-18 17:16:44,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:44,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119732eed175ae971b151 HTTP/1.1" 200 None 2026-04-18 17:16:44,315 - lava_callback - DEBUG - Processing node 69e119732eed175ae971b151: baseline-arm-baylibre 2026-04-18 17:16:44,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e119732eed175ae971b151 2026-04-18 17:16:44,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:44,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119732eed175ae971b151 HTTP/1.1" 200 None 2026-04-18 17:16:44,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:44,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:16:44,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:16:44,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e119732eed175ae971b151 HTTP/1.1" 200 None 2026-04-18 17:16:44,385 - lava_callback - ERROR - Error processing callback for node 69e119732eed175ae971b151: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:17:24,332 - lava_callback - INFO - Received callback for node 69e119982eed175ae971b161 INFO: 172.21.0.1:33780 - "POST /node/69e119982eed175ae971b161 HTTP/1.0" 202 Accepted 2026-04-18 17:17:24,338 - lava_callback - INFO - Starting async job submit for node 69e119982eed175ae971b161 2026-04-18 17:17:24,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119982eed175ae971b161 HTTP/1.1" 200 None 2026-04-18 17:17:24,354 - lava_callback - DEBUG - Processing node 69e119982eed175ae971b161: baseline-arm-baylibre 2026-04-18 17:17:24,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e119982eed175ae971b161 2026-04-18 17:17:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:24,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119982eed175ae971b161 HTTP/1.1" 200 None 2026-04-18 17:17:24,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:24,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:17:24,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:24,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e119982eed175ae971b161 HTTP/1.1" 200 None 2026-04-18 17:17:24,403 - lava_callback - ERROR - Error processing callback for node 69e119982eed175ae971b161: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:17:48,596 - lava_callback - INFO - Received callback for node 69e3bcb07f5347282fbdea44 INFO: 172.21.0.1:59470 - "POST /node/69e3bcb07f5347282fbdea44 HTTP/1.0" 202 Accepted 2026-04-18 17:17:48,607 - lava_callback - INFO - Starting async job submit for node 69e3bcb07f5347282fbdea44 2026-04-18 17:17:48,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:48,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb07f5347282fbdea44 HTTP/1.1" 200 None 2026-04-18 17:17:48,628 - lava_callback - DEBUG - Processing node 69e3bcb07f5347282fbdea44: baseline-nfs-arm64 2026-04-18 17:17:48,630 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:17:48,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:17:48,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:17:48,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb07f5347282fbdea44/lava-logs.yaml 2026-04-18 17:17:48,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:17:48,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:17:48,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb07f5347282fbdea44/lava_callback.json.gz 2026-04-18 17:17:48,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:48,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb07f5347282fbdea44 HTTP/1.1" 200 None 2026-04-18 17:17:48,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:48,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:17:48,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:48,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb07f5347282fbdea44 HTTP/1.1" 200 None 2026-04-18 17:17:48,950 - lava_callback - INFO - Completed processing callback for node 69e3bcb07f5347282fbdea44 2026-04-18 17:17:50,815 - lava_callback - INFO - Received callback for node 69e3bc947f5347282fbde9de INFO: 172.21.0.1:57128 - "POST /node/69e3bc947f5347282fbde9de HTTP/1.0" 202 Accepted 2026-04-18 17:17:50,822 - lava_callback - INFO - Starting async job submit for node 69e3bc947f5347282fbde9de 2026-04-18 17:17:50,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:50,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc947f5347282fbde9de HTTP/1.1" 200 None 2026-04-18 17:17:50,857 - lava_callback - DEBUG - Processing node 69e3bc947f5347282fbde9de: baseline-arm64 2026-04-18 17:17:51,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:17:51,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:17:51,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc947f5347282fbde9de/log.txt.gz 2026-04-18 17:17:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:17:51,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:17:51,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc947f5347282fbde9de/lava-logs.yaml 2026-04-18 17:17:51,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:17:51,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:17:51,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc947f5347282fbde9de/lava_callback.json.gz 2026-04-18 17:17:51,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:51,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc947f5347282fbde9de HTTP/1.1" 200 None 2026-04-18 17:17:51,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:51,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:17:51,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:51,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc947f5347282fbde9de HTTP/1.1" 200 None 2026-04-18 17:17:51,535 - lava_callback - INFO - Completed processing callback for node 69e3bc947f5347282fbde9de 2026-04-18 17:17:52,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:17:52,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:11,414 - lava_callback - INFO - Received callback for node 69e119c42eed175ae971b173 INFO: 172.21.0.1:53532 - "POST /node/69e119c42eed175ae971b173 HTTP/1.0" 202 Accepted 2026-04-18 17:18:11,420 - lava_callback - INFO - Starting async job submit for node 69e119c42eed175ae971b173 2026-04-18 17:18:11,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:11,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119c42eed175ae971b173 HTTP/1.1" 200 None 2026-04-18 17:18:11,435 - lava_callback - DEBUG - Processing node 69e119c42eed175ae971b173: baseline-arm-clabbe 2026-04-18 17:18:11,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e119c42eed175ae971b173 2026-04-18 17:18:11,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:11,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119c42eed175ae971b173 HTTP/1.1" 200 None 2026-04-18 17:18:11,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:11,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:18:11,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:11,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e119c42eed175ae971b173 HTTP/1.1" 200 None 2026-04-18 17:18:11,492 - lava_callback - ERROR - Error processing callback for node 69e119c42eed175ae971b173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 17:18:15,418 - lava_callback - INFO - Received callback for node 69e3bc987f5347282fbde9ea INFO: 172.21.0.1:53556 - "POST /node/69e3bc987f5347282fbde9ea HTTP/1.0" 202 Accepted 2026-04-18 17:18:15,428 - lava_callback - INFO - Starting async job submit for node 69e3bc987f5347282fbde9ea 2026-04-18 17:18:15,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:15,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc987f5347282fbde9ea HTTP/1.1" 200 None 2026-04-18 17:18:15,537 - lava_callback - DEBUG - Processing node 69e3bc987f5347282fbde9ea: baseline-arm64 2026-04-18 17:18:15,690 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:18:15,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:15,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:15,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc987f5347282fbde9ea/lava-logs.yaml 2026-04-18 17:18:15,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:16,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:16,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc987f5347282fbde9ea/lava_callback.json.gz 2026-04-18 17:18:16,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:16,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc987f5347282fbde9ea HTTP/1.1" 200 None 2026-04-18 17:18:16,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:16,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:16,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:16,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc987f5347282fbde9ea HTTP/1.1" 200 None 2026-04-18 17:18:16,247 - lava_callback - INFO - Completed processing callback for node 69e3bc987f5347282fbde9ea INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:22,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:29,014 - lava_callback - INFO - Received callback for node 69e3bca07f5347282fbde9ff INFO: 172.21.0.1:53216 - "POST /node/69e3bca07f5347282fbde9ff HTTP/1.0" 202 Accepted 2026-04-18 17:18:29,020 - lava_callback - INFO - Starting async job submit for node 69e3bca07f5347282fbde9ff 2026-04-18 17:18:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:29,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca07f5347282fbde9ff HTTP/1.1" 200 None 2026-04-18 17:18:29,053 - lava_callback - DEBUG - Processing node 69e3bca07f5347282fbde9ff: baseline-arm64 INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:29,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:29,295 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca07f5347282fbde9ff/log.txt.gz 2026-04-18 17:18:29,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:29,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:29,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca07f5347282fbde9ff/lava-logs.yaml 2026-04-18 17:18:29,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:29,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:29,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca07f5347282fbde9ff/lava_callback.json.gz 2026-04-18 17:18:29,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:29,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca07f5347282fbde9ff HTTP/1.1" 200 None 2026-04-18 17:18:29,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:29,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:29,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:29,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca07f5347282fbde9ff HTTP/1.1" 200 None 2026-04-18 17:18:29,874 - lava_callback - INFO - Completed processing callback for node 69e3bca07f5347282fbde9ff 2026-04-18 17:18:30,580 - lava_callback - INFO - Received callback for node 69e3bc967f5347282fbde9e4 INFO: 172.21.0.1:45326 - "POST /node/69e3bc967f5347282fbde9e4 HTTP/1.0" 202 Accepted 2026-04-18 17:18:30,587 - lava_callback - INFO - Starting async job submit for node 69e3bc967f5347282fbde9e4 2026-04-18 17:18:30,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:30,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc967f5347282fbde9e4 HTTP/1.1" 200 None 2026-04-18 17:18:30,625 - lava_callback - DEBUG - Processing node 69e3bc967f5347282fbde9e4: baseline-arm64 2026-04-18 17:18:30,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:31,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:31,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc967f5347282fbde9e4/log.txt.gz 2026-04-18 17:18:31,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:31,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:31,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc967f5347282fbde9e4/lava-logs.yaml 2026-04-18 17:18:31,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:31,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:31,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc967f5347282fbde9e4/lava_callback.json.gz 2026-04-18 17:18:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc967f5347282fbde9e4 HTTP/1.1" 200 None 2026-04-18 17:18:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:31,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:31,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:31,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc967f5347282fbde9e4 HTTP/1.1" 200 None 2026-04-18 17:18:31,537 - lava_callback - INFO - Completed processing callback for node 69e3bc967f5347282fbde9e4 INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:38,437 - lava_callback - INFO - Received callback for node 69e3bc9e7f5347282fbde9f9 INFO: 172.21.0.1:45344 - "POST /node/69e3bc9e7f5347282fbde9f9 HTTP/1.0" 202 Accepted 2026-04-18 17:18:38,444 - lava_callback - INFO - Starting async job submit for node 69e3bc9e7f5347282fbde9f9 2026-04-18 17:18:38,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:38,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9e7f5347282fbde9f9 HTTP/1.1" 200 None 2026-04-18 17:18:38,485 - lava_callback - DEBUG - Processing node 69e3bc9e7f5347282fbde9f9: baseline-arm64 2026-04-18 17:18:38,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:39,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:39,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9e7f5347282fbde9f9/log.txt.gz 2026-04-18 17:18:39,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:39,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:39,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9e7f5347282fbde9f9/lava-logs.yaml 2026-04-18 17:18:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:39,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:39,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9e7f5347282fbde9f9/lava_callback.json.gz 2026-04-18 17:18:39,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:39,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9e7f5347282fbde9f9 HTTP/1.1" 200 None 2026-04-18 17:18:39,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:39,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:39,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:39,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc9e7f5347282fbde9f9 HTTP/1.1" 200 None 2026-04-18 17:18:39,696 - lava_callback - INFO - Completed processing callback for node 69e3bc9e7f5347282fbde9f9 2026-04-18 17:18:40,928 - lava_callback - INFO - Received callback for node 69e3bc9d7f5347282fbde9f6 INFO: 172.21.0.1:33334 - "POST /node/69e3bc9d7f5347282fbde9f6 HTTP/1.0" 202 Accepted 2026-04-18 17:18:40,935 - lava_callback - INFO - Starting async job submit for node 69e3bc9d7f5347282fbde9f6 2026-04-18 17:18:40,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:40,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9d7f5347282fbde9f6 HTTP/1.1" 200 None 2026-04-18 17:18:40,976 - lava_callback - DEBUG - Processing node 69e3bc9d7f5347282fbde9f6: baseline-arm64 2026-04-18 17:18:41,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:41,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:41,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9d7f5347282fbde9f6/log.txt.gz 2026-04-18 17:18:41,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:41,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:41,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9d7f5347282fbde9f6/lava-logs.yaml 2026-04-18 17:18:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:41,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:41,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9d7f5347282fbde9f6/lava_callback.json.gz 2026-04-18 17:18:42,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9d7f5347282fbde9f6 HTTP/1.1" 200 None 2026-04-18 17:18:42,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:42,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:42,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:42,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc9d7f5347282fbde9f6 HTTP/1.1" 200 None 2026-04-18 17:18:42,101 - lava_callback - INFO - Completed processing callback for node 69e3bc9d7f5347282fbde9f6 2026-04-18 17:18:43,220 - lava_callback - INFO - Received callback for node 69e3bca17f5347282fbdea02 INFO: 172.21.0.1:33338 - "POST /node/69e3bca17f5347282fbdea02 HTTP/1.0" 202 Accepted 2026-04-18 17:18:43,226 - lava_callback - INFO - Starting async job submit for node 69e3bca17f5347282fbdea02 2026-04-18 17:18:43,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:43,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca17f5347282fbdea02 HTTP/1.1" 200 None 2026-04-18 17:18:43,263 - lava_callback - DEBUG - Processing node 69e3bca17f5347282fbdea02: baseline-arm64 2026-04-18 17:18:43,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:43,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:43,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca17f5347282fbdea02/log.txt.gz 2026-04-18 17:18:43,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:44,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:44,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca17f5347282fbdea02/lava-logs.yaml 2026-04-18 17:18:44,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:44,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:44,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca17f5347282fbdea02/lava_callback.json.gz 2026-04-18 17:18:44,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:44,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca17f5347282fbdea02 HTTP/1.1" 200 None 2026-04-18 17:18:44,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:44,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:44,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca17f5347282fbdea02 HTTP/1.1" 200 None 2026-04-18 17:18:44,218 - lava_callback - INFO - Completed processing callback for node 69e3bca17f5347282fbdea02 2026-04-18 17:18:45,660 - lava_callback - INFO - Received callback for node 69e3bc957f5347282fbde9e1 INFO: 172.21.0.1:33348 - "POST /node/69e3bc957f5347282fbde9e1 HTTP/1.0" 202 Accepted 2026-04-18 17:18:45,667 - lava_callback - INFO - Starting async job submit for node 69e3bc957f5347282fbde9e1 2026-04-18 17:18:45,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:45,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc957f5347282fbde9e1 HTTP/1.1" 200 None 2026-04-18 17:18:45,708 - lava_callback - DEBUG - Processing node 69e3bc957f5347282fbde9e1: baseline-arm64 2026-04-18 17:18:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:46,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:46,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc957f5347282fbde9e1/log.txt.gz 2026-04-18 17:18:46,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:46,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:46,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc957f5347282fbde9e1/lava-logs.yaml 2026-04-18 17:18:46,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:46,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:46,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc957f5347282fbde9e1/lava_callback.json.gz 2026-04-18 17:18:46,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:46,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc957f5347282fbde9e1 HTTP/1.1" 200 None 2026-04-18 17:18:46,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:46,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:46,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc957f5347282fbde9e1 HTTP/1.1" 200 None 2026-04-18 17:18:46,550 - lava_callback - INFO - Completed processing callback for node 69e3bc957f5347282fbde9e1 2026-04-18 17:18:51,383 - lava_callback - INFO - Received callback for node 69e119eb2eed175ae971b181 INFO: 172.21.0.1:57460 - "POST /node/69e119eb2eed175ae971b181 HTTP/1.0" 202 Accepted 2026-04-18 17:18:51,388 - lava_callback - INFO - Starting async job submit for node 69e119eb2eed175ae971b181 2026-04-18 17:18:51,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:51,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119eb2eed175ae971b181 HTTP/1.1" 200 None 2026-04-18 17:18:51,404 - lava_callback - DEBUG - Processing node 69e119eb2eed175ae971b181: baseline-arm-clabbe 2026-04-18 17:18:51,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e119eb2eed175ae971b181 2026-04-18 17:18:51,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:51,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e119eb2eed175ae971b181 HTTP/1.1" 200 None 2026-04-18 17:18:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:51,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:18:51,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:51,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e119eb2eed175ae971b181 HTTP/1.1" 200 None 2026-04-18 17:18:51,480 - lava_callback - ERROR - Error processing callback for node 69e119eb2eed175ae971b181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 17:18:52,053 - lava_callback - INFO - Received callback for node 69e3bc9f7f5347282fbde9fc INFO: 172.21.0.1:57464 - "POST /node/69e3bc9f7f5347282fbde9fc HTTP/1.0" 202 Accepted 2026-04-18 17:18:52,059 - lava_callback - INFO - Starting async job submit for node 69e3bc9f7f5347282fbde9fc 2026-04-18 17:18:52,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:52,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9f7f5347282fbde9fc HTTP/1.1" 200 None 2026-04-18 17:18:52,094 - lava_callback - DEBUG - Processing node 69e3bc9f7f5347282fbde9fc: baseline-arm64 2026-04-18 17:18:52,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:52,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:52,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9f7f5347282fbde9fc/log.txt.gz 2026-04-18 17:18:52,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:52,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:52,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-18 17:18:53,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:53,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9f7f5347282fbde9fc/lava-logs.yaml 2026-04-18 17:18:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:53,173 - lava_callback - INFO - Received callback for node 69e3bca57f5347282fbdea0c 2026-04-18 17:18:53,181 - lava_callback - INFO - Starting async job submit for node 69e3bca57f5347282fbdea0c INFO: 172.21.0.1:57478 - "POST /node/69e3bca57f5347282fbdea0c HTTP/1.0" 202 Accepted 2026-04-18 17:18:53,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:53,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca57f5347282fbdea0c HTTP/1.1" 200 None 2026-04-18 17:18:53,228 - lava_callback - DEBUG - Processing node 69e3bca57f5347282fbdea0c: baseline-arm64 2026-04-18 17:18:53,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:53,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9f7f5347282fbde9fc/lava_callback.json.gz 2026-04-18 17:18:53,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9f7f5347282fbde9fc HTTP/1.1" 200 None 2026-04-18 17:18:53,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:53,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:53,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:53,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:53,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc9f7f5347282fbde9fc HTTP/1.1" 200 None 2026-04-18 17:18:53,630 - lava_callback - INFO - Completed processing callback for node 69e3bc9f7f5347282fbde9fc 2026-04-18 17:18:53,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:53,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca57f5347282fbdea0c/log.txt.gz 2026-04-18 17:18:53,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:54,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:54,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca57f5347282fbdea0c/lava-logs.yaml 2026-04-18 17:18:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:54,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:54,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca57f5347282fbdea0c/lava_callback.json.gz 2026-04-18 17:18:54,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:54,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca57f5347282fbdea0c HTTP/1.1" 200 None 2026-04-18 17:18:54,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:54,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:54,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca57f5347282fbdea0c HTTP/1.1" 200 None 2026-04-18 17:18:54,254 - lava_callback - INFO - Completed processing callback for node 69e3bca57f5347282fbdea0c INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:18:56,837 - lava_callback - INFO - Received callback for node 69e3bca47f5347282fbdea08 INFO: 172.21.0.1:57502 - "POST /node/69e3bca47f5347282fbdea08 HTTP/1.0" 202 Accepted 2026-04-18 17:18:56,843 - lava_callback - INFO - Starting async job submit for node 69e3bca47f5347282fbdea08 2026-04-18 17:18:56,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:56,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca47f5347282fbdea08 HTTP/1.1" 200 None 2026-04-18 17:18:56,880 - lava_callback - DEBUG - Processing node 69e3bca47f5347282fbdea08: baseline-arm64 2026-04-18 17:18:57,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:57,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:57,240 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca47f5347282fbdea08/log.txt.gz 2026-04-18 17:18:57,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:57,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:57,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca47f5347282fbdea08/lava-logs.yaml 2026-04-18 17:18:57,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:57,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:57,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca47f5347282fbdea08/lava_callback.json.gz 2026-04-18 17:18:57,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:57,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca47f5347282fbdea08 HTTP/1.1" 200 None 2026-04-18 17:18:57,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:57,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:57,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:57,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca47f5347282fbdea08 HTTP/1.1" 200 None 2026-04-18 17:18:57,742 - lava_callback - INFO - Completed processing callback for node 69e3bca47f5347282fbdea08 2026-04-18 17:18:59,158 - lava_callback - INFO - Received callback for node 69e3bc997f5347282fbde9ed INFO: 172.21.0.1:57504 - "POST /node/69e3bc997f5347282fbde9ed HTTP/1.0" 202 Accepted 2026-04-18 17:18:59,165 - lava_callback - INFO - Starting async job submit for node 69e3bc997f5347282fbde9ed 2026-04-18 17:18:59,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:59,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc997f5347282fbde9ed HTTP/1.1" 200 None 2026-04-18 17:18:59,220 - lava_callback - DEBUG - Processing node 69e3bc997f5347282fbde9ed: baseline-arm64 2026-04-18 17:18:59,410 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:18:59,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:59,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:59,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc997f5347282fbde9ed/lava-logs.yaml 2026-04-18 17:18:59,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:18:59,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:18:59,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc997f5347282fbde9ed/lava_callback.json.gz 2026-04-18 17:18:59,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:59,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc997f5347282fbde9ed HTTP/1.1" 200 None 2026-04-18 17:18:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:59,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:18:59,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:18:59,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc997f5347282fbde9ed HTTP/1.1" 200 None 2026-04-18 17:18:59,900 - lava_callback - INFO - Completed processing callback for node 69e3bc997f5347282fbde9ed INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:06,815 - lava_callback - INFO - Received callback for node 69e3bc9c7f5347282fbde9f3 INFO: 172.21.0.1:51748 - "POST /node/69e3bc9c7f5347282fbde9f3 HTTP/1.0" 202 Accepted 2026-04-18 17:19:06,821 - lava_callback - INFO - Starting async job submit for node 69e3bc9c7f5347282fbde9f3 2026-04-18 17:19:06,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:06,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9c7f5347282fbde9f3 HTTP/1.1" 200 None 2026-04-18 17:19:06,864 - lava_callback - DEBUG - Processing node 69e3bc9c7f5347282fbde9f3: baseline-arm64 2026-04-18 17:19:07,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:07,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:07,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9c7f5347282fbde9f3/log.txt.gz 2026-04-18 17:19:07,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:07,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:07,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9c7f5347282fbde9f3/lava-logs.yaml 2026-04-18 17:19:07,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:07,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:07,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9c7f5347282fbde9f3/lava_callback.json.gz 2026-04-18 17:19:07,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:07,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9c7f5347282fbde9f3 HTTP/1.1" 200 None 2026-04-18 17:19:07,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:07,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:07,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:07,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc9c7f5347282fbde9f3 HTTP/1.1" 200 None 2026-04-18 17:19:07,756 - lava_callback - INFO - Completed processing callback for node 69e3bc9c7f5347282fbde9f3 2026-04-18 17:19:09,867 - lava_callback - INFO - Received callback for node 69e3bca67f5347282fbdea0f INFO: 172.21.0.1:42632 - "POST /node/69e3bca67f5347282fbdea0f HTTP/1.0" 202 Accepted 2026-04-18 17:19:09,873 - lava_callback - INFO - Starting async job submit for node 69e3bca67f5347282fbdea0f 2026-04-18 17:19:09,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:09,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca67f5347282fbdea0f HTTP/1.1" 200 None 2026-04-18 17:19:09,910 - lava_callback - DEBUG - Processing node 69e3bca67f5347282fbdea0f: baseline-arm64 2026-04-18 17:19:10,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:10,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:10,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca67f5347282fbdea0f/log.txt.gz 2026-04-18 17:19:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:10,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:10,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca67f5347282fbdea0f/lava-logs.yaml 2026-04-18 17:19:10,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:10,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:10,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca67f5347282fbdea0f/lava_callback.json.gz 2026-04-18 17:19:10,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:10,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca67f5347282fbdea0f HTTP/1.1" 200 None 2026-04-18 17:19:10,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:10,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:10,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:10,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca67f5347282fbdea0f HTTP/1.1" 200 None 2026-04-18 17:19:10,898 - lava_callback - INFO - Completed processing callback for node 69e3bca67f5347282fbdea0f 2026-04-18 17:19:13,721 - lava_callback - INFO - Received callback for node 69e3bcaf7f5347282fbdea41 INFO: 172.21.0.1:42640 - "POST /node/69e3bcaf7f5347282fbdea41 HTTP/1.0" 202 Accepted 2026-04-18 17:19:13,728 - lava_callback - INFO - Starting async job submit for node 69e3bcaf7f5347282fbdea41 2026-04-18 17:19:13,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:13,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcaf7f5347282fbdea41 HTTP/1.1" 200 None 2026-04-18 17:19:13,768 - lava_callback - DEBUG - Processing node 69e3bcaf7f5347282fbdea41: baseline-nfs-arm64 2026-04-18 17:19:14,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:14,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:14,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaf7f5347282fbdea41/log.txt.gz 2026-04-18 17:19:14,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:15,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:15,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaf7f5347282fbdea41/lava-logs.yaml INFO: 172.21.0.1:42652 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 17:19:15,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:15,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:15,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaf7f5347282fbdea41/lava_callback.json.gz 2026-04-18 17:19:15,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:15,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcaf7f5347282fbdea41 HTTP/1.1" 200 None 2026-04-18 17:19:15,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:15,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:15,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:15,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcaf7f5347282fbdea41 HTTP/1.1" 200 None 2026-04-18 17:19:15,384 - lava_callback - INFO - Completed processing callback for node 69e3bcaf7f5347282fbdea41 INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:22,146 - lava_callback - INFO - Received callback for node 69e3bcd87f5347282fbdeace INFO: 172.21.0.1:42318 - "POST /node/69e3bcd87f5347282fbdeace HTTP/1.0" 202 Accepted 2026-04-18 17:19:22,153 - lava_callback - INFO - Starting async job submit for node 69e3bcd87f5347282fbdeace 2026-04-18 17:19:22,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:22,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd87f5347282fbdeace HTTP/1.1" 200 None 2026-04-18 17:19:22,189 - lava_callback - DEBUG - Processing node 69e3bcd87f5347282fbdeace: baseline-arm64-pengutronix 2026-04-18 17:19:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:22,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:22,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd87f5347282fbdeace/log.txt.gz 2026-04-18 17:19:22,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:22,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:22,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd87f5347282fbdeace/lava-logs.yaml 2026-04-18 17:19:22,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:22,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:22,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd87f5347282fbdeace/lava_callback.json.gz 2026-04-18 17:19:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:22,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd87f5347282fbdeace HTTP/1.1" 200 None 2026-04-18 17:19:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:22,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:22,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:22,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcd87f5347282fbdeace HTTP/1.1" 200 None 2026-04-18 17:19:22,937 - lava_callback - INFO - Completed processing callback for node 69e3bcd87f5347282fbdeace 2026-04-18 17:19:22,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:23,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-18 17:19:25,812 - lava_callback - INFO - Received callback for node 69e3bcad7f5347282fbdea3e INFO: 172.21.0.1:42328 - "POST /node/69e3bcad7f5347282fbdea3e HTTP/1.0" 202 Accepted 2026-04-18 17:19:25,819 - lava_callback - INFO - Starting async job submit for node 69e3bcad7f5347282fbdea3e 2026-04-18 17:19:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:25,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcad7f5347282fbdea3e HTTP/1.1" 200 None 2026-04-18 17:19:25,863 - lava_callback - DEBUG - Processing node 69e3bcad7f5347282fbdea3e: baseline-nfs-arm64 2026-04-18 17:19:26,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:26,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:26,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcad7f5347282fbdea3e/log.txt.gz INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:26,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:27,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:27,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcad7f5347282fbdea3e/lava-logs.yaml 2026-04-18 17:19:27,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:27,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:27,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcad7f5347282fbdea3e/lava_callback.json.gz 2026-04-18 17:19:27,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:27,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcad7f5347282fbdea3e HTTP/1.1" 200 None 2026-04-18 17:19:27,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:27,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:27,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:27,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcad7f5347282fbdea3e HTTP/1.1" 200 None 2026-04-18 17:19:27,224 - lava_callback - INFO - Completed processing callback for node 69e3bcad7f5347282fbdea3e INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:31,437 - lava_callback - INFO - Received callback for node 69e11a122eed175ae971b18d INFO: 172.21.0.1:44404 - "POST /node/69e11a122eed175ae971b18d HTTP/1.0" 202 Accepted 2026-04-18 17:19:31,443 - lava_callback - INFO - Starting async job submit for node 69e11a122eed175ae971b18d 2026-04-18 17:19:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:31,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11a122eed175ae971b18d HTTP/1.1" 200 None 2026-04-18 17:19:31,460 - lava_callback - DEBUG - Processing node 69e11a122eed175ae971b18d: baseline-arm-clabbe 2026-04-18 17:19:31,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11a122eed175ae971b18d 2026-04-18 17:19:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:31,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11a122eed175ae971b18d HTTP/1.1" 200 None 2026-04-18 17:19:31,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:31,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:19:31,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:31,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11a122eed175ae971b18d HTTP/1.1" 200 None 2026-04-18 17:19:31,511 - lava_callback - ERROR - Error processing callback for node 69e11a122eed175ae971b18d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 17:19:32,469 - lava_callback - INFO - Received callback for node 69e3bcb57f5347282fbdea53 INFO: 172.21.0.1:44420 - "POST /node/69e3bcb57f5347282fbdea53 HTTP/1.0" 202 Accepted 2026-04-18 17:19:32,475 - lava_callback - INFO - Starting async job submit for node 69e3bcb57f5347282fbdea53 2026-04-18 17:19:32,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:32,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb57f5347282fbdea53 HTTP/1.1" 200 None 2026-04-18 17:19:32,514 - lava_callback - DEBUG - Processing node 69e3bcb57f5347282fbdea53: baseline-nfs-arm64 2026-04-18 17:19:32,847 - lava_callback - INFO - Received callback for node 69e3bcb17f5347282fbdea47 INFO: 172.21.0.1:44422 - "POST /node/69e3bcb17f5347282fbdea47 HTTP/1.0" 202 Accepted 2026-04-18 17:19:32,878 - lava_callback - INFO - Starting async job submit for node 69e3bcb17f5347282fbdea47 2026-04-18 17:19:32,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:32,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:32,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb17f5347282fbdea47 HTTP/1.1" 200 None 2026-04-18 17:19:32,969 - lava_callback - DEBUG - Processing node 69e3bcb17f5347282fbdea47: baseline-nfs-arm64 2026-04-18 17:19:33,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:33,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb57f5347282fbdea53/log.txt.gz 2026-04-18 17:19:33,607 - lava_callback - INFO - Received callback for node 69e3bcd97f5347282fbdead4 2026-04-18 17:19:33,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:33,614 - lava_callback - INFO - Starting async job submit for node 69e3bcd97f5347282fbdead4 INFO: 172.21.0.1:44424 - "POST /node/69e3bcd97f5347282fbdead4 HTTP/1.0" 202 Accepted 2026-04-18 17:19:33,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:33,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:33,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd97f5347282fbdead4 HTTP/1.1" 200 None 2026-04-18 17:19:33,658 - lava_callback - DEBUG - Processing node 69e3bcd97f5347282fbdead4: baseline-arm64-pengutronix 2026-04-18 17:19:33,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:33,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb17f5347282fbdea47/log.txt.gz 2026-04-18 17:19:33,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:33,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb57f5347282fbdea53/lava-logs.yaml 2026-04-18 17:19:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd97f5347282fbdead4/log.txt.gz 2026-04-18 17:19:34,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb57f5347282fbdea53/lava_callback.json.gz 2026-04-18 17:19:34,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb17f5347282fbdea47/lava-logs.yaml 2026-04-18 17:19:34,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,367 - lava_callback - INFO - Received callback for node 69e3bc977f5347282fbde9e7 2026-04-18 17:19:34,374 - lava_callback - INFO - Starting async job submit for node 69e3bc977f5347282fbde9e7 INFO: 172.21.0.1:44432 - "POST /node/69e3bc977f5347282fbde9e7 HTTP/1.0" 202 Accepted 2026-04-18 17:19:34,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb57f5347282fbdea53 HTTP/1.1" 200 None 2026-04-18 17:19:34,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:34,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc977f5347282fbde9e7 HTTP/1.1" 200 None 2026-04-18 17:19:34,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,425 - lava_callback - DEBUG - Processing node 69e3bc977f5347282fbde9e7: baseline-arm64 2026-04-18 17:19:34,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd97f5347282fbdead4/lava-logs.yaml 2026-04-18 17:19:34,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb17f5347282fbdea47/lava_callback.json.gz 2026-04-18 17:19:34,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb57f5347282fbdea53 HTTP/1.1" 200 None 2026-04-18 17:19:34,568 - lava_callback - INFO - Completed processing callback for node 69e3bcb57f5347282fbdea53 2026-04-18 17:19:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb17f5347282fbdea47 HTTP/1.1" 200 None 2026-04-18 17:19:34,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:34,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcd97f5347282fbdead4/lava_callback.json.gz 2026-04-18 17:19:34,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:34,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:34,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd97f5347282fbdead4 HTTP/1.1" 200 None 2026-04-18 17:19:34,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:34,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb17f5347282fbdea47 HTTP/1.1" 200 None 2026-04-18 17:19:34,925 - lava_callback - INFO - Completed processing callback for node 69e3bcb17f5347282fbdea47 2026-04-18 17:19:34,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:34,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:35,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcd97f5347282fbdead4 HTTP/1.1" 200 None 2026-04-18 17:19:35,011 - lava_callback - INFO - Completed processing callback for node 69e3bcd97f5347282fbdead4 2026-04-18 17:19:35,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:35,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc977f5347282fbde9e7/log.txt.gz 2026-04-18 17:19:35,119 - lava_callback - INFO - Received callback for node 69e3bcb67f5347282fbdea56 INFO: 172.21.0.1:44444 - "POST /node/69e3bcb67f5347282fbdea56 HTTP/1.0" 202 Accepted 2026-04-18 17:19:35,143 - lava_callback - INFO - Starting async job submit for node 69e3bcb67f5347282fbdea56 2026-04-18 17:19:35,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:35,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb67f5347282fbdea56 HTTP/1.1" 200 None 2026-04-18 17:19:35,302 - lava_callback - DEBUG - Processing node 69e3bcb67f5347282fbdea56: baseline-nfs-arm64 2026-04-18 17:19:35,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:35,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:35,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc977f5347282fbde9e7/lava-logs.yaml 2026-04-18 17:19:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:35,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:35,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:35,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:35,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb67f5347282fbdea56/log.txt.gz 2026-04-18 17:19:35,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc977f5347282fbde9e7/lava_callback.json.gz 2026-04-18 17:19:35,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc977f5347282fbde9e7 HTTP/1.1" 200 None 2026-04-18 17:19:36,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:36,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:36,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc977f5347282fbde9e7 HTTP/1.1" 200 None 2026-04-18 17:19:36,327 - lava_callback - INFO - Completed processing callback for node 69e3bc977f5347282fbde9e7 2026-04-18 17:19:36,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:36,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb67f5347282fbdea56/lava-logs.yaml 2026-04-18 17:19:36,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:36,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:36,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb67f5347282fbdea56/lava_callback.json.gz 2026-04-18 17:19:36,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb67f5347282fbdea56 HTTP/1.1" 200 None 2026-04-18 17:19:36,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:36,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb67f5347282fbdea56 HTTP/1.1" 200 None 2026-04-18 17:19:36,690 - lava_callback - INFO - Completed processing callback for node 69e3bcb67f5347282fbdea56 2026-04-18 17:19:36,903 - lava_callback - INFO - Received callback for node 69e3bcd77f5347282fbdeac9 INFO: 172.21.0.1:44458 - "POST /node/69e3bcd77f5347282fbdeac9 HTTP/1.0" 202 Accepted 2026-04-18 17:19:36,909 - lava_callback - INFO - Starting async job submit for node 69e3bcd77f5347282fbdeac9 2026-04-18 17:19:36,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:36,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd77f5347282fbdeac9 HTTP/1.1" 200 None 2026-04-18 17:19:36,947 - lava_callback - DEBUG - Processing node 69e3bcd77f5347282fbdeac9: baseline-arm64-kontron 2026-04-18 17:19:37,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:37,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:37,356 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd77f5347282fbdeac9/log.txt.gz 2026-04-18 17:19:37,517 - lava_callback - INFO - Received callback for node 69e3bcc07f5347282fbdea70 INFO: 172.21.0.1:44472 - "POST /node/69e3bcc07f5347282fbdea70 HTTP/1.0" 202 Accepted 2026-04-18 17:19:37,539 - lava_callback - INFO - Starting async job submit for node 69e3bcc07f5347282fbdea70 2026-04-18 17:19:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:37,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:37,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc07f5347282fbdea70 HTTP/1.1" 200 None 2026-04-18 17:19:37,586 - lava_callback - DEBUG - Processing node 69e3bcc07f5347282fbdea70: baseline-arm64-broonie 2026-04-18 17:19:37,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:37,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd77f5347282fbdeac9/lava-logs.yaml 2026-04-18 17:19:37,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:37,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:37,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:37,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd77f5347282fbdeac9/lava_callback.json.gz 2026-04-18 17:19:38,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:38,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc07f5347282fbdea70/log.txt.gz 2026-04-18 17:19:38,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd77f5347282fbdeac9 HTTP/1.1" 200 None 2026-04-18 17:19:38,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:38,155 - lava_callback - INFO - Received callback for node 69e3bcdc7f5347282fbdeada INFO: 172.21.0.1:44484 - "POST /node/69e3bcdc7f5347282fbdeada HTTP/1.0" 202 Accepted 2026-04-18 17:19:38,163 - lava_callback - INFO - Starting async job submit for node 69e3bcdc7f5347282fbdeada 2026-04-18 17:19:38,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:38,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdc7f5347282fbdeada HTTP/1.1" 200 None 2026-04-18 17:19:38,205 - lava_callback - DEBUG - Processing node 69e3bcdc7f5347282fbdeada: baseline-arm64-foundriesio 2026-04-18 17:19:38,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcd77f5347282fbdeac9 HTTP/1.1" 200 None 2026-04-18 17:19:38,261 - lava_callback - INFO - Completed processing callback for node 69e3bcd77f5347282fbdeac9 2026-04-18 17:19:38,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:38,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc07f5347282fbdea70/lava-logs.yaml 2026-04-18 17:19:38,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:38,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:38,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:38,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdc7f5347282fbdeada/log.txt.gz 2026-04-18 17:19:38,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:38,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc07f5347282fbdea70/lava_callback.json.gz 2026-04-18 17:19:38,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc07f5347282fbdea70 HTTP/1.1" 200 None 2026-04-18 17:19:38,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:38,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:38,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:38,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc07f5347282fbdea70 HTTP/1.1" 200 None 2026-04-18 17:19:38,849 - lava_callback - INFO - Completed processing callback for node 69e3bcc07f5347282fbdea70 2026-04-18 17:19:38,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:38,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdc7f5347282fbdeada/lava-logs.yaml 2026-04-18 17:19:38,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:39,013 - lava_callback - INFO - Received callback for node 69e3bcc97f5347282fbdeaa4 INFO: 172.21.0.1:44488 - "POST /node/69e3bcc97f5347282fbdeaa4 HTTP/1.0" 202 Accepted 2026-04-18 17:19:39,021 - lava_callback - INFO - Starting async job submit for node 69e3bcc97f5347282fbdeaa4 2026-04-18 17:19:39,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:39,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc97f5347282fbdeaa4 HTTP/1.1" 200 None 2026-04-18 17:19:39,072 - lava_callback - DEBUG - Processing node 69e3bcc97f5347282fbdeaa4: baseline-arm64-broonie 2026-04-18 17:19:39,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:39,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdc7f5347282fbdeada/lava_callback.json.gz 2026-04-18 17:19:39,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:39,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdc7f5347282fbdeada HTTP/1.1" 200 None 2026-04-18 17:19:39,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:39,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:39,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcdc7f5347282fbdeada HTTP/1.1" 200 None 2026-04-18 17:19:39,505 - lava_callback - INFO - Completed processing callback for node 69e3bcdc7f5347282fbdeada 2026-04-18 17:19:39,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:39,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc97f5347282fbdeaa4/log.txt.gz 2026-04-18 17:19:39,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:39,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:39,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc97f5347282fbdeaa4/lava-logs.yaml 2026-04-18 17:19:39,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:39,900 - lava_callback - INFO - Received callback for node 69e3bcab7f5347282fbdea38 INFO: 172.21.0.1:34352 - "POST /node/69e3bcab7f5347282fbdea38 HTTP/1.0" 202 Accepted 2026-04-18 17:19:39,907 - lava_callback - INFO - Starting async job submit for node 69e3bcab7f5347282fbdea38 2026-04-18 17:19:39,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:39,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcab7f5347282fbdea38 HTTP/1.1" 200 None 2026-04-18 17:19:39,950 - lava_callback - DEBUG - Processing node 69e3bcab7f5347282fbdea38: baseline-nfs-arm64 2026-04-18 17:19:39,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:40,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc97f5347282fbdeaa4/lava_callback.json.gz 2026-04-18 17:19:40,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:40,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc97f5347282fbdeaa4 HTTP/1.1" 200 None 2026-04-18 17:19:40,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:40,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:40,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:40,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:40,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc97f5347282fbdeaa4 HTTP/1.1" 200 None 2026-04-18 17:19:40,387 - lava_callback - INFO - Completed processing callback for node 69e3bcc97f5347282fbdeaa4 2026-04-18 17:19:40,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:40,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcab7f5347282fbdea38/log.txt.gz 2026-04-18 17:19:40,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:40,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:40,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcab7f5347282fbdea38/lava-logs.yaml 2026-04-18 17:19:40,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:41,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:41,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcab7f5347282fbdea38/lava_callback.json.gz 2026-04-18 17:19:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:41,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcab7f5347282fbdea38 HTTP/1.1" 200 None 2026-04-18 17:19:41,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:41,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:41,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcab7f5347282fbdea38 HTTP/1.1" 200 None 2026-04-18 17:19:41,099 - lava_callback - INFO - Completed processing callback for node 69e3bcab7f5347282fbdea38 INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:49,835 - lava_callback - INFO - Received callback for node 69e3bcdb7f5347282fbdead7 INFO: 172.21.0.1:38846 - "POST /node/69e3bcdb7f5347282fbdead7 HTTP/1.0" 202 Accepted 2026-04-18 17:19:49,841 - lava_callback - INFO - Starting async job submit for node 69e3bcdb7f5347282fbdead7 2026-04-18 17:19:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:49,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdb7f5347282fbdead7 HTTP/1.1" 200 None 2026-04-18 17:19:49,888 - lava_callback - DEBUG - Processing node 69e3bcdb7f5347282fbdead7: baseline-arm64-pengutronix 2026-04-18 17:19:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:50,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:50,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcdb7f5347282fbdead7/log.txt.gz 2026-04-18 17:19:50,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:50,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:50,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcdb7f5347282fbdead7/lava-logs.yaml 2026-04-18 17:19:50,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:50,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:50,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e3bcdb7f5347282fbdead7/lava_callback.json.gz 2026-04-18 17:19:50,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:50,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdb7f5347282fbdead7 HTTP/1.1" 200 None 2026-04-18 17:19:50,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:50,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:50,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:50,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcdb7f5347282fbdead7 HTTP/1.1" 200 None 2026-04-18 17:19:50,842 - lava_callback - INFO - Completed processing callback for node 69e3bcdb7f5347282fbdead7 2026-04-18 17:19:53,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:53,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-18 17:19:53,910 - lava_callback - INFO - Received callback for node 69e3bcc47f5347282fbdea76 INFO: 172.21.0.1:38862 - "POST /node/69e3bcc47f5347282fbdea76 HTTP/1.0" 202 Accepted 2026-04-18 17:19:53,916 - lava_callback - INFO - Starting async job submit for node 69e3bcc47f5347282fbdea76 2026-04-18 17:19:53,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:53,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc47f5347282fbdea76 HTTP/1.1" 200 None 2026-04-18 17:19:53,961 - lava_callback - DEBUG - Processing node 69e3bcc47f5347282fbdea76: baseline-arm64-broonie 2026-04-18 17:19:54,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:54,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:54,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc47f5347282fbdea76/log.txt.gz 2026-04-18 17:19:54,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:54,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:54,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc47f5347282fbdea76/lava-logs.yaml 2026-04-18 17:19:54,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:54,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:54,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc47f5347282fbdea76/lava_callback.json.gz 2026-04-18 17:19:54,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:55,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc47f5347282fbdea76 HTTP/1.1" 200 None 2026-04-18 17:19:55,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:55,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:55,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:55,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc47f5347282fbdea76 HTTP/1.1" 200 None 2026-04-18 17:19:55,050 - lava_callback - INFO - Completed processing callback for node 69e3bcc47f5347282fbdea76 2026-04-18 17:19:55,339 - lava_callback - INFO - Received callback for node 69e3bcc67f5347282fbdea79 INFO: 172.21.0.1:38878 - "POST /node/69e3bcc67f5347282fbdea79 HTTP/1.0" 202 Accepted 2026-04-18 17:19:55,349 - lava_callback - INFO - Starting async job submit for node 69e3bcc67f5347282fbdea79 2026-04-18 17:19:55,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:55,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc67f5347282fbdea79 HTTP/1.1" 200 None 2026-04-18 17:19:55,390 - lava_callback - DEBUG - Processing node 69e3bcc67f5347282fbdea79: baseline-arm64-broonie 2026-04-18 17:19:55,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:55,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:55,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc67f5347282fbdea79/log.txt.gz 2026-04-18 17:19:55,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:56,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:56,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc67f5347282fbdea79/lava-logs.yaml 2026-04-18 17:19:56,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:56,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:56,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc67f5347282fbdea79/lava_callback.json.gz 2026-04-18 17:19:56,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:56,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc67f5347282fbdea79 HTTP/1.1" 200 None 2026-04-18 17:19:56,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:56,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:56,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:56,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc67f5347282fbdea79 HTTP/1.1" 200 None 2026-04-18 17:19:56,229 - lava_callback - INFO - Completed processing callback for node 69e3bcc67f5347282fbdea79 INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:19:56,787 - lava_callback - INFO - Received callback for node 69e3bcd67f5347282fbdeac6 INFO: 172.21.0.1:38896 - "POST /node/69e3bcd67f5347282fbdeac6 HTTP/1.0" 202 Accepted 2026-04-18 17:19:56,794 - lava_callback - INFO - Starting async job submit for node 69e3bcd67f5347282fbdeac6 2026-04-18 17:19:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:56,831 - lava_callback - INFO - Received callback for node 69e3bccc7f5347282fbdeaaa INFO: 172.21.0.1:38898 - "POST /node/69e3bccc7f5347282fbdeaaa HTTP/1.0" 202 Accepted 2026-04-18 17:19:56,837 - lava_callback - INFO - Starting async job submit for node 69e3bccc7f5347282fbdeaaa 2026-04-18 17:19:56,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:56,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd67f5347282fbdeac6 HTTP/1.1" 200 None 2026-04-18 17:19:56,874 - lava_callback - DEBUG - Processing node 69e3bcd67f5347282fbdeac6: baseline-arm64-kontron 2026-04-18 17:19:56,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bccc7f5347282fbdeaaa HTTP/1.1" 200 None 2026-04-18 17:19:56,916 - lava_callback - DEBUG - Processing node 69e3bccc7f5347282fbdeaaa: baseline-arm64-broonie 2026-04-18 17:19:57,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:57,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:57,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:57,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd67f5347282fbdeac6/log.txt.gz 2026-04-18 17:19:57,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:57,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccc7f5347282fbdeaaa/log.txt.gz 2026-04-18 17:19:57,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:57,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:58,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:58,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccc7f5347282fbdeaaa/lava-logs.yaml 2026-04-18 17:19:58,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:58,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:58,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd67f5347282fbdeac6/lava-logs.yaml 2026-04-18 17:19:58,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:19:58,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:58,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccc7f5347282fbdeaaa/lava_callback.json.gz 2026-04-18 17:19:58,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:19:58,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3bcd67f5347282fbdeac6/lava_callback.json.gz 2026-04-18 17:19:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bccc7f5347282fbdeaaa HTTP/1.1" 200 None 2026-04-18 17:19:58,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcd67f5347282fbdeac6 HTTP/1.1" 200 None 2026-04-18 17:19:58,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:58,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:19:58,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:19:58,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bccc7f5347282fbdeaaa HTTP/1.1" 200 None 2026-04-18 17:19:58,246 - lava_callback - INFO - Completed processing callback for node 69e3bccc7f5347282fbdeaaa 2026-04-18 17:19:58,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcd67f5347282fbdeac6 HTTP/1.1" 200 None 2026-04-18 17:19:58,380 - lava_callback - INFO - Completed processing callback for node 69e3bcd67f5347282fbdeac6 INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:20:13,883 - lava_callback - INFO - Received callback for node 69e3bcca7f5347282fbdeaa7 INFO: 172.21.0.1:45708 - "POST /node/69e3bcca7f5347282fbdeaa7 HTTP/1.0" 202 Accepted 2026-04-18 17:20:13,890 - lava_callback - INFO - Starting async job submit for node 69e3bcca7f5347282fbdeaa7 2026-04-18 17:20:13,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:13,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcca7f5347282fbdeaa7 HTTP/1.1" 200 None 2026-04-18 17:20:13,928 - lava_callback - DEBUG - Processing node 69e3bcca7f5347282fbdeaa7: baseline-arm64-broonie 2026-04-18 17:20:14,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:14,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:14,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcca7f5347282fbdeaa7/log.txt.gz 2026-04-18 17:20:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:14,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:14,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcca7f5347282fbdeaa7/lava-logs.yaml 2026-04-18 17:20:14,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:14,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:14,730 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcca7f5347282fbdeaa7/lava_callback.json.gz 2026-04-18 17:20:14,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:14,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcca7f5347282fbdeaa7 HTTP/1.1" 200 None 2026-04-18 17:20:14,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:14,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:20:14,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:14,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcca7f5347282fbdeaa7 HTTP/1.1" 200 None 2026-04-18 17:20:14,809 - lava_callback - INFO - Completed processing callback for node 69e3bcca7f5347282fbdeaa7 INFO: 172.21.0.1:45712 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 17:20:15,365 - lava_callback - INFO - Received callback for node 69e3bccd7f5347282fbdeaad INFO: 172.21.0.1:45728 - "POST /node/69e3bccd7f5347282fbdeaad HTTP/1.0" 202 Accepted 2026-04-18 17:20:15,371 - lava_callback - INFO - Starting async job submit for node 69e3bccd7f5347282fbdeaad 2026-04-18 17:20:15,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:15,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bccd7f5347282fbdeaad HTTP/1.1" 200 None 2026-04-18 17:20:15,415 - lava_callback - DEBUG - Processing node 69e3bccd7f5347282fbdeaad: baseline-arm64-broonie 2026-04-18 17:20:15,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:15,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:15,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccd7f5347282fbdeaad/log.txt.gz 2026-04-18 17:20:15,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:16,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:16,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccd7f5347282fbdeaad/lava-logs.yaml 2026-04-18 17:20:16,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:16,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:16,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bccd7f5347282fbdeaad/lava_callback.json.gz 2026-04-18 17:20:16,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:16,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bccd7f5347282fbdeaad HTTP/1.1" 200 None 2026-04-18 17:20:16,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:16,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:20:16,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:16,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bccd7f5347282fbdeaad HTTP/1.1" 200 None 2026-04-18 17:20:16,265 - lava_callback - INFO - Completed processing callback for node 69e3bccd7f5347282fbdeaad INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:20:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:23,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-18 17:20:25,376 - lava_callback - INFO - Received callback for node 69e3bca97f5347282fbdea15 INFO: 172.21.0.1:45776 - "POST /node/69e3bca97f5347282fbdea15 HTTP/1.0" 202 Accepted 2026-04-18 17:20:25,383 - lava_callback - INFO - Starting async job submit for node 69e3bca97f5347282fbdea15 2026-04-18 17:20:25,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:25,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca97f5347282fbdea15 HTTP/1.1" 200 None 2026-04-18 17:20:25,420 - lava_callback - DEBUG - Processing node 69e3bca97f5347282fbdea15: baseline-nfs-arm64 2026-04-18 17:20:25,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:25,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:25,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bca97f5347282fbdea15/log.txt.gz 2026-04-18 17:20:26,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:26,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:26,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bca97f5347282fbdea15/lava-logs.yaml 2026-04-18 17:20:26,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:20:26,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:20:26,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bca97f5347282fbdea15/lava_callback.json.gz 2026-04-18 17:20:26,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:26,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca97f5347282fbdea15 HTTP/1.1" 200 None 2026-04-18 17:20:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:26,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:20:26,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:26,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca97f5347282fbdea15 HTTP/1.1" 200 None 2026-04-18 17:20:26,397 - lava_callback - INFO - Completed processing callback for node 69e3bca97f5347282fbdea15 INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET /node/693ae70efee8383e92b65001%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:20:53,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:20:53,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:21:31,520 - lava_callback - INFO - Received callback for node 69e11a892eed175ae971b1b9 INFO: 172.21.0.1:51318 - "POST /node/69e11a892eed175ae971b1b9 HTTP/1.0" 202 Accepted 2026-04-18 17:21:31,526 - lava_callback - INFO - Starting async job submit for node 69e11a892eed175ae971b1b9 2026-04-18 17:21:31,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:31,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11a892eed175ae971b1b9 HTTP/1.1" 200 None 2026-04-18 17:21:31,541 - lava_callback - DEBUG - Processing node 69e11a892eed175ae971b1b9: baseline-arm-clabbe 2026-04-18 17:21:31,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11a892eed175ae971b1b9 2026-04-18 17:21:31,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:31,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11a892eed175ae971b1b9 HTTP/1.1" 200 None 2026-04-18 17:21:31,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:31,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:21:31,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:31,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11a892eed175ae971b1b9 HTTP/1.1" 200 None 2026-04-18 17:21:31,592 - lava_callback - ERROR - Error processing callback for node 69e11a892eed175ae971b1b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:21:38,840 - lava_callback - INFO - Received callback for node 69e3bc9a7f5347282fbde9f0 INFO: 172.21.0.1:51336 - "POST /node/69e3bc9a7f5347282fbde9f0 HTTP/1.0" 202 Accepted 2026-04-18 17:21:38,845 - lava_callback - INFO - Starting async job submit for node 69e3bc9a7f5347282fbde9f0 2026-04-18 17:21:38,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:38,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9a7f5347282fbde9f0 HTTP/1.1" 200 None 2026-04-18 17:21:38,877 - lava_callback - DEBUG - Processing node 69e3bc9a7f5347282fbde9f0: baseline-arm64 2026-04-18 17:21:39,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:39,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:39,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9a7f5347282fbde9f0/log.txt.gz 2026-04-18 17:21:39,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:39,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:39,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9a7f5347282fbde9f0/lava-logs.yaml 2026-04-18 17:21:39,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:39,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:39,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bc9a7f5347282fbde9f0/lava_callback.json.gz 2026-04-18 17:21:39,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:39,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc9a7f5347282fbde9f0 HTTP/1.1" 200 None 2026-04-18 17:21:39,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:39,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:21:39,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:39,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc9a7f5347282fbde9f0 HTTP/1.1" 200 None 2026-04-18 17:21:40,044 - lava_callback - INFO - Completed processing callback for node 69e3bc9a7f5347282fbde9f0 2026-04-18 17:21:41,894 - lava_callback - INFO - Received callback for node 69e3bcaa7f5347282fbdea35 INFO: 172.21.0.1:42216 - "POST /node/69e3bcaa7f5347282fbdea35 HTTP/1.0" 202 Accepted 2026-04-18 17:21:41,901 - lava_callback - INFO - Starting async job submit for node 69e3bcaa7f5347282fbdea35 2026-04-18 17:21:41,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:41,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcaa7f5347282fbdea35 HTTP/1.1" 200 None 2026-04-18 17:21:41,938 - lava_callback - DEBUG - Processing node 69e3bcaa7f5347282fbdea35: baseline-nfs-arm64 2026-04-18 17:21:42,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:42,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:42,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaa7f5347282fbdea35/log.txt.gz 2026-04-18 17:21:42,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:43,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:43,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaa7f5347282fbdea35/lava-logs.yaml 2026-04-18 17:21:43,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:43,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:43,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcaa7f5347282fbdea35/lava_callback.json.gz 2026-04-18 17:21:43,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:43,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcaa7f5347282fbdea35 HTTP/1.1" 200 None 2026-04-18 17:21:43,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:43,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:21:43,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:43,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcaa7f5347282fbdea35 HTTP/1.1" 200 None 2026-04-18 17:21:43,232 - lava_callback - INFO - Completed processing callback for node 69e3bcaa7f5347282fbdea35 INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:21:53,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:53,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:21:57,606 - lava_callback - INFO - Received callback for node 69e3bcc77f5347282fbdea7c INFO: 172.21.0.1:45098 - "POST /node/69e3bcc77f5347282fbdea7c HTTP/1.0" 202 Accepted 2026-04-18 17:21:57,617 - lava_callback - INFO - Starting async job submit for node 69e3bcc77f5347282fbdea7c 2026-04-18 17:21:57,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:57,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc77f5347282fbdea7c HTTP/1.1" 200 None 2026-04-18 17:21:57,662 - lava_callback - DEBUG - Processing node 69e3bcc77f5347282fbdea7c: baseline-arm64-broonie 2026-04-18 17:21:58,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:58,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:58,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc77f5347282fbdea7c/log.txt.gz 2026-04-18 17:21:58,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:58,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:58,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc77f5347282fbdea7c/lava-logs.yaml 2026-04-18 17:21:58,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:21:58,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:21:58,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc77f5347282fbdea7c/lava_callback.json.gz 2026-04-18 17:21:58,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:58,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc77f5347282fbdea7c HTTP/1.1" 200 None 2026-04-18 17:21:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:58,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:21:58,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:21:58,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc77f5347282fbdea7c HTTP/1.1" 200 None 2026-04-18 17:21:58,719 - lava_callback - INFO - Completed processing callback for node 69e3bcc77f5347282fbdea7c INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:22:11,520 - lava_callback - INFO - Received callback for node 69e11aaf2eed175ae971b1c9 INFO: 172.21.0.1:42544 - "POST /node/69e11aaf2eed175ae971b1c9 HTTP/1.0" 202 Accepted 2026-04-18 17:22:11,529 - lava_callback - INFO - Starting async job submit for node 69e11aaf2eed175ae971b1c9 2026-04-18 17:22:11,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:11,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11aaf2eed175ae971b1c9 HTTP/1.1" 200 None 2026-04-18 17:22:11,544 - lava_callback - DEBUG - Processing node 69e11aaf2eed175ae971b1c9: baseline-arm-clabbe 2026-04-18 17:22:11,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11aaf2eed175ae971b1c9 2026-04-18 17:22:11,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:11,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11aaf2eed175ae971b1c9 HTTP/1.1" 200 None 2026-04-18 17:22:11,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:11,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:22:11,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:11,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11aaf2eed175ae971b1c9 HTTP/1.1" 200 None 2026-04-18 17:22:11,601 - lava_callback - ERROR - Error processing callback for node 69e11aaf2eed175ae971b1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:22:23,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:23,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:22:51,579 - lava_callback - INFO - Received callback for node 69e11ad62eed175ae971b1d8 INFO: 172.21.0.1:49442 - "POST /node/69e11ad62eed175ae971b1d8 HTTP/1.0" 202 Accepted 2026-04-18 17:22:51,585 - lava_callback - INFO - Starting async job submit for node 69e11ad62eed175ae971b1d8 2026-04-18 17:22:51,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:51,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11ad62eed175ae971b1d8 HTTP/1.1" 200 None 2026-04-18 17:22:51,608 - lava_callback - DEBUG - Processing node 69e11ad62eed175ae971b1d8: baseline-arm-clabbe 2026-04-18 17:22:51,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11ad62eed175ae971b1d8 2026-04-18 17:22:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:51,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11ad62eed175ae971b1d8 HTTP/1.1" 200 None 2026-04-18 17:22:51,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:51,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:22:51,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:22:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11ad62eed175ae971b1d8 HTTP/1.1" 200 None 2026-04-18 17:22:51,667 - lava_callback - ERROR - Error processing callback for node 69e11ad62eed175ae971b1d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:23:11,580 - lava_callback - INFO - Received callback for node 69e11afd2eed175ae971b1e6 INFO: 172.21.0.1:36850 - "POST /node/69e11afd2eed175ae971b1e6 HTTP/1.0" 202 Accepted 2026-04-18 17:23:11,586 - lava_callback - INFO - Starting async job submit for node 69e11afd2eed175ae971b1e6 2026-04-18 17:23:11,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:11,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11afd2eed175ae971b1e6 HTTP/1.1" 200 None 2026-04-18 17:23:11,607 - lava_callback - DEBUG - Processing node 69e11afd2eed175ae971b1e6: baseline-arm-clabbe 2026-04-18 17:23:11,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11afd2eed175ae971b1e6 2026-04-18 17:23:11,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:11,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11afd2eed175ae971b1e6 HTTP/1.1" 200 None 2026-04-18 17:23:11,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:11,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:23:11,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:11,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11afd2eed175ae971b1e6 HTTP/1.1" 200 None 2026-04-18 17:23:11,660 - lava_callback - ERROR - Error processing callback for node 69e11afd2eed175ae971b1e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:23:26,669 - lava_callback - INFO - Received callback for node 69e3bcdd7f5347282fbdeadd INFO: 172.21.0.1:60446 - "POST /node/69e3bcdd7f5347282fbdeadd HTTP/1.0" 202 Accepted 2026-04-18 17:23:26,678 - lava_callback - INFO - Starting async job submit for node 69e3bcdd7f5347282fbdeadd 2026-04-18 17:23:26,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:26,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdd7f5347282fbdeadd HTTP/1.1" 200 None 2026-04-18 17:23:26,747 - lava_callback - DEBUG - Processing node 69e3bcdd7f5347282fbdeadd: baseline-arm64-foundriesio 2026-04-18 17:23:27,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:23:28,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:23:28,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdd7f5347282fbdeadd/log.txt.gz 2026-04-18 17:23:28,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:23:29,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:23:29,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdd7f5347282fbdeadd/lava-logs.yaml 2026-04-18 17:23:29,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:23:29,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:23:29,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3bcdd7f5347282fbdeadd/lava_callback.json.gz DEBUG: 69e3bcdd7f5347282fbdeadd Transitting job node result: pass -> incomplete 2026-04-18 17:23:29,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:29,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcdd7f5347282fbdeadd HTTP/1.1" 200 None 2026-04-18 17:23:29,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:29,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:23:29,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:29,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcdd7f5347282fbdeadd HTTP/1.1" 200 None 2026-04-18 17:23:29,657 - lava_callback - INFO - Completed processing callback for node 69e3bcdd7f5347282fbdeadd INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:23:53,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:23:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:25:11,737 - lava_callback - INFO - Received callback for node 69e11b742eed175ae971b214 INFO: 172.21.0.1:34092 - "POST /node/69e11b742eed175ae971b214 HTTP/1.0" 202 Accepted 2026-04-18 17:25:11,743 - lava_callback - INFO - Starting async job submit for node 69e11b742eed175ae971b214 2026-04-18 17:25:11,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:11,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b742eed175ae971b214 HTTP/1.1" 200 None 2026-04-18 17:25:11,763 - lava_callback - DEBUG - Processing node 69e11b742eed175ae971b214: baseline-arm-clabbe 2026-04-18 17:25:11,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11b742eed175ae971b214 2026-04-18 17:25:11,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:11,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b742eed175ae971b214 HTTP/1.1" 200 None 2026-04-18 17:25:11,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:11,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:25:11,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:11,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11b742eed175ae971b214 HTTP/1.1" 200 None 2026-04-18 17:25:11,817 - lava_callback - ERROR - Error processing callback for node 69e11b742eed175ae971b214: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 17:25:12,027 - lava_callback - INFO - Received callback for node 69e3bca77f5347282fbdea12 INFO: 172.21.0.1:34098 - "POST /node/69e3bca77f5347282fbdea12 HTTP/1.0" 202 Accepted 2026-04-18 17:25:12,036 - lava_callback - INFO - Starting async job submit for node 69e3bca77f5347282fbdea12 2026-04-18 17:25:12,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:12,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca77f5347282fbdea12 HTTP/1.1" 200 None 2026-04-18 17:25:12,106 - lava_callback - DEBUG - Processing node 69e3bca77f5347282fbdea12: baseline-arm64 2026-04-18 17:25:12,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:25:12,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:12,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca77f5347282fbdea12/log.txt.gz 2026-04-18 17:25:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:25:12,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:12,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca77f5347282fbdea12/lava-logs.yaml 2026-04-18 17:25:12,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:25:13,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:13,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca77f5347282fbdea12/lava_callback.json.gz DEBUG: Setup failed for 69e3bca77f5347282fbdea12. Transitting job node result: incomplete -> fail 2026-04-18 17:25:13,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:13,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca77f5347282fbdea12 HTTP/1.1" 200 None 2026-04-18 17:25:13,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:13,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:25:13,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:13,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca77f5347282fbdea12 HTTP/1.1" 200 None 2026-04-18 17:25:13,278 - lava_callback - INFO - Completed processing callback for node 69e3bca77f5347282fbdea12 2026-04-18 17:25:14,211 - lava_callback - INFO - Received callback for node 69e3bd817f5347282fbdec20 INFO: 172.21.0.1:34108 - "POST /node/69e3bd817f5347282fbdec20 HTTP/1.0" 202 Accepted 2026-04-18 17:25:14,218 - lava_callback - INFO - Starting async job submit for node 69e3bd817f5347282fbdec20 2026-04-18 17:25:14,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:14,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bd817f5347282fbdec20 HTTP/1.1" 200 None 2026-04-18 17:25:14,264 - lava_callback - DEBUG - Processing node 69e3bd817f5347282fbdec20: ltp-controllers 2026-04-18 17:25:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:25:14,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:14,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3bd817f5347282fbdec20/log.txt.gz 2026-04-18 17:25:15,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 17:25:15,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:15,201 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3bd817f5347282fbdec20/lava-logs.yaml 2026-04-18 17:25:15,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:25:15,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:25:15,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e3bd817f5347282fbdec20/lava_callback.json.gz 2026-04-18 17:25:15,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:15,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bd817f5347282fbdec20 HTTP/1.1" 200 None 2026-04-18 17:25:15,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 17:25:15,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:15,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bd817f5347282fbdec20 HTTP/1.1" 200 None 2026-04-18 17:25:15,412 - lava_callback - INFO - Completed processing callback for node 69e3bd817f5347282fbdec20 INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:25:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:23,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:25:51,686 - lava_callback - INFO - Received callback for node 69e11b9b2eed175ae971b224 INFO: 172.21.0.1:49148 - "POST /node/69e11b9b2eed175ae971b224 HTTP/1.0" 202 Accepted 2026-04-18 17:25:51,692 - lava_callback - INFO - Starting async job submit for node 69e11b9b2eed175ae971b224 2026-04-18 17:25:51,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:51,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b9b2eed175ae971b224 HTTP/1.1" 200 None 2026-04-18 17:25:51,708 - lava_callback - DEBUG - Processing node 69e11b9b2eed175ae971b224: baseline-arm-clabbe 2026-04-18 17:25:51,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11b9b2eed175ae971b224 2026-04-18 17:25:51,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:51,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b9b2eed175ae971b224 HTTP/1.1" 200 None 2026-04-18 17:25:51,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:51,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-18 17:25:51,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:25:51,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11b9b2eed175ae971b224 HTTP/1.1" 200 None 2026-04-18 17:25:51,768 - lava_callback - ERROR - Error processing callback for node 69e11b9b2eed175ae971b224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:26:49,013 - lava_callback - INFO - Received callback for node 69e3becf7f5347282fbdecb0 INFO: 172.21.0.1:44734 - "POST /node/69e3becf7f5347282fbdecb0 HTTP/1.0" 202 Accepted 2026-04-18 17:26:49,019 - lava_callback - INFO - Starting async job submit for node 69e3becf7f5347282fbdecb0 2026-04-18 17:26:49,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:26:49,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3becf7f5347282fbdecb0 HTTP/1.1" 200 None 2026-04-18 17:26:49,059 - lava_callback - DEBUG - Processing node 69e3becf7f5347282fbdecb0: baseline-nfs-arm64 2026-04-18 17:26:49,061 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:26:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:26:49,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:26:49,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3becf7f5347282fbdecb0/lava-logs.yaml 2026-04-18 17:26:49,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:26:49,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:26:49,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3becf7f5347282fbdecb0/lava_callback.json.gz 2026-04-18 17:26:49,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:26:49,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3becf7f5347282fbdecb0 HTTP/1.1" 200 None 2026-04-18 17:26:49,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:26:49,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:26:49,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:26:49,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3becf7f5347282fbdecb0 HTTP/1.1" 200 None 2026-04-18 17:26:49,496 - lava_callback - INFO - Completed processing callback for node 69e3becf7f5347282fbdecb0 2026-04-18 17:26:53,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:26:53,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:28:42,356 - lava_callback - INFO - Received callback for node 69e3bf177f5347282fbdecd3 INFO: 172.21.0.1:44358 - "POST /node/69e3bf177f5347282fbdecd3 HTTP/1.0" 202 Accepted 2026-04-18 17:28:42,362 - lava_callback - INFO - Starting async job submit for node 69e3bf177f5347282fbdecd3 2026-04-18 17:28:42,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:28:42,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bf177f5347282fbdecd3 HTTP/1.1" 200 None 2026-04-18 17:28:42,412 - lava_callback - DEBUG - Processing node 69e3bf177f5347282fbdecd3: baseline-arm64 2026-04-18 17:28:42,542 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:28:42,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:28:42,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:28:42,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bf177f5347282fbdecd3/lava-logs.yaml 2026-04-18 17:28:42,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:28:43,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:28:43,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bf177f5347282fbdecd3/lava_callback.json.gz 2026-04-18 17:28:43,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:28:43,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bf177f5347282fbdecd3 HTTP/1.1" 200 None 2026-04-18 17:28:43,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:28:43,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:28:43,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:28:43,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bf177f5347282fbdecd3 HTTP/1.1" 200 None 2026-04-18 17:28:43,208 - lava_callback - INFO - Completed processing callback for node 69e3bf177f5347282fbdecd3 INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:28:53,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:28:53,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET /node/698a41d522b4cc0f227b068a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:30:46,069 - lava_callback - INFO - Received callback for node 69e3bf6d7f5347282fbdecf7 INFO: 172.21.0.1:48042 - "POST /node/69e3bf6d7f5347282fbdecf7 HTTP/1.0" 202 Accepted 2026-04-18 17:30:46,080 - lava_callback - INFO - Starting async job submit for node 69e3bf6d7f5347282fbdecf7 2026-04-18 17:30:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:30:46,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bf6d7f5347282fbdecf7 HTTP/1.1" 200 None 2026-04-18 17:30:46,159 - lava_callback - DEBUG - Processing node 69e3bf6d7f5347282fbdecf7: baseline-arm64 2026-04-18 17:30:46,386 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:30:46,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:30:46,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:30:46,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bf6d7f5347282fbdecf7/lava-logs.yaml 2026-04-18 17:30:46,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:30:46,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:30:46,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bf6d7f5347282fbdecf7/lava_callback.json.gz 2026-04-18 17:30:46,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:30:46,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bf6d7f5347282fbdecf7 HTTP/1.1" 200 None 2026-04-18 17:30:46,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:30:46,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:30:46,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:30:46,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bf6d7f5347282fbdecf7 HTTP/1.1" 200 None 2026-04-18 17:30:46,958 - lava_callback - INFO - Completed processing callback for node 69e3bf6d7f5347282fbdecf7 2026-04-18 17:30:53,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:30:53,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET /node/69876c13e31b58f834f198e7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 17:32:16,359 - lava_callback - INFO - Received callback for node 69e3bfbd7f5347282fbded1a INFO: 172.21.0.1:39474 - "POST /node/69e3bfbd7f5347282fbded1a HTTP/1.0" 202 Accepted 2026-04-18 17:32:16,365 - lava_callback - INFO - Starting async job submit for node 69e3bfbd7f5347282fbded1a 2026-04-18 17:32:16,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:16,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bfbd7f5347282fbded1a HTTP/1.1" 200 None 2026-04-18 17:32:16,402 - lava_callback - DEBUG - Processing node 69e3bfbd7f5347282fbded1a: baseline-arm64 INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:32:16,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:16,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:16,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bfbd7f5347282fbded1a/log.txt.gz 2026-04-18 17:32:16,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:17,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:17,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bfbd7f5347282fbded1a/lava-logs.yaml 2026-04-18 17:32:17,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:17,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:17,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bfbd7f5347282fbded1a/lava_callback.json.gz 2026-04-18 17:32:17,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:17,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bfbd7f5347282fbded1a HTTP/1.1" 200 None 2026-04-18 17:32:17,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:17,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:32:17,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:17,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bfbd7f5347282fbded1a HTTP/1.1" 200 None 2026-04-18 17:32:17,177 - lava_callback - INFO - Completed processing callback for node 69e3bfbd7f5347282fbded1a 2026-04-18 17:32:18,546 - lava_callback - INFO - Received callback for node 69e3bbf67f5347282fbde999 INFO: 172.21.0.1:39490 - "POST /node/69e3bbf67f5347282fbde999 HTTP/1.0" 202 Accepted 2026-04-18 17:32:18,553 - lava_callback - INFO - Starting async job submit for node 69e3bbf67f5347282fbde999 2026-04-18 17:32:18,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:18,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bbf67f5347282fbde999 HTTP/1.1" 200 None 2026-04-18 17:32:18,629 - lava_callback - DEBUG - Processing node 69e3bbf67f5347282fbde999: ltp-smoke 2026-04-18 17:32:19,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:19,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:19,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3bbf67f5347282fbde999/log.txt.gz 2026-04-18 17:32:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:19,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:19,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3bbf67f5347282fbde999/lava-logs.yaml 2026-04-18 17:32:19,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:32:19,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:32:19,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3bbf67f5347282fbde999/lava_callback.json.gz 2026-04-18 17:32:19,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:19,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bbf67f5347282fbde999 HTTP/1.1" 200 None 2026-04-18 17:32:19,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:19,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af027f5347282fbdbc7e HTTP/1.1" 200 None 2026-04-18 17:32:19,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:20,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bbf67f5347282fbde999 HTTP/1.1" 200 None 2026-04-18 17:32:20,152 - lava_callback - INFO - Completed processing callback for node 69e3bbf67f5347282fbde999 2026-04-18 17:32:23,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:32:23,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:33:24,252 - lava_callback - INFO - Received callback for node 69e3c0287f5347282fbded50 INFO: 172.21.0.1:45278 - "POST /node/69e3c0287f5347282fbded50 HTTP/1.0" 202 Accepted 2026-04-18 17:33:24,258 - lava_callback - INFO - Starting async job submit for node 69e3c0287f5347282fbded50 2026-04-18 17:33:24,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:24,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0287f5347282fbded50 HTTP/1.1" 200 None 2026-04-18 17:33:24,297 - lava_callback - DEBUG - Processing node 69e3c0287f5347282fbded50: baseline-arm64-foundriesio 2026-04-18 17:33:24,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:24,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:24,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c0287f5347282fbded50/log.txt.gz 2026-04-18 17:33:24,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:24,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:24,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c0287f5347282fbded50/lava-logs.yaml 2026-04-18 17:33:24,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:25,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:25,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c0287f5347282fbded50/lava_callback.json.gz 2026-04-18 17:33:25,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:25,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0287f5347282fbded50 HTTP/1.1" 200 None 2026-04-18 17:33:25,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:25,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:33:25,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:25,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c0287f5347282fbded50 HTTP/1.1" 200 None 2026-04-18 17:33:25,095 - lava_callback - INFO - Completed processing callback for node 69e3c0287f5347282fbded50 INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:33:27,569 - lava_callback - INFO - Received callback for node 69e3bc877f5347282fbde9c6 INFO: 172.21.0.1:45308 - "POST /node/69e3bc877f5347282fbde9c6 HTTP/1.0" 202 Accepted 2026-04-18 17:33:27,580 - lava_callback - INFO - Starting async job submit for node 69e3bc877f5347282fbde9c6 2026-04-18 17:33:27,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:27,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc877f5347282fbde9c6 HTTP/1.1" 200 None 2026-04-18 17:33:27,719 - lava_callback - DEBUG - Processing node 69e3bc877f5347282fbde9c6: baseline-arm 2026-04-18 17:33:28,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:28,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:28,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3bc877f5347282fbde9c6/log.txt.gz 2026-04-18 17:33:28,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:29,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:29,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3bc877f5347282fbde9c6/lava-logs.yaml 2026-04-18 17:33:29,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:33:29,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:33:29,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3bc877f5347282fbde9c6/lava_callback.json.gz DEBUG: Setup failed for 69e3bc877f5347282fbde9c6. Transitting job node result: incomplete -> fail 2026-04-18 17:33:29,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:29,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bc877f5347282fbde9c6 HTTP/1.1" 200 None 2026-04-18 17:33:29,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:29,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 17:33:29,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:29,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bc877f5347282fbde9c6 HTTP/1.1" 200 None INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:33:29,468 - lava_callback - INFO - Completed processing callback for node 69e3bc877f5347282fbde9c6 INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET /node/698374f166dc8a56088a4caf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45978 - "GET /node/69104603f4a91d81a0ec56fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:33:53,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:33:53,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:34:25,247 - lava_callback - INFO - Received callback for node 69e11d972eed175ae971b2f2 INFO: 172.21.0.1:53538 - "POST /node/69e11d972eed175ae971b2f2 HTTP/1.0" 202 Accepted 2026-04-18 17:34:25,253 - lava_callback - INFO - Starting async job submit for node 69e11d972eed175ae971b2f2 2026-04-18 17:34:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:34:25,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11d972eed175ae971b2f2 HTTP/1.1" 200 None 2026-04-18 17:34:25,287 - lava_callback - DEBUG - Processing node 69e11d972eed175ae971b2f2: baseline-arm64-baylibre 2026-04-18 17:34:25,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11d972eed175ae971b2f2 2026-04-18 17:34:25,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:34:25,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11d972eed175ae971b2f2 HTTP/1.1" 200 None 2026-04-18 17:34:25,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:34:25,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:34:25,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:34:25,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11d972eed175ae971b2f2 HTTP/1.1" 200 None 2026-04-18 17:34:25,341 - lava_callback - ERROR - Error processing callback for node 69e11d972eed175ae971b2f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET /node/693fda64575bc060ce14da3d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56028 - "GET /node/693af17afee8383e92b69dcd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:35:37,414 - lava_callback - INFO - Received callback for node 69e3c0767f5347282fbded7c INFO: 172.21.0.1:47516 - "POST /node/69e3c0767f5347282fbded7c HTTP/1.0" 202 Accepted 2026-04-18 17:35:37,420 - lava_callback - INFO - Starting async job submit for node 69e3c0767f5347282fbded7c 2026-04-18 17:35:37,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:37,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0767f5347282fbded7c HTTP/1.1" 200 None 2026-04-18 17:35:37,470 - lava_callback - DEBUG - Processing node 69e3c0767f5347282fbded7c: baseline-arm64-kontron 2026-04-18 17:35:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:35:37,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:35:37,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c0767f5347282fbded7c/log.txt.gz 2026-04-18 17:35:37,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:35:38,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:35:38,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c0767f5347282fbded7c/lava-logs.yaml 2026-04-18 17:35:38,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:35:38,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:35:38,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c0767f5347282fbded7c/lava_callback.json.gz 2026-04-18 17:35:38,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:38,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0767f5347282fbded7c HTTP/1.1" 200 None 2026-04-18 17:35:38,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:38,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:35:38,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:38,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c0767f5347282fbded7c HTTP/1.1" 200 None 2026-04-18 17:35:38,540 - lava_callback - INFO - Completed processing callback for node 69e3c0767f5347282fbded7c 2026-04-18 17:35:45,302 - lava_callback - INFO - Received callback for node 69e11de82eed175ae971b319 INFO: 172.21.0.1:55378 - "POST /node/69e11de82eed175ae971b319 HTTP/1.0" 202 Accepted 2026-04-18 17:35:45,308 - lava_callback - INFO - Starting async job submit for node 69e11de82eed175ae971b319 2026-04-18 17:35:45,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:45,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11de82eed175ae971b319 HTTP/1.1" 200 None 2026-04-18 17:35:45,324 - lava_callback - DEBUG - Processing node 69e11de82eed175ae971b319: baseline-arm64-baylibre 2026-04-18 17:35:45,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11de82eed175ae971b319 2026-04-18 17:35:45,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:45,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11de82eed175ae971b319 HTTP/1.1" 200 None 2026-04-18 17:35:45,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:45,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:35:45,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:45,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11de82eed175ae971b319 HTTP/1.1" 200 None 2026-04-18 17:35:45,373 - lava_callback - ERROR - Error processing callback for node 69e11de82eed175ae971b319: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:35:53,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:35:53,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET /node/6953280c31522df6df79b649%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39760 - "GET /node/694a5e1c83c67c43d1eda2e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:36:37,695 - lava_callback - INFO - Received callback for node 69e3bca27f5347282fbdea05 INFO: 172.21.0.1:55414 - "POST /node/69e3bca27f5347282fbdea05 HTTP/1.0" 202 Accepted 2026-04-18 17:36:37,702 - lava_callback - INFO - Starting async job submit for node 69e3bca27f5347282fbdea05 2026-04-18 17:36:37,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:36:37,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca27f5347282fbdea05 HTTP/1.1" 200 None 2026-04-18 17:36:37,753 - lava_callback - DEBUG - Processing node 69e3bca27f5347282fbdea05: baseline-arm64 2026-04-18 17:36:38,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:36:38,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:36:38,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca27f5347282fbdea05/log.txt.gz 2026-04-18 17:36:38,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:36:38,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:36:38,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca27f5347282fbdea05/lava-logs.yaml 2026-04-18 17:36:39,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:36:39,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:36:39,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3bca27f5347282fbdea05/lava_callback.json.gz 2026-04-18 17:36:39,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:36:39,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bca27f5347282fbdea05 HTTP/1.1" 200 None 2026-04-18 17:36:39,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:36:39,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:36:39,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:36:39,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bca27f5347282fbdea05 HTTP/1.1" 200 None 2026-04-18 17:36:39,291 - lava_callback - INFO - Completed processing callback for node 69e3bca27f5347282fbdea05 INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:36:53,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:36:53,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:37:05,377 - lava_callback - INFO - Received callback for node 69e11e3b2eed175ae971b339 INFO: 172.21.0.1:38370 - "POST /node/69e11e3b2eed175ae971b339 HTTP/1.0" 202 Accepted 2026-04-18 17:37:05,383 - lava_callback - INFO - Starting async job submit for node 69e11e3b2eed175ae971b339 2026-04-18 17:37:05,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:05,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11e3b2eed175ae971b339 HTTP/1.1" 200 None 2026-04-18 17:37:05,406 - lava_callback - DEBUG - Processing node 69e11e3b2eed175ae971b339: baseline-arm64-baylibre 2026-04-18 17:37:05,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11e3b2eed175ae971b339 2026-04-18 17:37:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:05,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11e3b2eed175ae971b339 HTTP/1.1" 200 None 2026-04-18 17:37:05,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:05,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:37:05,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:05,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11e3b2eed175ae971b339 HTTP/1.1" 200 None 2026-04-18 17:37:05,458 - lava_callback - ERROR - Error processing callback for node 69e11e3b2eed175ae971b339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:37:47,304 - lava_callback - INFO - Received callback for node 69e3bcac7f5347282fbdea3b INFO: 172.21.0.1:38848 - "POST /node/69e3bcac7f5347282fbdea3b HTTP/1.0" 202 Accepted 2026-04-18 17:37:47,313 - lava_callback - INFO - Starting async job submit for node 69e3bcac7f5347282fbdea3b 2026-04-18 17:37:47,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:47,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcac7f5347282fbdea3b HTTP/1.1" 200 None 2026-04-18 17:37:47,378 - lava_callback - DEBUG - Processing node 69e3bcac7f5347282fbdea3b: baseline-nfs-arm64 2026-04-18 17:37:48,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:37:48,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:37:48,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcac7f5347282fbdea3b/log.txt.gz 2026-04-18 17:37:49,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:37:49,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:37:49,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcac7f5347282fbdea3b/lava-logs.yaml 2026-04-18 17:37:49,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:37:49,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:37:49,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcac7f5347282fbdea3b/lava_callback.json.gz DEBUG: Setup failed for 69e3bcac7f5347282fbdea3b. Transitting job node result: incomplete -> fail 2026-04-18 17:37:50,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43410 - "GET /node/69d8491bb28893fa2e23155b%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-18 17:37:50,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcac7f5347282fbdea3b HTTP/1.1" 200 None 2026-04-18 17:37:50,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:50,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:37:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:50,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcac7f5347282fbdea3b HTTP/1.1" 200 None 2026-04-18 17:37:50,194 - lava_callback - INFO - Completed processing callback for node 69e3bcac7f5347282fbdea3b INFO: 172.21.0.1:43414 - "GET /node/69de8f65f6535ffd5b3ef2d7%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-18 17:37:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:37:53,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET /node/692ffeca3eb37f3c8fbc1551%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:38:26,499 - lava_callback - INFO - Received callback for node 69e3c0b17f5347282fbdeda2 INFO: 172.21.0.1:54978 - "POST /node/69e3c0b17f5347282fbdeda2 HTTP/1.0" 202 Accepted 2026-04-18 17:38:26,504 - lava_callback - INFO - Starting async job submit for node 69e3c0b17f5347282fbdeda2 INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:38:26,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0b17f5347282fbdeda2 HTTP/1.1" 200 None 2026-04-18 17:38:26,552 - lava_callback - DEBUG - Processing node 69e3c0b17f5347282fbdeda2: baseline-arm64 2026-04-18 17:38:26,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:27,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:27,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c0b17f5347282fbdeda2/log.txt.gz 2026-04-18 17:38:27,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:27,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:27,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c0b17f5347282fbdeda2/lava-logs.yaml 2026-04-18 17:38:27,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:27,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:27,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c0b17f5347282fbdeda2/lava_callback.json.gz 2026-04-18 17:38:27,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:27,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c0b17f5347282fbdeda2 HTTP/1.1" 200 None 2026-04-18 17:38:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:27,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:38:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:27,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c0b17f5347282fbdeda2 HTTP/1.1" 200 None 2026-04-18 17:38:27,648 - lava_callback - INFO - Completed processing callback for node 69e3c0b17f5347282fbdeda2 INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:38:40,679 - lava_callback - INFO - Received callback for node 69e3bcb37f5347282fbdea4f INFO: 172.21.0.1:33286 - "POST /node/69e3bcb37f5347282fbdea4f HTTP/1.0" 202 Accepted 2026-04-18 17:38:40,688 - lava_callback - INFO - Starting async job submit for node 69e3bcb37f5347282fbdea4f 2026-04-18 17:38:40,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:40,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb37f5347282fbdea4f HTTP/1.1" 200 None 2026-04-18 17:38:40,746 - lava_callback - DEBUG - Processing node 69e3bcb37f5347282fbdea4f: baseline-nfs-arm64 2026-04-18 17:38:41,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:41,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:41,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb37f5347282fbdea4f/log.txt.gz 2026-04-18 17:38:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:42,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:42,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb37f5347282fbdea4f/lava-logs.yaml 2026-04-18 17:38:42,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:38:42,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:38:42,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb37f5347282fbdea4f/lava_callback.json.gz DEBUG: Setup failed for 69e3bcb37f5347282fbdea4f. Transitting job node result: incomplete -> fail 2026-04-18 17:38:42,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:42,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb37f5347282fbdea4f HTTP/1.1" 200 None 2026-04-18 17:38:42,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:42,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:38:42,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:42,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb37f5347282fbdea4f HTTP/1.1" 200 None 2026-04-18 17:38:42,804 - lava_callback - INFO - Completed processing callback for node 69e3bcb37f5347282fbdea4f INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:38:53,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:38:53,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:39:45,487 - lava_callback - INFO - Received callback for node 69e11edc2eed175ae971b37d INFO: 172.21.0.1:34892 - "POST /node/69e11edc2eed175ae971b37d HTTP/1.0" 202 Accepted 2026-04-18 17:39:45,493 - lava_callback - INFO - Starting async job submit for node 69e11edc2eed175ae971b37d 2026-04-18 17:39:45,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:39:45,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11edc2eed175ae971b37d HTTP/1.1" 200 None 2026-04-18 17:39:45,509 - lava_callback - DEBUG - Processing node 69e11edc2eed175ae971b37d: baseline-arm64-baylibre 2026-04-18 17:39:45,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11edc2eed175ae971b37d 2026-04-18 17:39:45,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:39:45,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11edc2eed175ae971b37d HTTP/1.1" 200 None 2026-04-18 17:39:45,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:39:45,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:39:45,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:39:45,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11edc2eed175ae971b37d HTTP/1.1" 200 None 2026-04-18 17:39:45,562 - lava_callback - ERROR - Error processing callback for node 69e11edc2eed175ae971b37d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET /node/6983ed89969566dcb0d29de2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:41:25,610 - lava_callback - INFO - Received callback for node 69e11f302eed175ae971b39d INFO: 172.21.0.1:50358 - "POST /node/69e11f302eed175ae971b39d HTTP/1.0" 202 Accepted 2026-04-18 17:41:25,616 - lava_callback - INFO - Starting async job submit for node 69e11f302eed175ae971b39d 2026-04-18 17:41:25,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:25,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11f302eed175ae971b39d HTTP/1.1" 200 None 2026-04-18 17:41:25,632 - lava_callback - DEBUG - Processing node 69e11f302eed175ae971b39d: baseline-arm64-baylibre 2026-04-18 17:41:25,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11f302eed175ae971b39d 2026-04-18 17:41:25,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:25,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11f302eed175ae971b39d HTTP/1.1" 200 None 2026-04-18 17:41:25,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:25,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:41:25,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:25,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11f302eed175ae971b39d HTTP/1.1" 200 None 2026-04-18 17:41:25,683 - lava_callback - ERROR - Error processing callback for node 69e11f302eed175ae971b39d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:41:29,996 - lava_callback - INFO - Received callback for node 69e3c23a7f5347282fbdee4f INFO: 172.21.0.1:39562 - "POST /node/69e3c23a7f5347282fbdee4f HTTP/1.0" 202 Accepted 2026-04-18 17:41:30,003 - lava_callback - INFO - Starting async job submit for node 69e3c23a7f5347282fbdee4f 2026-04-18 17:41:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:30,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c23a7f5347282fbdee4f HTTP/1.1" 200 None 2026-04-18 17:41:30,020 - lava_callback - DEBUG - Processing node 69e3c23a7f5347282fbdee4f: baseline-nfs-arm64 2026-04-18 17:41:30,022 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:41:30,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:41:30,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:41:30,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c23a7f5347282fbdee4f/lava-logs.yaml 2026-04-18 17:41:30,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:41:30,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:41:30,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c23a7f5347282fbdee4f/lava_callback.json.gz 2026-04-18 17:41:30,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:30,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c23a7f5347282fbdee4f HTTP/1.1" 200 None 2026-04-18 17:41:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:41:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:30,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c23a7f5347282fbdee4f HTTP/1.1" 200 None 2026-04-18 17:41:30,312 - lava_callback - INFO - Completed processing callback for node 69e3c23a7f5347282fbdee4f INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:41:53,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:41:53,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:42:20,589 - lava_callback - INFO - Received callback for node 69e3c11a7f5347282fbdedc8 INFO: 172.21.0.1:59494 - "POST /node/69e3c11a7f5347282fbdedc8 HTTP/1.0" 202 Accepted 2026-04-18 17:42:20,598 - lava_callback - INFO - Starting async job submit for node 69e3c11a7f5347282fbdedc8 2026-04-18 17:42:20,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:42:20,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c11a7f5347282fbdedc8 HTTP/1.1" 200 None 2026-04-18 17:42:20,671 - lava_callback - DEBUG - Processing node 69e3c11a7f5347282fbdedc8: baseline-arm64-foundriesio 2026-04-18 17:42:21,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:42:21,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:42:21,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c11a7f5347282fbdedc8/log.txt.gz 2026-04-18 17:42:22,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:42:22,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:42:22,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c11a7f5347282fbdedc8/lava-logs.yaml 2026-04-18 17:42:22,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:42:23,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:42:23,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c11a7f5347282fbdedc8/lava_callback.json.gz DEBUG: Setup failed for 69e3c11a7f5347282fbdedc8. Transitting job node result: incomplete -> fail 2026-04-18 17:42:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:42:23,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c11a7f5347282fbdedc8 HTTP/1.1" 200 None 2026-04-18 17:42:23,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:42:23,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:42:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:42:23,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c11a7f5347282fbdedc8 HTTP/1.1" 200 None 2026-04-18 17:42:23,326 - lava_callback - INFO - Completed processing callback for node 69e3c11a7f5347282fbdedc8 2026-04-18 17:42:23,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:42:23,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET /node/6983ed3b969566dcb0d29a98%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET /node/69dae95e0a04df09a44e8c66%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET /node/69936a97cebe99dd8e067092%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:43:42,114 - lava_callback - INFO - Received callback for node 69e3c2837f5347282fbdee79 INFO: 172.21.0.1:60280 - "POST /node/69e3c2837f5347282fbdee79 HTTP/1.0" 202 Accepted 2026-04-18 17:43:42,125 - lava_callback - INFO - Starting async job submit for node 69e3c2837f5347282fbdee79 2026-04-18 17:43:42,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:43:42,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c2837f5347282fbdee79 HTTP/1.1" 200 None 2026-04-18 17:43:42,182 - lava_callback - DEBUG - Processing node 69e3c2837f5347282fbdee79: baseline-arm64 2026-04-18 17:43:42,329 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:43:42,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:43:42,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:43:42,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c2837f5347282fbdee79/lava-logs.yaml 2026-04-18 17:43:42,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:43:42,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:43:42,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c2837f5347282fbdee79/lava_callback.json.gz 2026-04-18 17:43:42,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:43:42,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c2837f5347282fbdee79 HTTP/1.1" 200 None 2026-04-18 17:43:42,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:43:42,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:43:42,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:43:42,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c2837f5347282fbdee79 HTTP/1.1" 200 None 2026-04-18 17:43:42,775 - lava_callback - INFO - Completed processing callback for node 69e3c2837f5347282fbdee79 INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:43:53,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:43:53,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:44:00,036 - lava_callback - INFO - Received callback for node 69e3be0e7f5347282fbdec56 INFO: 172.21.0.1:55208 - "POST /node/69e3be0e7f5347282fbdec56 HTTP/1.0" 202 Accepted 2026-04-18 17:44:00,042 - lava_callback - INFO - Starting async job submit for node 69e3be0e7f5347282fbdec56 2026-04-18 17:44:00,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:00,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3be0e7f5347282fbdec56 HTTP/1.1" 200 None 2026-04-18 17:44:00,084 - lava_callback - DEBUG - Processing node 69e3be0e7f5347282fbdec56: baseline-x86 2026-04-18 17:44:00,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:44:00,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:44:00,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3be0e7f5347282fbdec56/log.txt.gz 2026-04-18 17:44:00,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:44:00,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:44:00,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3be0e7f5347282fbdec56/lava-logs.yaml 2026-04-18 17:44:00,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:44:00,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:44:00,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3be0e7f5347282fbdec56/lava_callback.json.gz 2026-04-18 17:44:00,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:00,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3be0e7f5347282fbdec56 HTTP/1.1" 200 None 2026-04-18 17:44:00,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:00,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 17:44:00,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:00,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3be0e7f5347282fbdec56 HTTP/1.1" 200 None 2026-04-18 17:44:00,688 - lava_callback - INFO - Completed processing callback for node 69e3be0e7f5347282fbdec56 2026-04-18 17:44:05,817 - lava_callback - INFO - Received callback for node 69e11fd12eed175ae971b3da INFO: 172.21.0.1:55222 - "POST /node/69e11fd12eed175ae971b3da HTTP/1.0" 202 Accepted 2026-04-18 17:44:05,823 - lava_callback - INFO - Starting async job submit for node 69e11fd12eed175ae971b3da 2026-04-18 17:44:05,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:05,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11fd12eed175ae971b3da HTTP/1.1" 200 None 2026-04-18 17:44:05,838 - lava_callback - DEBUG - Processing node 69e11fd12eed175ae971b3da: baseline-arm64-baylibre 2026-04-18 17:44:05,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e11fd12eed175ae971b3da 2026-04-18 17:44:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:05,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11fd12eed175ae971b3da HTTP/1.1" 200 None 2026-04-18 17:44:05,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:05,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:44:05,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:05,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11fd12eed175ae971b3da HTTP/1.1" 200 None 2026-04-18 17:44:05,885 - lava_callback - ERROR - Error processing callback for node 69e11fd12eed175ae971b3da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:44:23,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:44:23,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:45:01,179 - lava_callback - INFO - Received callback for node 69e3c2d37f5347282fbdee9b INFO: 172.21.0.1:50520 - "POST /node/69e3c2d37f5347282fbdee9b HTTP/1.0" 202 Accepted 2026-04-18 17:45:01,186 - lava_callback - INFO - Starting async job submit for node 69e3c2d37f5347282fbdee9b 2026-04-18 17:45:01,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:01,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c2d37f5347282fbdee9b HTTP/1.1" 200 None 2026-04-18 17:45:01,236 - lava_callback - DEBUG - Processing node 69e3c2d37f5347282fbdee9b: baseline-arm64 2026-04-18 17:45:01,371 - lava_callback - WARNING - Failed to upload log 2026-04-18 17:45:01,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:45:01,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:45:01,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c2d37f5347282fbdee9b/lava-logs.yaml 2026-04-18 17:45:01,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:45:01,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:45:01,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c2d37f5347282fbdee9b/lava_callback.json.gz 2026-04-18 17:45:01,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:01,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c2d37f5347282fbdee9b HTTP/1.1" 200 None 2026-04-18 17:45:01,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:01,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:45:01,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:01,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c2d37f5347282fbdee9b HTTP/1.1" 200 None 2026-04-18 17:45:01,827 - lava_callback - INFO - Completed processing callback for node 69e3c2d37f5347282fbdee9b INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:45:23,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:23,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:45:32,444 - lava_callback - INFO - Received callback for node 69e120292eed175ae971b3fa INFO: 172.21.0.1:57886 - "POST /node/69e120292eed175ae971b3fa HTTP/1.0" 202 Accepted 2026-04-18 17:45:32,449 - lava_callback - INFO - Starting async job submit for node 69e120292eed175ae971b3fa 2026-04-18 17:45:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:32,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120292eed175ae971b3fa HTTP/1.1" 200 None 2026-04-18 17:45:32,471 - lava_callback - DEBUG - Processing node 69e120292eed175ae971b3fa: baseline-arm64-clabbe 2026-04-18 17:45:32,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e120292eed175ae971b3fa 2026-04-18 17:45:32,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120292eed175ae971b3fa HTTP/1.1" 200 None 2026-04-18 17:45:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:32,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:45:32,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:45:32,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e120292eed175ae971b3fa HTTP/1.1" 200 None 2026-04-18 17:45:32,520 - lava_callback - ERROR - Error processing callback for node 69e120292eed175ae971b3fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:46:07,929 - lava_callback - INFO - Received callback for node 69e3c1977f5347282fbdee06 INFO: 172.21.0.1:58346 - "POST /node/69e3c1977f5347282fbdee06 HTTP/1.0" 202 Accepted 2026-04-18 17:46:07,937 - lava_callback - INFO - Starting async job submit for node 69e3c1977f5347282fbdee06 2026-04-18 17:46:07,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:46:07,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c1977f5347282fbdee06 HTTP/1.1" 200 None 2026-04-18 17:46:07,994 - lava_callback - DEBUG - Processing node 69e3c1977f5347282fbdee06: baseline-arm64 2026-04-18 17:46:08,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:46:08,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:46:08,617 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c1977f5347282fbdee06/log.txt.gz 2026-04-18 17:46:08,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:46:09,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:46:09,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c1977f5347282fbdee06/lava-logs.yaml 2026-04-18 17:46:09,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:46:09,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:46:09,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c1977f5347282fbdee06/lava_callback.json.gz DEBUG: Setup failed for 69e3c1977f5347282fbdee06. Transitting job node result: incomplete -> fail 2026-04-18 17:46:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:46:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c1977f5347282fbdee06 HTTP/1.1" 200 None 2026-04-18 17:46:09,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:46:09,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:46:09,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:46:09,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c1977f5347282fbdee06 HTTP/1.1" 200 None 2026-04-18 17:46:09,380 - lava_callback - INFO - Completed processing callback for node 69e3c1977f5347282fbdee06 INFO: 172.21.0.1:34792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:46:23,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:46:23,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:47:52,611 - lava_callback - INFO - Received callback for node 69e120be2eed175ae971b42c INFO: 172.21.0.1:60680 - "POST /node/69e120be2eed175ae971b42c HTTP/1.0" 202 Accepted 2026-04-18 17:47:52,616 - lava_callback - INFO - Starting async job submit for node 69e120be2eed175ae971b42c 2026-04-18 17:47:52,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:47:52,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120be2eed175ae971b42c HTTP/1.1" 200 None 2026-04-18 17:47:52,632 - lava_callback - DEBUG - Processing node 69e120be2eed175ae971b42c: baseline-arm64-clabbe 2026-04-18 17:47:52,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e120be2eed175ae971b42c 2026-04-18 17:47:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:47:52,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120be2eed175ae971b42c HTTP/1.1" 200 None 2026-04-18 17:47:52,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:47:52,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:47:52,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:47:52,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e120be2eed175ae971b42c HTTP/1.1" 200 None 2026-04-18 17:47:52,679 - lava_callback - ERROR - Error processing callback for node 69e120be2eed175ae971b42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:49:12,637 - lava_callback - INFO - Received callback for node 69e121132eed175ae971b450 INFO: 172.21.0.1:42962 - "POST /node/69e121132eed175ae971b450 HTTP/1.0" 202 Accepted 2026-04-18 17:49:12,642 - lava_callback - INFO - Starting async job submit for node 69e121132eed175ae971b450 2026-04-18 17:49:12,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:12,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121132eed175ae971b450 HTTP/1.1" 200 None 2026-04-18 17:49:12,658 - lava_callback - DEBUG - Processing node 69e121132eed175ae971b450: baseline-arm64-clabbe 2026-04-18 17:49:12,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e121132eed175ae971b450 2026-04-18 17:49:12,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:12,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121132eed175ae971b450 HTTP/1.1" 200 None 2026-04-18 17:49:12,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:12,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:49:12,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:12,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e121132eed175ae971b450 HTTP/1.1" 200 None 2026-04-18 17:49:12,707 - lava_callback - ERROR - Error processing callback for node 69e121132eed175ae971b450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:49:17,156 - lava_callback - INFO - Received callback for node 69e3bcb27f5347282fbdea4a INFO: 172.21.0.1:42990 - "POST /node/69e3bcb27f5347282fbdea4a HTTP/1.0" 202 Accepted 2026-04-18 17:49:17,163 - lava_callback - INFO - Starting async job submit for node 69e3bcb27f5347282fbdea4a 2026-04-18 17:49:17,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:17,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb27f5347282fbdea4a HTTP/1.1" 200 None 2026-04-18 17:49:17,221 - lava_callback - DEBUG - Processing node 69e3bcb27f5347282fbdea4a: baseline-nfs-arm64 2026-04-18 17:49:17,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:18,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:18,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb27f5347282fbdea4a/log.txt.gz 2026-04-18 17:49:18,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:18,416 - lava_callback - INFO - Received callback for node 69e3c3ad7f5347282fbdeef9 INFO: 172.21.0.1:43002 - "POST /node/69e3c3ad7f5347282fbdeef9 HTTP/1.0" 202 Accepted 2026-04-18 17:49:18,424 - lava_callback - INFO - Starting async job submit for node 69e3c3ad7f5347282fbdeef9 2026-04-18 17:49:18,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3ad7f5347282fbdeef9 HTTP/1.1" 200 None 2026-04-18 17:49:18,474 - lava_callback - DEBUG - Processing node 69e3c3ad7f5347282fbdeef9: baseline-arm64-kontron 2026-04-18 17:49:18,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:18,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:18,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb27f5347282fbdea4a/lava-logs.yaml 2026-04-18 17:49:18,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:18,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:18,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c3ad7f5347282fbdeef9/log.txt.gz 2026-04-18 17:49:18,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:18,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3bcb27f5347282fbdea4a/lava_callback.json.gz 2026-04-18 17:49:19,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:19,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcb27f5347282fbdea4a HTTP/1.1" 200 None 2026-04-18 17:49:19,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:49:19,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcb27f5347282fbdea4a HTTP/1.1" 200 None 2026-04-18 17:49:19,214 - lava_callback - INFO - Completed processing callback for node 69e3bcb27f5347282fbdea4a 2026-04-18 17:49:19,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:19,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c3ad7f5347282fbdeef9/lava-logs.yaml 2026-04-18 17:49:19,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:49:19,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:49:19,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3c3ad7f5347282fbdeef9/lava_callback.json.gz 2026-04-18 17:49:19,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3ad7f5347282fbdeef9 HTTP/1.1" 200 None 2026-04-18 17:49:19,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:49:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:19,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c3ad7f5347282fbdeef9 HTTP/1.1" 200 None 2026-04-18 17:49:19,573 - lava_callback - INFO - Completed processing callback for node 69e3c3ad7f5347282fbdeef9 2026-04-18 17:49:23,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:49:23,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:50:52,704 - lava_callback - INFO - Received callback for node 69e121682eed175ae971b480 INFO: 172.21.0.1:56930 - "POST /node/69e121682eed175ae971b480 HTTP/1.0" 202 Accepted 2026-04-18 17:50:52,710 - lava_callback - INFO - Starting async job submit for node 69e121682eed175ae971b480 2026-04-18 17:50:52,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:50:52,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121682eed175ae971b480 HTTP/1.1" 200 None 2026-04-18 17:50:52,726 - lava_callback - DEBUG - Processing node 69e121682eed175ae971b480: baseline-arm64-clabbe 2026-04-18 17:50:52,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e121682eed175ae971b480 2026-04-18 17:50:52,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:50:52,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121682eed175ae971b480 HTTP/1.1" 200 None 2026-04-18 17:50:52,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:50:52,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:50:52,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:50:52,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e121682eed175ae971b480 HTTP/1.1" 200 None 2026-04-18 17:50:52,777 - lava_callback - ERROR - Error processing callback for node 69e121682eed175ae971b480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:52:12,780 - lava_callback - INFO - Received callback for node 69e121b92eed175ae971b4af INFO: 172.21.0.1:33914 - "POST /node/69e121b92eed175ae971b4af HTTP/1.0" 202 Accepted 2026-04-18 17:52:12,790 - lava_callback - INFO - Starting async job submit for node 69e121b92eed175ae971b4af 2026-04-18 17:52:12,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:52:12,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121b92eed175ae971b4af HTTP/1.1" 200 None 2026-04-18 17:52:12,814 - lava_callback - DEBUG - Processing node 69e121b92eed175ae971b4af: baseline-arm64-clabbe 2026-04-18 17:52:12,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e121b92eed175ae971b4af 2026-04-18 17:52:12,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:52:12,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121b92eed175ae971b4af HTTP/1.1" 200 None 2026-04-18 17:52:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:52:12,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:52:12,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:52:12,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e121b92eed175ae971b4af HTTP/1.1" 200 None 2026-04-18 17:52:12,861 - lava_callback - ERROR - Error processing callback for node 69e121b92eed175ae971b4af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:54:32,804 - lava_callback - INFO - Received callback for node 69e122502eed175ae971b4e2 INFO: 172.21.0.1:46484 - "POST /node/69e122502eed175ae971b4e2 HTTP/1.0" 202 Accepted 2026-04-18 17:54:32,810 - lava_callback - INFO - Starting async job submit for node 69e122502eed175ae971b4e2 2026-04-18 17:54:32,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:54:32,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122502eed175ae971b4e2 HTTP/1.1" 200 None 2026-04-18 17:54:32,826 - lava_callback - DEBUG - Processing node 69e122502eed175ae971b4e2: baseline-arm64-clabbe 2026-04-18 17:54:32,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e122502eed175ae971b4e2 2026-04-18 17:54:32,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:54:32,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122502eed175ae971b4e2 HTTP/1.1" 200 None 2026-04-18 17:54:32,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:54:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:54:32,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:54:32,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e122502eed175ae971b4e2 HTTP/1.1" 200 None 2026-04-18 17:54:32,873 - lava_callback - ERROR - Error processing callback for node 69e122502eed175ae971b4e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:55:52,930 - lava_callback - INFO - Received callback for node 69e122a02eed175ae971b4fb INFO: 172.21.0.1:49596 - "POST /node/69e122a02eed175ae971b4fb HTTP/1.0" 202 Accepted 2026-04-18 17:55:52,936 - lava_callback - INFO - Starting async job submit for node 69e122a02eed175ae971b4fb 2026-04-18 17:55:52,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:55:52,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122a02eed175ae971b4fb HTTP/1.1" 200 None 2026-04-18 17:55:52,983 - lava_callback - DEBUG - Processing node 69e122a02eed175ae971b4fb: baseline-arm64-clabbe 2026-04-18 17:55:52,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e122a02eed175ae971b4fb 2026-04-18 17:55:52,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:55:53,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122a02eed175ae971b4fb HTTP/1.1" 200 None 2026-04-18 17:55:53,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:55:53,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 17:55:53,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:55:53,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e122a02eed175ae971b4fb HTTP/1.1" 200 None 2026-04-18 17:55:53,054 - lava_callback - ERROR - Error processing callback for node 69e122a02eed175ae971b4fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:57:27,016 - lava_callback - INFO - Received callback for node 69e3c5277f5347282fbdefa4 INFO: 172.21.0.1:59368 - "POST /node/69e3c5277f5347282fbdefa4 HTTP/1.0" 202 Accepted 2026-04-18 17:57:27,026 - lava_callback - INFO - Starting async job submit for node 69e3c5277f5347282fbdefa4 2026-04-18 17:57:27,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:57:27,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c5277f5347282fbdefa4 HTTP/1.1" 200 None 2026-04-18 17:57:27,067 - lava_callback - DEBUG - Processing node 69e3c5277f5347282fbdefa4: baseline-arm64 2026-04-18 17:57:27,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:57:27,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:57:27,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c5277f5347282fbdefa4/log.txt.gz 2026-04-18 17:57:27,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:57:27,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:57:27,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c5277f5347282fbdefa4/lava-logs.yaml 2026-04-18 17:57:27,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 17:57:28,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 17:57:28,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c5277f5347282fbdefa4/lava_callback.json.gz 2026-04-18 17:57:28,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:57:28,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c5277f5347282fbdefa4 HTTP/1.1" 200 None 2026-04-18 17:57:28,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:57:28,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 17:57:28,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:57:28,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c5277f5347282fbdefa4 HTTP/1.1" 200 None 2026-04-18 17:57:28,258 - lava_callback - INFO - Completed processing callback for node 69e3c5277f5347282fbdefa4 INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:57:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:57:53,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:58:26,603 - lava_callback - INFO - Received callback for node 69e123342eed175ae971b53e INFO: 172.21.0.1:34132 - "POST /node/69e123342eed175ae971b53e HTTP/1.0" 202 Accepted 2026-04-18 17:58:26,608 - lava_callback - INFO - Starting async job submit for node 69e123342eed175ae971b53e 2026-04-18 17:58:26,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:58:26,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123342eed175ae971b53e HTTP/1.1" 200 None 2026-04-18 17:58:26,624 - lava_callback - DEBUG - Processing node 69e123342eed175ae971b53e: baseline-arm64-baylibre 2026-04-18 17:58:26,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e123342eed175ae971b53e 2026-04-18 17:58:26,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:58:26,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123342eed175ae971b53e HTTP/1.1" 200 None 2026-04-18 17:58:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:58:26,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 17:58:26,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:58:26,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e123342eed175ae971b53e HTTP/1.1" 200 None 2026-04-18 17:58:26,687 - lava_callback - ERROR - Error processing callback for node 69e123342eed175ae971b53e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK 2026-04-18 17:59:46,634 - lava_callback - INFO - Received callback for node 69e123802eed175ae971b56a INFO: 172.21.0.1:39394 - "POST /node/69e123802eed175ae971b56a HTTP/1.0" 202 Accepted 2026-04-18 17:59:46,640 - lava_callback - INFO - Starting async job submit for node 69e123802eed175ae971b56a 2026-04-18 17:59:46,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:59:46,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123802eed175ae971b56a HTTP/1.1" 200 None 2026-04-18 17:59:46,656 - lava_callback - DEBUG - Processing node 69e123802eed175ae971b56a: baseline-arm64-baylibre 2026-04-18 17:59:46,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e123802eed175ae971b56a 2026-04-18 17:59:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:59:46,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123802eed175ae971b56a HTTP/1.1" 200 None 2026-04-18 17:59:46,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:59:46,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 17:59:46,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 17:59:46,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e123802eed175ae971b56a HTTP/1.1" 200 None 2026-04-18 17:59:46,703 - lava_callback - ERROR - Error processing callback for node 69e123802eed175ae971b56a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:01:04,808 - lava_callback - INFO - Received callback for node 69e3c6bd7f5347282fbdf048 INFO: 172.21.0.1:51184 - "POST /node/69e3c6bd7f5347282fbdf048 HTTP/1.0" 202 Accepted 2026-04-18 18:01:04,814 - lava_callback - INFO - Starting async job submit for node 69e3c6bd7f5347282fbdf048 2026-04-18 18:01:04,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:01:04,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c6bd7f5347282fbdf048 HTTP/1.1" 200 None 2026-04-18 18:01:04,834 - lava_callback - DEBUG - Processing node 69e3c6bd7f5347282fbdf048: baseline-nfs-arm64 2026-04-18 18:01:04,836 - lava_callback - WARNING - Failed to upload log 2026-04-18 18:01:04,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:01:04,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:01:04,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c6bd7f5347282fbdf048/lava-logs.yaml 2026-04-18 18:01:04,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:01:05,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:01:05,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c6bd7f5347282fbdf048/lava_callback.json.gz 2026-04-18 18:01:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:01:05,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c6bd7f5347282fbdf048 HTTP/1.1" 200 None 2026-04-18 18:01:05,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:01:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:01:05,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:01:05,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c6bd7f5347282fbdf048 HTTP/1.1" 200 None 2026-04-18 18:01:05,085 - lava_callback - INFO - Completed processing callback for node 69e3c6bd7f5347282fbdf048 INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:01:23,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:01:23,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET /node/693e49d0407f32424eb5fd0e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58718 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:02:27,047 - lava_callback - INFO - Received callback for node 69e1241e2eed175ae971b5b8 INFO: 172.21.0.1:58728 - "POST /node/69e1241e2eed175ae971b5b8 HTTP/1.0" 202 Accepted 2026-04-18 18:02:27,052 - lava_callback - INFO - Starting async job submit for node 69e1241e2eed175ae971b5b8 2026-04-18 18:02:27,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:27,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1241e2eed175ae971b5b8 HTTP/1.1" 200 None 2026-04-18 18:02:27,068 - lava_callback - DEBUG - Processing node 69e1241e2eed175ae971b5b8: baseline-arm64-baylibre 2026-04-18 18:02:27,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1241e2eed175ae971b5b8 2026-04-18 18:02:27,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:27,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1241e2eed175ae971b5b8 HTTP/1.1" 200 None 2026-04-18 18:02:27,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:27,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:02:27,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:27,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1241e2eed175ae971b5b8 HTTP/1.1" 200 None 2026-04-18 18:02:27,122 - lava_callback - ERROR - Error processing callback for node 69e1241e2eed175ae971b5b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:02:39,492 - lava_callback - INFO - Received callback for node 69e3c3217f5347282fbdeec3 INFO: 172.21.0.1:36234 - "POST /node/69e3c3217f5347282fbdeec3 HTTP/1.0" 202 Accepted 2026-04-18 18:02:39,498 - lava_callback - INFO - Starting async job submit for node 69e3c3217f5347282fbdeec3 2026-04-18 18:02:39,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:39,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3217f5347282fbdeec3 HTTP/1.1" 200 None 2026-04-18 18:02:39,570 - lava_callback - DEBUG - Processing node 69e3c3217f5347282fbdeec3: ltp-smoke 2026-04-18 18:02:40,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:40,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:40,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3c3217f5347282fbdeec3/log.txt.gz 2026-04-18 18:02:40,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:40,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:40,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3c3217f5347282fbdeec3/lava-logs.yaml 2026-04-18 18:02:40,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:40,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:40,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3c3217f5347282fbdeec3/lava_callback.json.gz 2026-04-18 18:02:40,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:40,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3217f5347282fbdeec3 HTTP/1.1" 200 None 2026-04-18 18:02:40,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:40,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af027f5347282fbdbc7e HTTP/1.1" 200 None 2026-04-18 18:02:40,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:40,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c3217f5347282fbdeec3 HTTP/1.1" 200 None 2026-04-18 18:02:41,041 - lava_callback - INFO - Completed processing callback for node 69e3c3217f5347282fbdeec3 2026-04-18 18:02:43,196 - lava_callback - INFO - Received callback for node 69e3c3237f5347282fbdeec6 INFO: 172.21.0.1:47594 - "POST /node/69e3c3237f5347282fbdeec6 HTTP/1.0" 202 Accepted 2026-04-18 18:02:43,203 - lava_callback - INFO - Starting async job submit for node 69e3c3237f5347282fbdeec6 2026-04-18 18:02:43,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:43,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3237f5347282fbdeec6 HTTP/1.1" 200 None 2026-04-18 18:02:43,270 - lava_callback - DEBUG - Processing node 69e3c3237f5347282fbdeec6: baseline-arm 2026-04-18 18:02:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:43,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:43,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3c3237f5347282fbdeec6/log.txt.gz 2026-04-18 18:02:44,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:44,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:44,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3c3237f5347282fbdeec6/lava-logs.yaml 2026-04-18 18:02:44,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:02:44,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:02:44,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3c3237f5347282fbdeec6/lava_callback.json.gz DEBUG: Setup failed for 69e3c3237f5347282fbdeec6. Transitting job node result: incomplete -> fail 2026-04-18 18:02:44,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:44,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c3237f5347282fbdeec6 HTTP/1.1" 200 None 2026-04-18 18:02:44,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:44,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 18:02:44,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:44,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c3237f5347282fbdeec6 HTTP/1.1" 200 None 2026-04-18 18:02:44,939 - lava_callback - INFO - Completed processing callback for node 69e3c3237f5347282fbdeec6 INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:02:53,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:02:53,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:03:26,820 - lava_callback - INFO - Received callback for node 69e124682eed175ae971b5e3 INFO: 172.21.0.1:37664 - "POST /node/69e124682eed175ae971b5e3 HTTP/1.0" 202 Accepted 2026-04-18 18:03:26,825 - lava_callback - INFO - Starting async job submit for node 69e124682eed175ae971b5e3 2026-04-18 18:03:26,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:26,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124682eed175ae971b5e3 HTTP/1.1" 200 None 2026-04-18 18:03:26,842 - lava_callback - DEBUG - Processing node 69e124682eed175ae971b5e3: baseline-arm64-baylibre 2026-04-18 18:03:26,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e124682eed175ae971b5e3 2026-04-18 18:03:26,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:26,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124682eed175ae971b5e3 HTTP/1.1" 200 None 2026-04-18 18:03:26,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:26,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:03:26,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:26,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124682eed175ae971b5e3 HTTP/1.1" 200 None 2026-04-18 18:03:26,889 - lava_callback - ERROR - Error processing callback for node 69e124682eed175ae971b5e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:03:30,858 - lava_callback - INFO - Received callback for node 69e3c7207f5347282fbdf074 INFO: 172.21.0.1:39292 - "POST /node/69e3c7207f5347282fbdf074 HTTP/1.0" 202 Accepted 2026-04-18 18:03:30,865 - lava_callback - INFO - Starting async job submit for node 69e3c7207f5347282fbdf074 2026-04-18 18:03:30,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:30,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7207f5347282fbdf074 HTTP/1.1" 200 None 2026-04-18 18:03:30,909 - lava_callback - DEBUG - Processing node 69e3c7207f5347282fbdf074: baseline-arm64-foundriesio 2026-04-18 18:03:31,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:03:31,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:03:31,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c7207f5347282fbdf074/log.txt.gz 2026-04-18 18:03:31,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:03:31,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:03:31,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c7207f5347282fbdf074/lava-logs.yaml 2026-04-18 18:03:31,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:03:32,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:03:32,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e3c7207f5347282fbdf074/lava_callback.json.gz 2026-04-18 18:03:32,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:32,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7207f5347282fbdf074 HTTP/1.1" 200 None 2026-04-18 18:03:32,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:32,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:03:32,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:32,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c7207f5347282fbdf074 HTTP/1.1" 200 None 2026-04-18 18:03:32,089 - lava_callback - INFO - Completed processing callback for node 69e3c7207f5347282fbdf074 INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:03:43,773 - lava_callback - INFO - Received callback for node 69e3c7587f5347282fbdf09b INFO: 172.21.0.1:60110 - "POST /node/69e3c7587f5347282fbdf09b HTTP/1.0" 202 Accepted 2026-04-18 18:03:43,780 - lava_callback - INFO - Starting async job submit for node 69e3c7587f5347282fbdf09b 2026-04-18 18:03:43,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:43,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7587f5347282fbdf09b HTTP/1.1" 200 None 2026-04-18 18:03:43,825 - lava_callback - DEBUG - Processing node 69e3c7587f5347282fbdf09b: baseline-arm64 2026-04-18 18:03:43,953 - lava_callback - WARNING - Failed to upload log 2026-04-18 18:03:44,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:03:44,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:03:44,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c7587f5347282fbdf09b/lava-logs.yaml 2026-04-18 18:03:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:03:44,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:03:44,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c7587f5347282fbdf09b/lava_callback.json.gz 2026-04-18 18:03:44,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:44,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7587f5347282fbdf09b HTTP/1.1" 200 None 2026-04-18 18:03:44,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:44,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:03:44,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:44,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c7587f5347282fbdf09b HTTP/1.1" 200 None 2026-04-18 18:03:44,571 - lava_callback - INFO - Completed processing callback for node 69e3c7587f5347282fbdf09b INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:03:53,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:03:53,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45448 - "GET /node/6988c5dd9fc35f969e1eec2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:04:46,907 - lava_callback - INFO - Received callback for node 69e124b92eed175ae971b5fe INFO: 172.21.0.1:55284 - "POST /node/69e124b92eed175ae971b5fe HTTP/1.0" 202 Accepted 2026-04-18 18:04:46,913 - lava_callback - INFO - Starting async job submit for node 69e124b92eed175ae971b5fe 2026-04-18 18:04:46,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:04:46,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124b92eed175ae971b5fe HTTP/1.1" 200 None 2026-04-18 18:04:46,928 - lava_callback - DEBUG - Processing node 69e124b92eed175ae971b5fe: baseline-arm64-baylibre 2026-04-18 18:04:46,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e124b92eed175ae971b5fe 2026-04-18 18:04:46,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:04:46,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124b92eed175ae971b5fe HTTP/1.1" 200 None 2026-04-18 18:04:46,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:04:46,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:04:46,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:04:46,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124b92eed175ae971b5fe HTTP/1.1" 200 None 2026-04-18 18:04:46,980 - lava_callback - ERROR - Error processing callback for node 69e124b92eed175ae971b5fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET /node/6991155685f550420785e238%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:06:06,970 - lava_callback - INFO - Received callback for node 69e125002eed175ae971b639 INFO: 172.21.0.1:49890 - "POST /node/69e125002eed175ae971b639 HTTP/1.0" 202 Accepted 2026-04-18 18:06:06,975 - lava_callback - INFO - Starting async job submit for node 69e125002eed175ae971b639 2026-04-18 18:06:06,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:06,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125002eed175ae971b639 HTTP/1.1" 200 None 2026-04-18 18:06:06,997 - lava_callback - DEBUG - Processing node 69e125002eed175ae971b639: baseline-arm-baylibre 2026-04-18 18:06:06,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125002eed175ae971b639 2026-04-18 18:06:06,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125002eed175ae971b639 HTTP/1.1" 200 None 2026-04-18 18:06:07,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:07,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125002eed175ae971b639 HTTP/1.1" 200 None 2026-04-18 18:06:07,047 - lava_callback - ERROR - Error processing callback for node 69e125002eed175ae971b639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:07,668 - lava_callback - INFO - Received callback for node 69e125022eed175ae971b63c INFO: 172.21.0.1:49900 - "POST /node/69e125022eed175ae971b63c HTTP/1.0" 202 Accepted 2026-04-18 18:06:07,677 - lava_callback - INFO - Starting async job submit for node 69e125022eed175ae971b63c 2026-04-18 18:06:07,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125022eed175ae971b63c HTTP/1.1" 200 None 2026-04-18 18:06:07,696 - lava_callback - DEBUG - Processing node 69e125022eed175ae971b63c: baseline-arm-baylibre 2026-04-18 18:06:07,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125022eed175ae971b63c 2026-04-18 18:06:07,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125022eed175ae971b63c HTTP/1.1" 200 None 2026-04-18 18:06:07,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:07,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:07,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125022eed175ae971b63c HTTP/1.1" 200 None 2026-04-18 18:06:07,752 - lava_callback - ERROR - Error processing callback for node 69e125022eed175ae971b63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:08,370 - lava_callback - INFO - Received callback for node 69e125032eed175ae971b63f INFO: 172.21.0.1:49914 - "POST /node/69e125032eed175ae971b63f HTTP/1.0" 202 Accepted 2026-04-18 18:06:08,379 - lava_callback - INFO - Starting async job submit for node 69e125032eed175ae971b63f 2026-04-18 18:06:08,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:08,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125032eed175ae971b63f HTTP/1.1" 200 None 2026-04-18 18:06:08,401 - lava_callback - DEBUG - Processing node 69e125032eed175ae971b63f: baseline-arm-baylibre 2026-04-18 18:06:08,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125032eed175ae971b63f 2026-04-18 18:06:08,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:08,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125032eed175ae971b63f HTTP/1.1" 200 None 2026-04-18 18:06:08,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:08,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:08,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:08,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125032eed175ae971b63f HTTP/1.1" 200 None 2026-04-18 18:06:08,461 - lava_callback - ERROR - Error processing callback for node 69e125032eed175ae971b63f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:09,047 - lava_callback - INFO - Received callback for node 69e125042eed175ae971b644 INFO: 172.21.0.1:49926 - "POST /node/69e125042eed175ae971b644 HTTP/1.0" 202 Accepted 2026-04-18 18:06:09,053 - lava_callback - INFO - Starting async job submit for node 69e125042eed175ae971b644 2026-04-18 18:06:09,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125042eed175ae971b644 HTTP/1.1" 200 None 2026-04-18 18:06:09,069 - lava_callback - DEBUG - Processing node 69e125042eed175ae971b644: baseline-arm-baylibre 2026-04-18 18:06:09,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125042eed175ae971b644 2026-04-18 18:06:09,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125042eed175ae971b644 HTTP/1.1" 200 None 2026-04-18 18:06:09,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:09,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125042eed175ae971b644 HTTP/1.1" 200 None 2026-04-18 18:06:09,117 - lava_callback - ERROR - Error processing callback for node 69e125042eed175ae971b644: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:09,726 - lava_callback - INFO - Received callback for node 69e125082eed175ae971b64f INFO: 172.21.0.1:37136 - "POST /node/69e125082eed175ae971b64f HTTP/1.0" 202 Accepted 2026-04-18 18:06:09,731 - lava_callback - INFO - Starting async job submit for node 69e125082eed175ae971b64f 2026-04-18 18:06:09,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125082eed175ae971b64f HTTP/1.1" 200 None 2026-04-18 18:06:09,747 - lava_callback - DEBUG - Processing node 69e125082eed175ae971b64f: baseline-arm64-baylibre 2026-04-18 18:06:09,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125082eed175ae971b64f 2026-04-18 18:06:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125082eed175ae971b64f HTTP/1.1" 200 None 2026-04-18 18:06:09,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:06:09,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:09,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125082eed175ae971b64f HTTP/1.1" 200 None 2026-04-18 18:06:09,794 - lava_callback - ERROR - Error processing callback for node 69e125082eed175ae971b64f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:10,424 - lava_callback - INFO - Received callback for node 69e125082eed175ae971b651 INFO: 172.21.0.1:37138 - "POST /node/69e125082eed175ae971b651 HTTP/1.0" 202 Accepted 2026-04-18 18:06:10,434 - lava_callback - INFO - Starting async job submit for node 69e125082eed175ae971b651 2026-04-18 18:06:10,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:10,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125082eed175ae971b651 HTTP/1.1" 200 None 2026-04-18 18:06:10,457 - lava_callback - DEBUG - Processing node 69e125082eed175ae971b651: baseline-arm-baylibre 2026-04-18 18:06:10,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125082eed175ae971b651 2026-04-18 18:06:10,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:10,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125082eed175ae971b651 HTTP/1.1" 200 None 2026-04-18 18:06:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:10,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:10,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:10,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125082eed175ae971b651 HTTP/1.1" 200 None 2026-04-18 18:06:10,514 - lava_callback - ERROR - Error processing callback for node 69e125082eed175ae971b651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:11,112 - lava_callback - INFO - Received callback for node 69e125092eed175ae971b655 INFO: 172.21.0.1:37152 - "POST /node/69e125092eed175ae971b655 HTTP/1.0" 202 Accepted 2026-04-18 18:06:11,118 - lava_callback - INFO - Starting async job submit for node 69e125092eed175ae971b655 2026-04-18 18:06:11,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:11,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125092eed175ae971b655 HTTP/1.1" 200 None 2026-04-18 18:06:11,134 - lava_callback - DEBUG - Processing node 69e125092eed175ae971b655: baseline-arm-baylibre 2026-04-18 18:06:11,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125092eed175ae971b655 2026-04-18 18:06:11,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:11,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125092eed175ae971b655 HTTP/1.1" 200 None 2026-04-18 18:06:11,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:11,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:11,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:11,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125092eed175ae971b655 HTTP/1.1" 200 None 2026-04-18 18:06:11,181 - lava_callback - ERROR - Error processing callback for node 69e125092eed175ae971b655: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:13,349 - lava_callback - INFO - Received callback for node 69e125102eed175ae971b66a INFO: 172.21.0.1:37158 - "POST /node/69e125102eed175ae971b66a HTTP/1.0" 202 Accepted 2026-04-18 18:06:13,355 - lava_callback - INFO - Starting async job submit for node 69e125102eed175ae971b66a 2026-04-18 18:06:13,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:13,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125102eed175ae971b66a HTTP/1.1" 200 None 2026-04-18 18:06:13,370 - lava_callback - DEBUG - Processing node 69e125102eed175ae971b66a: baseline-arm-clabbe 2026-04-18 18:06:13,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125102eed175ae971b66a 2026-04-18 18:06:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:13,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125102eed175ae971b66a HTTP/1.1" 200 None 2026-04-18 18:06:13,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:13,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:13,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125102eed175ae971b66a HTTP/1.1" 200 None 2026-04-18 18:06:13,429 - lava_callback - ERROR - Error processing callback for node 69e125102eed175ae971b66a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:14,039 - lava_callback - INFO - Received callback for node 69e125132eed175ae971b670 INFO: 172.21.0.1:37174 - "POST /node/69e125132eed175ae971b670 HTTP/1.0" 202 Accepted 2026-04-18 18:06:14,044 - lava_callback - INFO - Starting async job submit for node 69e125132eed175ae971b670 2026-04-18 18:06:14,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125132eed175ae971b670 HTTP/1.1" 200 None 2026-04-18 18:06:14,061 - lava_callback - DEBUG - Processing node 69e125132eed175ae971b670: baseline-arm-clabbe 2026-04-18 18:06:14,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125132eed175ae971b670 2026-04-18 18:06:14,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125132eed175ae971b670 HTTP/1.1" 200 None 2026-04-18 18:06:14,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125132eed175ae971b670 HTTP/1.1" 200 None 2026-04-18 18:06:14,138 - lava_callback - ERROR - Error processing callback for node 69e125132eed175ae971b670: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:14,727 - lava_callback - INFO - Received callback for node 69e125132eed175ae971b677 INFO: 172.21.0.1:37188 - "POST /node/69e125132eed175ae971b677 HTTP/1.0" 202 Accepted 2026-04-18 18:06:14,737 - lava_callback - INFO - Starting async job submit for node 69e125132eed175ae971b677 2026-04-18 18:06:14,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125132eed175ae971b677 HTTP/1.1" 200 None 2026-04-18 18:06:14,761 - lava_callback - DEBUG - Processing node 69e125132eed175ae971b677: baseline-arm-clabbe 2026-04-18 18:06:14,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125132eed175ae971b677 2026-04-18 18:06:14,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125132eed175ae971b677 HTTP/1.1" 200 None 2026-04-18 18:06:14,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:14,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:14,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125132eed175ae971b677 HTTP/1.1" 200 None 2026-04-18 18:06:14,825 - lava_callback - ERROR - Error processing callback for node 69e125132eed175ae971b677: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:06:33,339 - lava_callback - INFO - Received callback for node 69e125142eed175ae971b67a INFO: 172.21.0.1:34718 - "POST /node/69e125142eed175ae971b67a HTTP/1.0" 202 Accepted 2026-04-18 18:06:33,345 - lava_callback - INFO - Starting async job submit for node 69e125142eed175ae971b67a 2026-04-18 18:06:33,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125142eed175ae971b67a HTTP/1.1" 200 None 2026-04-18 18:06:33,370 - lava_callback - DEBUG - Processing node 69e125142eed175ae971b67a: baseline-arm-clabbe 2026-04-18 18:06:33,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125142eed175ae971b67a 2026-04-18 18:06:33,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:33,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125142eed175ae971b67a HTTP/1.1" 200 None 2026-04-18 18:06:33,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:33,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:33,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125142eed175ae971b67a HTTP/1.1" 200 None 2026-04-18 18:06:33,429 - lava_callback - ERROR - Error processing callback for node 69e125142eed175ae971b67a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:34,016 - lava_callback - INFO - Received callback for node 69e125152eed175ae971b67d INFO: 172.21.0.1:34730 - "POST /node/69e125152eed175ae971b67d HTTP/1.0" 202 Accepted 2026-04-18 18:06:34,022 - lava_callback - INFO - Starting async job submit for node 69e125152eed175ae971b67d 2026-04-18 18:06:34,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125152eed175ae971b67d HTTP/1.1" 200 None 2026-04-18 18:06:34,039 - lava_callback - DEBUG - Processing node 69e125152eed175ae971b67d: baseline-arm-clabbe 2026-04-18 18:06:34,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125152eed175ae971b67d 2026-04-18 18:06:34,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125152eed175ae971b67d HTTP/1.1" 200 None 2026-04-18 18:06:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:34,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125152eed175ae971b67d HTTP/1.1" 200 None 2026-04-18 18:06:34,090 - lava_callback - ERROR - Error processing callback for node 69e125152eed175ae971b67d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:34,701 - lava_callback - INFO - Received callback for node 69e125162eed175ae971b680 INFO: 172.21.0.1:34738 - "POST /node/69e125162eed175ae971b680 HTTP/1.0" 202 Accepted 2026-04-18 18:06:34,707 - lava_callback - INFO - Starting async job submit for node 69e125162eed175ae971b680 2026-04-18 18:06:34,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125162eed175ae971b680 HTTP/1.1" 200 None 2026-04-18 18:06:34,724 - lava_callback - DEBUG - Processing node 69e125162eed175ae971b680: baseline-arm-clabbe 2026-04-18 18:06:34,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125162eed175ae971b680 2026-04-18 18:06:34,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125162eed175ae971b680 HTTP/1.1" 200 None 2026-04-18 18:06:34,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:34,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:34,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125162eed175ae971b680 HTTP/1.1" 200 None 2026-04-18 18:06:34,783 - lava_callback - ERROR - Error processing callback for node 69e125162eed175ae971b680: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:35,393 - lava_callback - INFO - Received callback for node 69e125172eed175ae971b683 INFO: 172.21.0.1:34752 - "POST /node/69e125172eed175ae971b683 HTTP/1.0" 202 Accepted 2026-04-18 18:06:35,403 - lava_callback - INFO - Starting async job submit for node 69e125172eed175ae971b683 2026-04-18 18:06:35,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:35,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125172eed175ae971b683 HTTP/1.1" 200 None 2026-04-18 18:06:35,430 - lava_callback - DEBUG - Processing node 69e125172eed175ae971b683: baseline-arm-clabbe 2026-04-18 18:06:35,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125172eed175ae971b683 2026-04-18 18:06:35,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:35,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125172eed175ae971b683 HTTP/1.1" 200 None 2026-04-18 18:06:35,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:35,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:35,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125172eed175ae971b683 HTTP/1.1" 200 None 2026-04-18 18:06:35,481 - lava_callback - ERROR - Error processing callback for node 69e125172eed175ae971b683: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:06:36,087 - lava_callback - INFO - Received callback for node 69e125172eed175ae971b686 INFO: 172.21.0.1:34754 - "POST /node/69e125172eed175ae971b686 HTTP/1.0" 202 Accepted 2026-04-18 18:06:36,097 - lava_callback - INFO - Starting async job submit for node 69e125172eed175ae971b686 2026-04-18 18:06:36,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125172eed175ae971b686 HTTP/1.1" 200 None 2026-04-18 18:06:36,116 - lava_callback - DEBUG - Processing node 69e125172eed175ae971b686: baseline-arm-clabbe 2026-04-18 18:06:36,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125172eed175ae971b686 2026-04-18 18:06:36,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125172eed175ae971b686 HTTP/1.1" 200 None 2026-04-18 18:06:36,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:36,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125172eed175ae971b686 HTTP/1.1" 200 None 2026-04-18 18:06:36,179 - lava_callback - ERROR - Error processing callback for node 69e125172eed175ae971b686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:06:36,800 - lava_callback - INFO - Received callback for node 69e125182eed175ae971b68c INFO: 172.21.0.1:34772 - "POST /node/69e125182eed175ae971b68c HTTP/1.0" 202 Accepted 2026-04-18 18:06:36,805 - lava_callback - INFO - Starting async job submit for node 69e125182eed175ae971b68c 2026-04-18 18:06:36,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125182eed175ae971b68c HTTP/1.1" 200 None 2026-04-18 18:06:36,821 - lava_callback - DEBUG - Processing node 69e125182eed175ae971b68c: baseline-arm-clabbe 2026-04-18 18:06:36,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125182eed175ae971b68c 2026-04-18 18:06:36,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125182eed175ae971b68c HTTP/1.1" 200 None 2026-04-18 18:06:36,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-18 18:06:36,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:06:36,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125182eed175ae971b68c HTTP/1.1" 200 None 2026-04-18 18:06:36,875 - lava_callback - ERROR - Error processing callback for node 69e125182eed175ae971b68c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET /node/69dd350517c944d2f17dc26f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:07:33,517 - lava_callback - INFO - Received callback for node 69e1255e2eed175ae971b747 INFO: 172.21.0.1:40864 - "POST /node/69e1255e2eed175ae971b747 HTTP/1.0" 202 Accepted 2026-04-18 18:07:33,523 - lava_callback - INFO - Starting async job submit for node 69e1255e2eed175ae971b747 2026-04-18 18:07:33,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:07:33,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1255e2eed175ae971b747 HTTP/1.1" 200 None 2026-04-18 18:07:33,546 - lava_callback - DEBUG - Processing node 69e1255e2eed175ae971b747: baseline-arm64-clabbe 2026-04-18 18:07:33,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1255e2eed175ae971b747 2026-04-18 18:07:33,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:07:33,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1255e2eed175ae971b747 HTTP/1.1" 200 None 2026-04-18 18:07:33,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:07:33,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:07:33,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:07:33,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1255e2eed175ae971b747 HTTP/1.1" 200 None 2026-04-18 18:07:33,610 - lava_callback - ERROR - Error processing callback for node 69e1255e2eed175ae971b747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:08:01,770 - lava_callback - INFO - Received callback for node 69e3c83b7f5347282fbdf10a INFO: 172.21.0.1:42018 - "POST /node/69e3c83b7f5347282fbdf10a HTTP/1.0" 202 Accepted 2026-04-18 18:08:01,778 - lava_callback - INFO - Starting async job submit for node 69e3c83b7f5347282fbdf10a 2026-04-18 18:08:01,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:01,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c83b7f5347282fbdf10a HTTP/1.1" 200 None 2026-04-18 18:08:01,837 - lava_callback - DEBUG - Processing node 69e3c83b7f5347282fbdf10a: baseline-arm64 2026-04-18 18:08:02,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:08:02,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:08:02,107 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c83b7f5347282fbdf10a/log.txt.gz 2026-04-18 18:08:02,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:08:02,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:08:02,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c83b7f5347282fbdf10a/lava-logs.yaml 2026-04-18 18:08:02,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:08:02,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:08:02,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c83b7f5347282fbdf10a/lava_callback.json.gz 2026-04-18 18:08:02,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:02,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c83b7f5347282fbdf10a HTTP/1.1" 200 None 2026-04-18 18:08:02,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:02,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:08:02,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:02,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c83b7f5347282fbdf10a HTTP/1.1" 200 None 2026-04-18 18:08:02,649 - lava_callback - INFO - Completed processing callback for node 69e3c83b7f5347282fbdf10a INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:08:23,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:23,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:08:53,435 - lava_callback - INFO - Received callback for node 69e125ad2eed175ae971b79b INFO: 172.21.0.1:49306 - "POST /node/69e125ad2eed175ae971b79b HTTP/1.0" 202 Accepted 2026-04-18 18:08:53,443 - lava_callback - INFO - Starting async job submit for node 69e125ad2eed175ae971b79b 2026-04-18 18:08:53,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:53,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125ad2eed175ae971b79b HTTP/1.1" 200 None 2026-04-18 18:08:53,459 - lava_callback - DEBUG - Processing node 69e125ad2eed175ae971b79b: baseline-arm64-clabbe 2026-04-18 18:08:53,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e125ad2eed175ae971b79b 2026-04-18 18:08:53,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:53,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125ad2eed175ae971b79b HTTP/1.1" 200 None 2026-04-18 18:08:53,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:53,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:08:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:08:53,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125ad2eed175ae971b79b HTTP/1.1" 200 None 2026-04-18 18:08:53,511 - lava_callback - ERROR - Error processing callback for node 69e125ad2eed175ae971b79b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET /node/694c18922f7ca341fdeb16b4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET /node/6988b77b9fc35f969e1eca47%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:11:33,549 - lava_callback - INFO - Received callback for node 69e1264b2eed175ae971b808 INFO: 172.21.0.1:47040 - "POST /node/69e1264b2eed175ae971b808 HTTP/1.0" 202 Accepted 2026-04-18 18:11:33,555 - lava_callback - INFO - Starting async job submit for node 69e1264b2eed175ae971b808 2026-04-18 18:11:33,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:11:33,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1264b2eed175ae971b808 HTTP/1.1" 200 None 2026-04-18 18:11:33,573 - lava_callback - DEBUG - Processing node 69e1264b2eed175ae971b808: baseline-arm64-clabbe 2026-04-18 18:11:33,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1264b2eed175ae971b808 2026-04-18 18:11:33,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:11:33,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1264b2eed175ae971b808 HTTP/1.1" 200 None 2026-04-18 18:11:33,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:11:33,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:11:33,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:11:33,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1264b2eed175ae971b808 HTTP/1.1" 200 None 2026-04-18 18:11:33,620 - lava_callback - ERROR - Error processing callback for node 69e1264b2eed175ae971b808: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET /node/6983c6ed66dc8a56088a8021%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:12:40,053 - lava_callback - INFO - Received callback for node 69e3c4dd7f5347282fbdef85 INFO: 172.21.0.1:41596 - "POST /node/69e3c4dd7f5347282fbdef85 HTTP/1.0" 202 Accepted 2026-04-18 18:12:40,062 - lava_callback - INFO - Starting async job submit for node 69e3c4dd7f5347282fbdef85 2026-04-18 18:12:40,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:40,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c4dd7f5347282fbdef85 HTTP/1.1" 200 None 2026-04-18 18:12:40,120 - lava_callback - DEBUG - Processing node 69e3c4dd7f5347282fbdef85: baseline-nfs-arm64 2026-04-18 18:12:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:12:41,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:12:41,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c4dd7f5347282fbdef85/log.txt.gz 2026-04-18 18:12:42,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:12:42,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:12:42,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c4dd7f5347282fbdef85/lava-logs.yaml 2026-04-18 18:12:42,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:12:42,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:12:42,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c4dd7f5347282fbdef85/lava_callback.json.gz DEBUG: Setup failed for 69e3c4dd7f5347282fbdef85. Transitting job node result: incomplete -> fail 2026-04-18 18:12:42,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:42,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c4dd7f5347282fbdef85 HTTP/1.1" 200 None 2026-04-18 18:12:42,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:42,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:12:42,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:42,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c4dd7f5347282fbdef85 HTTP/1.1" 200 None 2026-04-18 18:12:42,792 - lava_callback - INFO - Completed processing callback for node 69e3c4dd7f5347282fbdef85 INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:12:53,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:53,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 18:12:53,630 - lava_callback - INFO - Received callback for node 69e126992eed175ae971b830 INFO: 172.21.0.1:37814 - "POST /node/69e126992eed175ae971b830 HTTP/1.0" 202 Accepted 2026-04-18 18:12:53,636 - lava_callback - INFO - Starting async job submit for node 69e126992eed175ae971b830 2026-04-18 18:12:53,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:53,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e126992eed175ae971b830 HTTP/1.1" 200 None 2026-04-18 18:12:53,650 - lava_callback - DEBUG - Processing node 69e126992eed175ae971b830: baseline-arm64-clabbe 2026-04-18 18:12:53,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e126992eed175ae971b830 2026-04-18 18:12:53,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:53,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e126992eed175ae971b830 HTTP/1.1" 200 None 2026-04-18 18:12:53,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:12:53,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:12:53,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e126992eed175ae971b830 HTTP/1.1" 200 None 2026-04-18 18:12:53,698 - lava_callback - ERROR - Error processing callback for node 69e126992eed175ae971b830: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET /node/69846a663a8748f282086cdb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET /node/69dae9590a04df09a44e8c53%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:14:13,665 - lava_callback - INFO - Received callback for node 69e126e62eed175ae971b85c INFO: 172.21.0.1:34246 - "POST /node/69e126e62eed175ae971b85c HTTP/1.0" 202 Accepted 2026-04-18 18:14:13,670 - lava_callback - INFO - Starting async job submit for node 69e126e62eed175ae971b85c 2026-04-18 18:14:13,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:14:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e126e62eed175ae971b85c HTTP/1.1" 200 None 2026-04-18 18:14:13,687 - lava_callback - DEBUG - Processing node 69e126e62eed175ae971b85c: baseline-arm64-clabbe 2026-04-18 18:14:13,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e126e62eed175ae971b85c 2026-04-18 18:14:13,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:14:13,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e126e62eed175ae971b85c HTTP/1.1" 200 None 2026-04-18 18:14:13,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:14:13,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:14:13,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:14:13,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e126e62eed175ae971b85c HTTP/1.1" 200 None 2026-04-18 18:14:13,751 - lava_callback - ERROR - Error processing callback for node 69e126e62eed175ae971b85c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:15:08,802 - lava_callback - INFO - Received callback for node 69e3c8e17f5347282fbdf14b INFO: 172.21.0.1:56706 - "POST /node/69e3c8e17f5347282fbdf14b HTTP/1.0" 202 Accepted 2026-04-18 18:15:08,810 - lava_callback - INFO - Starting async job submit for node 69e3c8e17f5347282fbdf14b 2026-04-18 18:15:08,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:15:08,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c8e17f5347282fbdf14b HTTP/1.1" 200 None 2026-04-18 18:15:08,860 - lava_callback - DEBUG - Processing node 69e3c8e17f5347282fbdf14b: baseline-arm64 2026-04-18 18:15:09,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:15:09,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:15:09,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c8e17f5347282fbdf14b/log.txt.gz 2026-04-18 18:15:09,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:15:09,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:15:09,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c8e17f5347282fbdf14b/lava-logs.yaml 2026-04-18 18:15:09,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:15:10,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:15:10,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3c8e17f5347282fbdf14b/lava_callback.json.gz DEBUG: Setup failed for 69e3c8e17f5347282fbdf14b. Transitting job node result: incomplete -> fail 2026-04-18 18:15:10,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:15:10,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c8e17f5347282fbdf14b HTTP/1.1" 200 None 2026-04-18 18:15:10,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:15:10,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:15:10,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:15:10,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c8e17f5347282fbdf14b HTTP/1.1" 200 None 2026-04-18 18:15:10,257 - lava_callback - INFO - Completed processing callback for node 69e3c8e17f5347282fbdf14b INFO: 172.21.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:15:23,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:15:23,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET /node/69936fe0cebe99dd8e068b80%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:16:03,568 - lava_callback - INFO - Received callback for node 69e3c57f7f5347282fbdefc6 INFO: 172.21.0.1:36226 - "POST /node/69e3c57f7f5347282fbdefc6 HTTP/1.0" 202 Accepted 2026-04-18 18:16:03,576 - lava_callback - INFO - Starting async job submit for node 69e3c57f7f5347282fbdefc6 2026-04-18 18:16:03,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:03,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c57f7f5347282fbdefc6 HTTP/1.1" 200 None 2026-04-18 18:16:03,642 - lava_callback - DEBUG - Processing node 69e3c57f7f5347282fbdefc6: baseline-nfs-arm64 2026-04-18 18:16:04,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:16:04,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:16:04,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c57f7f5347282fbdefc6/log.txt.gz 2026-04-18 18:16:05,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:16:05,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:16:05,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c57f7f5347282fbdefc6/lava-logs.yaml 2026-04-18 18:16:05,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:16:05,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:16:05,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c57f7f5347282fbdefc6/lava_callback.json.gz DEBUG: Setup failed for 69e3c57f7f5347282fbdefc6. Transitting job node result: incomplete -> fail 2026-04-18 18:16:05,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:05,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c57f7f5347282fbdefc6 HTTP/1.1" 200 None 2026-04-18 18:16:05,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:05,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:16:05,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:05,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c57f7f5347282fbdefc6 HTTP/1.1" 200 None 2026-04-18 18:16:05,779 - lava_callback - INFO - Completed processing callback for node 69e3c57f7f5347282fbdefc6 INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:16:23,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:23,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:16:53,749 - lava_callback - INFO - Received callback for node 69e127812eed175ae971b8c2 INFO: 172.21.0.1:54460 - "POST /node/69e127812eed175ae971b8c2 HTTP/1.0" 202 Accepted 2026-04-18 18:16:53,758 - lava_callback - INFO - Starting async job submit for node 69e127812eed175ae971b8c2 2026-04-18 18:16:53,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:53,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127812eed175ae971b8c2 HTTP/1.1" 200 None 2026-04-18 18:16:53,774 - lava_callback - DEBUG - Processing node 69e127812eed175ae971b8c2: baseline-arm64-clabbe 2026-04-18 18:16:53,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e127812eed175ae971b8c2 2026-04-18 18:16:53,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:53,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127812eed175ae971b8c2 HTTP/1.1" 200 None 2026-04-18 18:16:53,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:53,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:16:53,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:53,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e127812eed175ae971b8c2 HTTP/1.1" 200 None 2026-04-18 18:16:53,830 - lava_callback - ERROR - Error processing callback for node 69e127812eed175ae971b8c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:16:59,529 - lava_callback - INFO - Received callback for node 69e3ca347f5347282fbdf1d1 INFO: 172.21.0.1:54472 - "POST /node/69e3ca347f5347282fbdf1d1 HTTP/1.0" 202 Accepted 2026-04-18 18:16:59,535 - lava_callback - INFO - Starting async job submit for node 69e3ca347f5347282fbdf1d1 2026-04-18 18:16:59,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:16:59,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3ca347f5347282fbdf1d1 HTTP/1.1" 200 None 2026-04-18 18:16:59,586 - lava_callback - DEBUG - Processing node 69e3ca347f5347282fbdf1d1: baseline-arm64-kontron 2026-04-18 18:16:59,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:16:59,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:16:59,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3ca347f5347282fbdf1d1/log.txt.gz 2026-04-18 18:17:00,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:17:00,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:17:00,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3ca347f5347282fbdf1d1/lava-logs.yaml 2026-04-18 18:17:00,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:17:00,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:17:00,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e3ca347f5347282fbdf1d1/lava_callback.json.gz 2026-04-18 18:17:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:00,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3ca347f5347282fbdf1d1 HTTP/1.1" 200 None 2026-04-18 18:17:00,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:00,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:17:00,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:00,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3ca347f5347282fbdf1d1 HTTP/1.1" 200 None 2026-04-18 18:17:00,654 - lava_callback - INFO - Completed processing callback for node 69e3ca347f5347282fbdf1d1 INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:17:23,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:23,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:17:53,766 - lava_callback - INFO - Received callback for node 69e127ce2eed175ae971b8f0 INFO: 172.21.0.1:39684 - "POST /node/69e127ce2eed175ae971b8f0 HTTP/1.0" 202 Accepted 2026-04-18 18:17:53,771 - lava_callback - INFO - Starting async job submit for node 69e127ce2eed175ae971b8f0 2026-04-18 18:17:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:53,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127ce2eed175ae971b8f0 HTTP/1.1" 200 None 2026-04-18 18:17:53,787 - lava_callback - DEBUG - Processing node 69e127ce2eed175ae971b8f0: baseline-arm64-clabbe 2026-04-18 18:17:53,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e127ce2eed175ae971b8f0 2026-04-18 18:17:53,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:53,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127ce2eed175ae971b8f0 HTTP/1.1" 200 None 2026-04-18 18:17:53,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:53,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-18 18:17:53,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:17:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e127ce2eed175ae971b8f0 HTTP/1.1" 200 None 2026-04-18 18:17:53,837 - lava_callback - ERROR - Error processing callback for node 69e127ce2eed175ae971b8f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET /node/698fcb2976d4b6342e9d74d3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54464 - "GET /node/698ead24db401c547d571e56%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET /node/693f5c710d8ce4018da8ce61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47280 - "GET /node/69830fa5409235c29c0de767%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:21:28,129 - lava_callback - INFO - Received callback for node 69e3c7e57f5347282fbdf0c7 INFO: 172.21.0.1:52384 - "POST /node/69e3c7e57f5347282fbdf0c7 HTTP/1.0" 202 Accepted 2026-04-18 18:21:28,136 - lava_callback - INFO - Starting async job submit for node 69e3c7e57f5347282fbdf0c7 2026-04-18 18:21:28,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:21:28,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7e57f5347282fbdf0c7 HTTP/1.1" 200 None 2026-04-18 18:21:28,196 - lava_callback - DEBUG - Processing node 69e3c7e57f5347282fbdf0c7: baseline-x86 2026-04-18 18:21:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:21:29,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:21:29,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3c7e57f5347282fbdf0c7/log.txt.gz 2026-04-18 18:21:29,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:21:29,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:21:29,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3c7e57f5347282fbdf0c7/lava-logs.yaml 2026-04-18 18:21:29,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:21:30,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:21:30,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3c7e57f5347282fbdf0c7/lava_callback.json.gz DEBUG: Setup failed for 69e3c7e57f5347282fbdf0c7. Transitting job node result: incomplete -> fail 2026-04-18 18:21:30,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:21:30,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c7e57f5347282fbdf0c7 HTTP/1.1" 200 None 2026-04-18 18:21:30,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:21:30,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 18:21:30,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:21:30,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c7e57f5347282fbdf0c7 HTTP/1.1" 200 None 2026-04-18 18:21:30,373 - lava_callback - INFO - Completed processing callback for node 69e3c7e57f5347282fbdf0c7 INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:21:53,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:21:53,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET /node/693a233478d7681e6b491773%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:24:18,677 - lava_callback - INFO - Received callback for node 69e3c9d67f5347282fbdf1ab INFO: 172.21.0.1:53640 - "POST /node/69e3c9d67f5347282fbdf1ab HTTP/1.0" 202 Accepted 2026-04-18 18:24:18,685 - lava_callback - INFO - Starting async job submit for node 69e3c9d67f5347282fbdf1ab 2026-04-18 18:24:18,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:24:18,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c9d67f5347282fbdf1ab HTTP/1.1" 200 None 2026-04-18 18:24:18,743 - lava_callback - DEBUG - Processing node 69e3c9d67f5347282fbdf1ab: baseline-nfs-arm64 2026-04-18 18:24:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:24:19,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:24:19,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c9d67f5347282fbdf1ab/log.txt.gz 2026-04-18 18:24:19,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:24:19,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:24:19,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c9d67f5347282fbdf1ab/lava-logs.yaml 2026-04-18 18:24:20,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:24:20,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:24:20,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3c9d67f5347282fbdf1ab/lava_callback.json.gz 2026-04-18 18:24:20,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:24:20,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3c9d67f5347282fbdf1ab HTTP/1.1" 200 None 2026-04-18 18:24:20,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:24:20,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:24:20,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:24:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3c9d67f5347282fbdf1ab HTTP/1.1" 200 None 2026-04-18 18:24:20,263 - lava_callback - INFO - Completed processing callback for node 69e3c9d67f5347282fbdf1ab 2026-04-18 18:24:23,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:24:23,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:25:01,773 - lava_callback - INFO - Received callback for node 69e3cbb47f5347282fbdf274 INFO: 172.21.0.1:51244 - "POST /node/69e3cbb47f5347282fbdf274 HTTP/1.0" 202 Accepted 2026-04-18 18:25:01,779 - lava_callback - INFO - Starting async job submit for node 69e3cbb47f5347282fbdf274 2026-04-18 18:25:01,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:25:01,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cbb47f5347282fbdf274 HTTP/1.1" 200 None 2026-04-18 18:25:01,822 - lava_callback - DEBUG - Processing node 69e3cbb47f5347282fbdf274: baseline-arm64 2026-04-18 18:25:02,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:25:02,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:25:02,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cbb47f5347282fbdf274/log.txt.gz 2026-04-18 18:25:02,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:25:02,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:25:02,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cbb47f5347282fbdf274/lava-logs.yaml 2026-04-18 18:25:02,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:25:02,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:25:02,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cbb47f5347282fbdf274/lava_callback.json.gz 2026-04-18 18:25:02,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:25:02,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cbb47f5347282fbdf274 HTTP/1.1" 200 None 2026-04-18 18:25:02,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:25:02,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:25:02,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:25:02,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cbb47f5347282fbdf274 HTTP/1.1" 200 None 2026-04-18 18:25:03,055 - lava_callback - INFO - Completed processing callback for node 69e3cbb47f5347282fbdf274 INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:25:23,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:25:23,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET /node/698401cd969566dcb0d2b427%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53494 - "GET /node/695d1a2ff1251675e15ae54f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET /node/693ae713fee8383e92b65020%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:34:48,756 - lava_callback - INFO - Received callback for node 69e12bb82eed175ae971babb INFO: 172.21.0.1:40830 - "POST /node/69e12bb82eed175ae971babb HTTP/1.0" 202 Accepted 2026-04-18 18:34:48,762 - lava_callback - INFO - Starting async job submit for node 69e12bb82eed175ae971babb 2026-04-18 18:34:48,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:34:48,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12bb82eed175ae971babb HTTP/1.1" 200 None 2026-04-18 18:34:48,778 - lava_callback - DEBUG - Processing node 69e12bb82eed175ae971babb: baseline-arm-baylibre 2026-04-18 18:34:48,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12bb82eed175ae971babb 2026-04-18 18:34:48,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:34:48,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12bb82eed175ae971babb HTTP/1.1" 200 None 2026-04-18 18:34:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:34:48,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-18 18:34:48,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:34:48,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12bb82eed175ae971babb HTTP/1.1" 200 None 2026-04-18 18:34:48,828 - lava_callback - ERROR - Error processing callback for node 69e12bb82eed175ae971babb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:39:19,944 - lava_callback - INFO - Received callback for node 69e3cf7e7f5347282fbdf3b8 INFO: 172.21.0.1:52908 - "POST /node/69e3cf7e7f5347282fbdf3b8 HTTP/1.0" 202 Accepted 2026-04-18 18:39:19,950 - lava_callback - INFO - Starting async job submit for node 69e3cf7e7f5347282fbdf3b8 2026-04-18 18:39:19,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:39:19,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cf7e7f5347282fbdf3b8 HTTP/1.1" 200 None 2026-04-18 18:39:19,985 - lava_callback - DEBUG - Processing node 69e3cf7e7f5347282fbdf3b8: baseline-x86 2026-04-18 18:39:20,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:39:20,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:39:20,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e3cf7e7f5347282fbdf3b8/log.txt.gz 2026-04-18 18:39:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:39:20,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:39:20,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e3cf7e7f5347282fbdf3b8/lava-logs.yaml 2026-04-18 18:39:20,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:39:20,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:39:20,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e3cf7e7f5347282fbdf3b8/lava_callback.json.gz 2026-04-18 18:39:20,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:39:20,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cf7e7f5347282fbdf3b8 HTTP/1.1" 200 None 2026-04-18 18:39:20,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:39:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af1c7f5347282fbdbca3 HTTP/1.1" 200 None 2026-04-18 18:39:20,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:39:20,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cf7e7f5347282fbdf3b8 HTTP/1.1" 200 None 2026-04-18 18:39:20,850 - lava_callback - INFO - Completed processing callback for node 69e3cf7e7f5347282fbdf3b8 2026-04-18 18:39:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:39:23,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:40:28,726 - lava_callback - INFO - Received callback for node 69e3cc037f5347282fbdf295 INFO: 172.21.0.1:56142 - "POST /node/69e3cc037f5347282fbdf295 HTTP/1.0" 202 Accepted 2026-04-18 18:40:28,733 - lava_callback - INFO - Starting async job submit for node 69e3cc037f5347282fbdf295 2026-04-18 18:40:28,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:28,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cc037f5347282fbdf295 HTTP/1.1" 200 None 2026-04-18 18:40:28,830 - lava_callback - DEBUG - Processing node 69e3cc037f5347282fbdf295: baseline-arm 2026-04-18 18:40:29,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:29,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:40:29,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e3cc037f5347282fbdf295/log.txt.gz 2026-04-18 18:40:30,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:30,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:40:30,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e3cc037f5347282fbdf295/lava-logs.yaml 2026-04-18 18:40:30,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:30,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:40:30,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e3cc037f5347282fbdf295/lava_callback.json.gz DEBUG: Setup failed for 69e3cc037f5347282fbdf295. Transitting job node result: incomplete -> fail 2026-04-18 18:40:30,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:30,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cc037f5347282fbdf295 HTTP/1.1" 200 None 2026-04-18 18:40:30,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:30,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-18 18:40:30,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:30,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cc037f5347282fbdf295 HTTP/1.1" 200 None 2026-04-18 18:40:30,668 - lava_callback - INFO - Completed processing callback for node 69e3cc037f5347282fbdf295 INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:40:42,783 - lava_callback - INFO - Received callback for node 69e3cc017f5347282fbdf292 INFO: 172.21.0.1:41938 - "POST /node/69e3cc017f5347282fbdf292 HTTP/1.0" 202 Accepted 2026-04-18 18:40:42,789 - lava_callback - INFO - Starting async job submit for node 69e3cc017f5347282fbdf292 2026-04-18 18:40:42,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:42,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cc017f5347282fbdf292 HTTP/1.1" 200 None 2026-04-18 18:40:42,865 - lava_callback - DEBUG - Processing node 69e3cc017f5347282fbdf292: ltp-smoke 2026-04-18 18:40:43,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:43,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:40:43,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3cc017f5347282fbdf292/log.txt.gz 2026-04-18 18:40:43,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:43,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:40:43,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3cc017f5347282fbdf292/lava-logs.yaml 2026-04-18 18:40:43,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:40:44,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:40:44,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e3cc017f5347282fbdf292/lava_callback.json.gz 2026-04-18 18:40:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:44,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cc017f5347282fbdf292 HTTP/1.1" 200 None 2026-04-18 18:40:44,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af027f5347282fbdbc7e HTTP/1.1" 200 None 2026-04-18 18:40:44,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:44,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cc017f5347282fbdf292 HTTP/1.1" 200 None 2026-04-18 18:40:44,423 - lava_callback - INFO - Completed processing callback for node 69e3cc017f5347282fbdf292 INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:40:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:40:53,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50348 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:41:41,619 - lava_callback - INFO - Received callback for node 69e3cea57f5347282fbdf37c INFO: 172.21.0.1:50108 - "POST /node/69e3cea57f5347282fbdf37c HTTP/1.0" 202 Accepted 2026-04-18 18:41:41,626 - lava_callback - INFO - Starting async job submit for node 69e3cea57f5347282fbdf37c 2026-04-18 18:41:41,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:41,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cea57f5347282fbdf37c HTTP/1.1" 200 None 2026-04-18 18:41:41,677 - lava_callback - DEBUG - Processing node 69e3cea57f5347282fbdf37c: baseline-arm64 2026-04-18 18:41:42,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:41:42,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:41:42,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cea57f5347282fbdf37c/log.txt.gz 2026-04-18 18:41:42,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:41:42,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:41:42,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cea57f5347282fbdf37c/lava-logs.yaml 2026-04-18 18:41:42,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:41:42,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:41:42,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e3cea57f5347282fbdf37c/lava_callback.json.gz DEBUG: Setup failed for 69e3cea57f5347282fbdf37c. Transitting job node result: incomplete -> fail 2026-04-18 18:41:42,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:42,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cea57f5347282fbdf37c HTTP/1.1" 200 None 2026-04-18 18:41:42,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:42,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:41:42,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cea57f5347282fbdf37c HTTP/1.1" 200 None 2026-04-18 18:41:42,891 - lava_callback - INFO - Completed processing callback for node 69e3cea57f5347282fbdf37c INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:41:48,830 - lava_callback - INFO - Received callback for node 69e12d607cc280ca7299aafd INFO: 172.21.0.1:50120 - "POST /node/69e12d607cc280ca7299aafd HTTP/1.0" 202 Accepted 2026-04-18 18:41:48,835 - lava_callback - INFO - Starting async job submit for node 69e12d607cc280ca7299aafd 2026-04-18 18:41:48,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:48,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12d607cc280ca7299aafd HTTP/1.1" 200 None 2026-04-18 18:41:48,852 - lava_callback - DEBUG - Processing node 69e12d607cc280ca7299aafd: baseline-arm-baylibre 2026-04-18 18:41:48,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12d607cc280ca7299aafd 2026-04-18 18:41:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:48,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12d607cc280ca7299aafd HTTP/1.1" 200 None 2026-04-18 18:41:48,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:48,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:41:48,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:48,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12d607cc280ca7299aafd HTTP/1.1" 200 None 2026-04-18 18:41:48,909 - lava_callback - ERROR - Error processing callback for node 69e12d607cc280ca7299aafd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-18 18:41:53,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:41:53,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:42:48,839 - lava_callback - INFO - Received callback for node 69e12d9d7cc280ca7299ab0e INFO: 172.21.0.1:53382 - "POST /node/69e12d9d7cc280ca7299ab0e HTTP/1.0" 202 Accepted 2026-04-18 18:42:48,844 - lava_callback - INFO - Starting async job submit for node 69e12d9d7cc280ca7299ab0e 2026-04-18 18:42:48,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:42:48,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12d9d7cc280ca7299ab0e HTTP/1.1" 200 None 2026-04-18 18:42:48,860 - lava_callback - DEBUG - Processing node 69e12d9d7cc280ca7299ab0e: baseline-arm-baylibre 2026-04-18 18:42:48,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12d9d7cc280ca7299ab0e 2026-04-18 18:42:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:42:48,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12d9d7cc280ca7299ab0e HTTP/1.1" 200 None 2026-04-18 18:42:48,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:42:48,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:42:48,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:42:48,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12d9d7cc280ca7299ab0e HTTP/1.1" 200 None 2026-04-18 18:42:48,925 - lava_callback - ERROR - Error processing callback for node 69e12d9d7cc280ca7299ab0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:43:28,915 - lava_callback - INFO - Received callback for node 69e12dc37cc280ca7299ab1c INFO: 172.21.0.1:36544 - "POST /node/69e12dc37cc280ca7299ab1c HTTP/1.0" 202 Accepted 2026-04-18 18:43:28,921 - lava_callback - INFO - Starting async job submit for node 69e12dc37cc280ca7299ab1c 2026-04-18 18:43:28,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:43:28,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12dc37cc280ca7299ab1c HTTP/1.1" 200 None 2026-04-18 18:43:28,938 - lava_callback - DEBUG - Processing node 69e12dc37cc280ca7299ab1c: baseline-arm-baylibre 2026-04-18 18:43:28,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12dc37cc280ca7299ab1c 2026-04-18 18:43:28,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:43:28,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12dc37cc280ca7299ab1c HTTP/1.1" 200 None 2026-04-18 18:43:28,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:43:28,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:43:28,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:43:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12dc37cc280ca7299ab1c HTTP/1.1" 200 None 2026-04-18 18:43:28,988 - lava_callback - ERROR - Error processing callback for node 69e12dc37cc280ca7299ab1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:44:08,884 - lava_callback - INFO - Received callback for node 69e12dea7cc280ca7299ab2b INFO: 172.21.0.1:37622 - "POST /node/69e12dea7cc280ca7299ab2b HTTP/1.0" 202 Accepted 2026-04-18 18:44:08,892 - lava_callback - INFO - Starting async job submit for node 69e12dea7cc280ca7299ab2b 2026-04-18 18:44:08,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:44:08,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12dea7cc280ca7299ab2b HTTP/1.1" 200 None 2026-04-18 18:44:08,907 - lava_callback - DEBUG - Processing node 69e12dea7cc280ca7299ab2b: baseline-arm-baylibre 2026-04-18 18:44:08,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12dea7cc280ca7299ab2b 2026-04-18 18:44:08,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:44:08,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12dea7cc280ca7299ab2b HTTP/1.1" 200 None 2026-04-18 18:44:08,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:44:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:44:08,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:44:08,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12dea7cc280ca7299ab2b HTTP/1.1" 200 None 2026-04-18 18:44:08,960 - lava_callback - ERROR - Error processing callback for node 69e12dea7cc280ca7299ab2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:46:55,025 - lava_callback - INFO - Received callback for node 69e12e947cc280ca7299ab82 INFO: 172.21.0.1:54490 - "POST /node/69e12e947cc280ca7299ab82 HTTP/1.0" 202 Accepted 2026-04-18 18:46:55,032 - lava_callback - INFO - Starting async job submit for node 69e12e947cc280ca7299ab82 2026-04-18 18:46:55,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:46:55,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12e947cc280ca7299ab82 HTTP/1.1" 200 None 2026-04-18 18:46:55,050 - lava_callback - DEBUG - Processing node 69e12e947cc280ca7299ab82: baseline-arm-clabbe 2026-04-18 18:46:55,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12e947cc280ca7299ab82 2026-04-18 18:46:55,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:46:55,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12e947cc280ca7299ab82 HTTP/1.1" 200 None 2026-04-18 18:46:55,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:46:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:46:55,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:46:55,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12e947cc280ca7299ab82 HTTP/1.1" 200 None 2026-04-18 18:46:55,108 - lava_callback - ERROR - Error processing callback for node 69e12e947cc280ca7299ab82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:47:55,086 - lava_callback - INFO - Received callback for node 69e12ecf7cc280ca7299ab92 INFO: 172.21.0.1:52386 - "POST /node/69e12ecf7cc280ca7299ab92 HTTP/1.0" 202 Accepted 2026-04-18 18:47:55,091 - lava_callback - INFO - Starting async job submit for node 69e12ecf7cc280ca7299ab92 2026-04-18 18:47:55,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:47:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12ecf7cc280ca7299ab92 HTTP/1.1" 200 None 2026-04-18 18:47:55,107 - lava_callback - DEBUG - Processing node 69e12ecf7cc280ca7299ab92: baseline-arm-clabbe 2026-04-18 18:47:55,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12ecf7cc280ca7299ab92 2026-04-18 18:47:55,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:47:55,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12ecf7cc280ca7299ab92 HTTP/1.1" 200 None 2026-04-18 18:47:55,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:47:55,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:47:55,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:47:55,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12ecf7cc280ca7299ab92 HTTP/1.1" 200 None 2026-04-18 18:47:55,160 - lava_callback - ERROR - Error processing callback for node 69e12ecf7cc280ca7299ab92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:48:39,682 - lava_callback - INFO - Received callback for node 69e3cf8b7f5347282fbdf3c4 INFO: 172.21.0.1:55432 - "POST /node/69e3cf8b7f5347282fbdf3c4 HTTP/1.0" 202 Accepted 2026-04-18 18:48:39,689 - lava_callback - INFO - Starting async job submit for node 69e3cf8b7f5347282fbdf3c4 2026-04-18 18:48:39,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:39,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cf8b7f5347282fbdf3c4 HTTP/1.1" 200 None 2026-04-18 18:48:39,730 - lava_callback - DEBUG - Processing node 69e3cf8b7f5347282fbdf3c4: baseline-nfs-arm64 2026-04-18 18:48:40,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:48:40,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:48:40,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cf8b7f5347282fbdf3c4/log.txt.gz 2026-04-18 18:48:40,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:48:40,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:48:40,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cf8b7f5347282fbdf3c4/lava-logs.yaml 2026-04-18 18:48:40,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:48:41,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:48:41,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cf8b7f5347282fbdf3c4/lava_callback.json.gz 2026-04-18 18:48:41,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:41,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cf8b7f5347282fbdf3c4 HTTP/1.1" 200 None 2026-04-18 18:48:41,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:41,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:48:41,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:41,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cf8b7f5347282fbdf3c4 HTTP/1.1" 200 None 2026-04-18 18:48:41,206 - lava_callback - INFO - Completed processing callback for node 69e3cf8b7f5347282fbdf3c4 INFO: 172.21.0.1:51022 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:48:53,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:53,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-18 18:48:55,071 - lava_callback - INFO - Received callback for node 69e12f0b7cc280ca7299aba7 INFO: 172.21.0.1:41578 - "POST /node/69e12f0b7cc280ca7299aba7 HTTP/1.0" 202 Accepted 2026-04-18 18:48:55,076 - lava_callback - INFO - Starting async job submit for node 69e12f0b7cc280ca7299aba7 2026-04-18 18:48:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:55,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f0b7cc280ca7299aba7 HTTP/1.1" 200 None 2026-04-18 18:48:55,091 - lava_callback - DEBUG - Processing node 69e12f0b7cc280ca7299aba7: baseline-arm-clabbe 2026-04-18 18:48:55,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12f0b7cc280ca7299aba7 2026-04-18 18:48:55,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:55,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f0b7cc280ca7299aba7 HTTP/1.1" 200 None 2026-04-18 18:48:55,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:55,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:48:55,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:48:55,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12f0b7cc280ca7299aba7 HTTP/1.1" 200 None 2026-04-18 18:48:55,147 - lava_callback - ERROR - Error processing callback for node 69e12f0b7cc280ca7299aba7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:49:35,071 - lava_callback - INFO - Received callback for node 69e12f337cc280ca7299abb7 INFO: 172.21.0.1:49614 - "POST /node/69e12f337cc280ca7299abb7 HTTP/1.0" 202 Accepted 2026-04-18 18:49:35,077 - lava_callback - INFO - Starting async job submit for node 69e12f337cc280ca7299abb7 2026-04-18 18:49:35,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:49:35,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f337cc280ca7299abb7 HTTP/1.1" 200 None 2026-04-18 18:49:35,095 - lava_callback - DEBUG - Processing node 69e12f337cc280ca7299abb7: baseline-arm-clabbe 2026-04-18 18:49:35,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12f337cc280ca7299abb7 2026-04-18 18:49:35,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:49:35,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f337cc280ca7299abb7 HTTP/1.1" 200 None 2026-04-18 18:49:35,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:49:35,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:49:35,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:49:35,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12f337cc280ca7299abb7 HTTP/1.1" 200 None 2026-04-18 18:49:35,142 - lava_callback - ERROR - Error processing callback for node 69e12f337cc280ca7299abb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:50:55,159 - lava_callback - INFO - Received callback for node 69e12f837cc280ca7299abcf INFO: 172.21.0.1:50930 - "POST /node/69e12f837cc280ca7299abcf HTTP/1.0" 202 Accepted 2026-04-18 18:50:55,164 - lava_callback - INFO - Starting async job submit for node 69e12f837cc280ca7299abcf 2026-04-18 18:50:55,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:50:55,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f837cc280ca7299abcf HTTP/1.1" 200 None 2026-04-18 18:50:55,180 - lava_callback - DEBUG - Processing node 69e12f837cc280ca7299abcf: baseline-arm-clabbe 2026-04-18 18:50:55,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12f837cc280ca7299abcf 2026-04-18 18:50:55,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:50:55,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12f837cc280ca7299abcf HTTP/1.1" 200 None 2026-04-18 18:50:55,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:50:55,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:50:55,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:50:55,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12f837cc280ca7299abcf HTTP/1.1" 200 None 2026-04-18 18:50:55,233 - lava_callback - ERROR - Error processing callback for node 69e12f837cc280ca7299abcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50936 - "GET /node/69485afd9214b493871688a3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50938 - "GET /node/6985bc7871989fb14149755f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:51:35,143 - lava_callback - INFO - Received callback for node 69e12fac7cc280ca7299abde INFO: 172.21.0.1:41682 - "POST /node/69e12fac7cc280ca7299abde HTTP/1.0" 202 Accepted 2026-04-18 18:51:35,149 - lava_callback - INFO - Starting async job submit for node 69e12fac7cc280ca7299abde 2026-04-18 18:51:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:51:35,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12fac7cc280ca7299abde HTTP/1.1" 200 None 2026-04-18 18:51:35,165 - lava_callback - DEBUG - Processing node 69e12fac7cc280ca7299abde: baseline-arm-clabbe 2026-04-18 18:51:35,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12fac7cc280ca7299abde 2026-04-18 18:51:35,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:51:35,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12fac7cc280ca7299abde HTTP/1.1" 200 None 2026-04-18 18:51:35,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:51:35,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:51:35,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:51:35,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12fac7cc280ca7299abde HTTP/1.1" 200 None 2026-04-18 18:51:35,222 - lava_callback - ERROR - Error processing callback for node 69e12fac7cc280ca7299abde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 18:52:15,255 - lava_callback - INFO - Received callback for node 69e12fd47cc280ca7299abf2 INFO: 172.21.0.1:60152 - "POST /node/69e12fd47cc280ca7299abf2 HTTP/1.0" 202 Accepted 2026-04-18 18:52:15,261 - lava_callback - INFO - Starting async job submit for node 69e12fd47cc280ca7299abf2 2026-04-18 18:52:15,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:52:15,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12fd47cc280ca7299abf2 HTTP/1.1" 200 None 2026-04-18 18:52:15,317 - lava_callback - DEBUG - Processing node 69e12fd47cc280ca7299abf2: baseline-arm-clabbe 2026-04-18 18:52:15,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e12fd47cc280ca7299abf2 2026-04-18 18:52:15,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:52:15,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12fd47cc280ca7299abf2 HTTP/1.1" 200 None 2026-04-18 18:52:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:52:15,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:52:15,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:52:15,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12fd47cc280ca7299abf2 HTTP/1.1" 200 None 2026-04-18 18:52:15,415 - lava_callback - ERROR - Error processing callback for node 69e12fd47cc280ca7299abf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:53:00,133 - lava_callback - INFO - Received callback for node 69e3ce557f5347282fbdf35f INFO: 172.21.0.1:44246 - "POST /node/69e3ce557f5347282fbdf35f HTTP/1.0" 202 Accepted 2026-04-18 18:53:00,141 - lava_callback - INFO - Starting async job submit for node 69e3ce557f5347282fbdf35f 2026-04-18 18:53:00,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:00,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3ce557f5347282fbdf35f HTTP/1.1" 200 None 2026-04-18 18:53:00,198 - lava_callback - DEBUG - Processing node 69e3ce557f5347282fbdf35f: baseline-nfs-arm64 2026-04-18 18:53:01,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:53:01,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:53:01,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3ce557f5347282fbdf35f/log.txt.gz 2026-04-18 18:53:02,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:53:02,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:53:02,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3ce557f5347282fbdf35f/lava-logs.yaml 2026-04-18 18:53:02,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:53:02,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:53:02,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3ce557f5347282fbdf35f/lava_callback.json.gz DEBUG: Setup failed for 69e3ce557f5347282fbdf35f. Transitting job node result: incomplete -> fail 2026-04-18 18:53:02,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:02,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3ce557f5347282fbdf35f HTTP/1.1" 200 None 2026-04-18 18:53:02,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:02,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:53:02,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:02,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3ce557f5347282fbdf35f HTTP/1.1" 200 None 2026-04-18 18:53:02,956 - lava_callback - INFO - Completed processing callback for node 69e3ce557f5347282fbdf35f INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:53:23,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:23,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:53:55,254 - lava_callback - INFO - Received callback for node 69e130387cc280ca7299ac05 INFO: 172.21.0.1:48176 - "POST /node/69e130387cc280ca7299ac05 HTTP/1.0" 202 Accepted 2026-04-18 18:53:55,260 - lava_callback - INFO - Starting async job submit for node 69e130387cc280ca7299ac05 2026-04-18 18:53:55,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:55,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e130387cc280ca7299ac05 HTTP/1.1" 200 None 2026-04-18 18:53:55,276 - lava_callback - DEBUG - Processing node 69e130387cc280ca7299ac05: baseline-arm-clabbe 2026-04-18 18:53:55,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e130387cc280ca7299ac05 2026-04-18 18:53:55,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:55,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e130387cc280ca7299ac05 HTTP/1.1" 200 None 2026-04-18 18:53:55,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:55,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:53:55,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:53:55,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e130387cc280ca7299ac05 HTTP/1.1" 200 None 2026-04-18 18:53:55,335 - lava_callback - ERROR - Error processing callback for node 69e130387cc280ca7299ac05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET /node/698bda521e517752bab8b8ee%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:54:55,293 - lava_callback - INFO - Received callback for node 69e130747cc280ca7299ac17 INFO: 172.21.0.1:60098 - "POST /node/69e130747cc280ca7299ac17 HTTP/1.0" 202 Accepted 2026-04-18 18:54:55,299 - lava_callback - INFO - Starting async job submit for node 69e130747cc280ca7299ac17 2026-04-18 18:54:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:54:55,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e130747cc280ca7299ac17 HTTP/1.1" 200 None 2026-04-18 18:54:55,315 - lava_callback - DEBUG - Processing node 69e130747cc280ca7299ac17: baseline-arm-clabbe 2026-04-18 18:54:55,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e130747cc280ca7299ac17 2026-04-18 18:54:55,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:54:55,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e130747cc280ca7299ac17 HTTP/1.1" 200 None 2026-04-18 18:54:55,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:54:55,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-18 18:54:55,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:54:55,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e130747cc280ca7299ac17 HTTP/1.1" 200 None 2026-04-18 18:54:55,382 - lava_callback - ERROR - Error processing callback for node 69e130747cc280ca7299ac17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:55:45,148 - lava_callback - INFO - Received callback for node 69e3cef97f5347282fbdf39d INFO: 172.21.0.1:46110 - "POST /node/69e3cef97f5347282fbdf39d HTTP/1.0" 202 Accepted 2026-04-18 18:55:45,157 - lava_callback - INFO - Starting async job submit for node 69e3cef97f5347282fbdf39d 2026-04-18 18:55:45,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:55:45,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cef97f5347282fbdf39d HTTP/1.1" 200 None 2026-04-18 18:55:45,229 - lava_callback - DEBUG - Processing node 69e3cef97f5347282fbdf39d: baseline-nfs-arm64 2026-04-18 18:55:46,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:55:46,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:55:46,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cef97f5347282fbdf39d/log.txt.gz INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK 2026-04-18 18:55:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:55:47,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:55:47,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cef97f5347282fbdf39d/lava-logs.yaml 2026-04-18 18:55:47,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 18:55:47,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 18:55:47,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3cef97f5347282fbdf39d/lava_callback.json.gz DEBUG: Setup failed for 69e3cef97f5347282fbdf39d. Transitting job node result: incomplete -> fail 2026-04-18 18:55:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:55:47,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3cef97f5347282fbdf39d HTTP/1.1" 200 None 2026-04-18 18:55:47,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:55:47,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 18:55:47,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:55:47,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3cef97f5347282fbdf39d HTTP/1.1" 200 None 2026-04-18 18:55:47,497 - lava_callback - INFO - Completed processing callback for node 69e3cef97f5347282fbdf39d 2026-04-18 18:55:53,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 18:55:53,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET /node/6991f89c01ff1e8e0859da49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET /node/6985c4d271989fb1414980ae%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46640 - "GET /node/6929825d09677735f68aefaf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET /node/69864ed0177ca0f097bd3984%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53080 - "GET /node/693e3468407f32424eb5a67f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET /node/6985d90a71989fb14149a89e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48868 - "GET /node/69655f81cf87553b28022cf6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET /node/698b9ab30a16aea5a0dc9315%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:03:30,130 - lava_callback - INFO - Received callback for node 69e1327d7cc280ca7299d35e INFO: 172.21.0.1:38242 - "POST /node/69e1327d7cc280ca7299d35e HTTP/1.0" 202 Accepted 2026-04-18 19:03:30,136 - lava_callback - INFO - Starting async job submit for node 69e1327d7cc280ca7299d35e 2026-04-18 19:03:30,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:03:30,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1327d7cc280ca7299d35e HTTP/1.1" 200 None 2026-04-18 19:03:30,157 - lava_callback - DEBUG - Processing node 69e1327d7cc280ca7299d35e: baseline-arm64-baylibre 2026-04-18 19:03:30,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1327d7cc280ca7299d35e 2026-04-18 19:03:30,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:03:30,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1327d7cc280ca7299d35e HTTP/1.1" 200 None 2026-04-18 19:03:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:03:30,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:03:30,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:03:30,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1327d7cc280ca7299d35e HTTP/1.1" 200 None 2026-04-18 19:03:30,205 - lava_callback - ERROR - Error processing callback for node 69e1327d7cc280ca7299d35e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET /node/69840344969566dcb0d2b809%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55436 - "GET /node/6983e4d4969566dcb0d2960c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET /node/698b0f333b3beb19e7618402%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:04:50,126 - lava_callback - INFO - Received callback for node 69e132cc7cc280ca7299d382 INFO: 172.21.0.1:57918 - "POST /node/69e132cc7cc280ca7299d382 HTTP/1.0" 202 Accepted 2026-04-18 19:04:50,131 - lava_callback - INFO - Starting async job submit for node 69e132cc7cc280ca7299d382 2026-04-18 19:04:50,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:04:50,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e132cc7cc280ca7299d382 HTTP/1.1" 200 None 2026-04-18 19:04:50,147 - lava_callback - DEBUG - Processing node 69e132cc7cc280ca7299d382: baseline-arm64-baylibre 2026-04-18 19:04:50,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e132cc7cc280ca7299d382 2026-04-18 19:04:50,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:04:50,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e132cc7cc280ca7299d382 HTTP/1.1" 200 None 2026-04-18 19:04:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:04:50,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:04:50,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:04:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e132cc7cc280ca7299d382 HTTP/1.1" 200 None 2026-04-18 19:04:50,198 - lava_callback - ERROR - Error processing callback for node 69e132cc7cc280ca7299d382: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET /node/698622c4177ca0f097bd1bd8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:06:10,203 - lava_callback - INFO - Received callback for node 69e1331f7cc280ca7299d3a9 INFO: 172.21.0.1:59750 - "POST /node/69e1331f7cc280ca7299d3a9 HTTP/1.0" 202 Accepted 2026-04-18 19:06:10,208 - lava_callback - INFO - Starting async job submit for node 69e1331f7cc280ca7299d3a9 2026-04-18 19:06:10,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:06:10,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1331f7cc280ca7299d3a9 HTTP/1.1" 200 None 2026-04-18 19:06:10,231 - lava_callback - DEBUG - Processing node 69e1331f7cc280ca7299d3a9: baseline-arm64-baylibre 2026-04-18 19:06:10,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1331f7cc280ca7299d3a9 2026-04-18 19:06:10,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:06:10,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1331f7cc280ca7299d3a9 HTTP/1.1" 200 None 2026-04-18 19:06:10,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:06:10,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:06:10,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:06:10,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1331f7cc280ca7299d3a9 HTTP/1.1" 200 None 2026-04-18 19:06:10,284 - lava_callback - ERROR - Error processing callback for node 69e1331f7cc280ca7299d3a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:07:30,232 - lava_callback - INFO - Received callback for node 69e1336d7cc280ca7299d3cd INFO: 172.21.0.1:39132 - "POST /node/69e1336d7cc280ca7299d3cd HTTP/1.0" 202 Accepted 2026-04-18 19:07:30,238 - lava_callback - INFO - Starting async job submit for node 69e1336d7cc280ca7299d3cd 2026-04-18 19:07:30,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:07:30,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1336d7cc280ca7299d3cd HTTP/1.1" 200 None 2026-04-18 19:07:30,259 - lava_callback - DEBUG - Processing node 69e1336d7cc280ca7299d3cd: baseline-arm64-baylibre 2026-04-18 19:07:30,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1336d7cc280ca7299d3cd 2026-04-18 19:07:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:07:30,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1336d7cc280ca7299d3cd HTTP/1.1" 200 None 2026-04-18 19:07:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:07:30,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:07:30,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:07:30,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1336d7cc280ca7299d3cd HTTP/1.1" 200 None 2026-04-18 19:07:30,329 - lava_callback - ERROR - Error processing callback for node 69e1336d7cc280ca7299d3cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET /node/6984919b3a8748f282087af7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:08:50,304 - lava_callback - INFO - Received callback for node 69e133bb7cc280ca7299d3f4 INFO: 172.21.0.1:53276 - "POST /node/69e133bb7cc280ca7299d3f4 HTTP/1.0" 202 Accepted 2026-04-18 19:08:50,309 - lava_callback - INFO - Starting async job submit for node 69e133bb7cc280ca7299d3f4 2026-04-18 19:08:50,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:08:50,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e133bb7cc280ca7299d3f4 HTTP/1.1" 200 None 2026-04-18 19:08:50,328 - lava_callback - DEBUG - Processing node 69e133bb7cc280ca7299d3f4: baseline-arm64-baylibre 2026-04-18 19:08:50,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e133bb7cc280ca7299d3f4 2026-04-18 19:08:50,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:08:50,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e133bb7cc280ca7299d3f4 HTTP/1.1" 200 None 2026-04-18 19:08:50,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:08:50,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:08:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:08:50,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e133bb7cc280ca7299d3f4 HTTP/1.1" 200 None 2026-04-18 19:08:50,381 - lava_callback - ERROR - Error processing callback for node 69e133bb7cc280ca7299d3f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:10:10,381 - lava_callback - INFO - Received callback for node 69e134097cc280ca7299d418 INFO: 172.21.0.1:43360 - "POST /node/69e134097cc280ca7299d418 HTTP/1.0" 202 Accepted 2026-04-18 19:10:10,386 - lava_callback - INFO - Starting async job submit for node 69e134097cc280ca7299d418 2026-04-18 19:10:10,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:10:10,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134097cc280ca7299d418 HTTP/1.1" 200 None 2026-04-18 19:10:10,402 - lava_callback - DEBUG - Processing node 69e134097cc280ca7299d418: baseline-arm64-baylibre 2026-04-18 19:10:10,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e134097cc280ca7299d418 2026-04-18 19:10:10,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:10:10,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134097cc280ca7299d418 HTTP/1.1" 200 None 2026-04-18 19:10:10,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:10:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:10:10,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:10:10,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e134097cc280ca7299d418 HTTP/1.1" 200 None 2026-04-18 19:10:10,462 - lava_callback - ERROR - Error processing callback for node 69e134097cc280ca7299d418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET /node/698fc5d276d4b6342e9d7174%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET /node/698ee484f0e3ffbba67d20a3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:11:35,998 - lava_callback - INFO - Received callback for node 69e1345d7cc280ca7299d440 INFO: 172.21.0.1:38974 - "POST /node/69e1345d7cc280ca7299d440 HTTP/1.0" 202 Accepted 2026-04-18 19:11:36,004 - lava_callback - INFO - Starting async job submit for node 69e1345d7cc280ca7299d440 2026-04-18 19:11:36,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:11:36,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1345d7cc280ca7299d440 HTTP/1.1" 200 None 2026-04-18 19:11:36,028 - lava_callback - DEBUG - Processing node 69e1345d7cc280ca7299d440: baseline-arm64-clabbe 2026-04-18 19:11:36,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1345d7cc280ca7299d440 2026-04-18 19:11:36,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:11:36,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1345d7cc280ca7299d440 HTTP/1.1" 200 None 2026-04-18 19:11:36,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:11:36,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:11:36,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:11:36,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1345d7cc280ca7299d440 HTTP/1.1" 200 None 2026-04-18 19:11:36,103 - lava_callback - ERROR - Error processing callback for node 69e1345d7cc280ca7299d440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:12:56,046 - lava_callback - INFO - Received callback for node 69e134ac7cc280ca7299d46f INFO: 172.21.0.1:41196 - "POST /node/69e134ac7cc280ca7299d46f HTTP/1.0" 202 Accepted 2026-04-18 19:12:56,052 - lava_callback - INFO - Starting async job submit for node 69e134ac7cc280ca7299d46f 2026-04-18 19:12:56,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:12:56,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134ac7cc280ca7299d46f HTTP/1.1" 200 None 2026-04-18 19:12:56,068 - lava_callback - DEBUG - Processing node 69e134ac7cc280ca7299d46f: baseline-arm64-clabbe 2026-04-18 19:12:56,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e134ac7cc280ca7299d46f 2026-04-18 19:12:56,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:12:56,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134ac7cc280ca7299d46f HTTP/1.1" 200 None 2026-04-18 19:12:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:12:56,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:12:56,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:12:56,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e134ac7cc280ca7299d46f HTTP/1.1" 200 None 2026-04-18 19:12:56,140 - lava_callback - ERROR - Error processing callback for node 69e134ac7cc280ca7299d46f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 19:13:15,884 - lava_callback - INFO - Received callback for node 69e3d3177f5347282fbdf45c INFO: 172.21.0.1:53936 - "POST /node/69e3d3177f5347282fbdf45c HTTP/1.0" 202 Accepted 2026-04-18 19:13:15,892 - lava_callback - INFO - Starting async job submit for node 69e3d3177f5347282fbdf45c 2026-04-18 19:13:15,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:13:15,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3d3177f5347282fbdf45c HTTP/1.1" 200 None 2026-04-18 19:13:15,950 - lava_callback - DEBUG - Processing node 69e3d3177f5347282fbdf45c: baseline-nfs-arm64 INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:13:17,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:13:17,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:13:17,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3177f5347282fbdf45c/log.txt.gz 2026-04-18 19:13:17,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:13:18,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:13:18,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3177f5347282fbdf45c/lava-logs.yaml 2026-04-18 19:13:18,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:13:18,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:13:18,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3177f5347282fbdf45c/lava_callback.json.gz DEBUG: Setup failed for 69e3d3177f5347282fbdf45c. Transitting job node result: incomplete -> fail 2026-04-18 19:13:18,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:13:18,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3d3177f5347282fbdf45c HTTP/1.1" 200 None 2026-04-18 19:13:18,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:13:18,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 19:13:18,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:13:18,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3d3177f5347282fbdf45c HTTP/1.1" 200 None 2026-04-18 19:13:18,550 - lava_callback - INFO - Completed processing callback for node 69e3d3177f5347282fbdf45c 2026-04-18 19:13:23,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:13:23,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET /node/69d9294757c4e70f68e6c9df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 19:14:16,104 - lava_callback - INFO - Received callback for node 69e134f87cc280ca7299d499 INFO: 172.21.0.1:33462 - "POST /node/69e134f87cc280ca7299d499 HTTP/1.0" 202 Accepted 2026-04-18 19:14:16,110 - lava_callback - INFO - Starting async job submit for node 69e134f87cc280ca7299d499 2026-04-18 19:14:16,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:14:16,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134f87cc280ca7299d499 HTTP/1.1" 200 None 2026-04-18 19:14:16,127 - lava_callback - DEBUG - Processing node 69e134f87cc280ca7299d499: baseline-arm64-clabbe 2026-04-18 19:14:16,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e134f87cc280ca7299d499 2026-04-18 19:14:16,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:14:16,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e134f87cc280ca7299d499 HTTP/1.1" 200 None 2026-04-18 19:14:16,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:14:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:14:16,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:14:16,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e134f87cc280ca7299d499 HTTP/1.1" 200 None 2026-04-18 19:14:16,181 - lava_callback - ERROR - Error processing callback for node 69e134f87cc280ca7299d499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:15:36,193 - lava_callback - INFO - Received callback for node 69e135427cc280ca7299d4c9 INFO: 172.21.0.1:58748 - "POST /node/69e135427cc280ca7299d4c9 HTTP/1.0" 202 Accepted 2026-04-18 19:15:36,199 - lava_callback - INFO - Starting async job submit for node 69e135427cc280ca7299d4c9 2026-04-18 19:15:36,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:15:36,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135427cc280ca7299d4c9 HTTP/1.1" 200 None 2026-04-18 19:15:36,215 - lava_callback - DEBUG - Processing node 69e135427cc280ca7299d4c9: baseline-arm64-clabbe 2026-04-18 19:15:36,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e135427cc280ca7299d4c9 2026-04-18 19:15:36,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:15:36,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135427cc280ca7299d4c9 HTTP/1.1" 200 None 2026-04-18 19:15:36,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:15:36,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:15:36,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:15:36,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e135427cc280ca7299d4c9 HTTP/1.1" 200 None 2026-04-18 19:15:36,276 - lava_callback - ERROR - Error processing callback for node 69e135427cc280ca7299d4c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:16:01,280 - lava_callback - INFO - Received callback for node 69e3d3be7f5347282fbdf48d INFO: 172.21.0.1:37008 - "POST /node/69e3d3be7f5347282fbdf48d HTTP/1.0" 202 Accepted 2026-04-18 19:16:01,288 - lava_callback - INFO - Starting async job submit for node 69e3d3be7f5347282fbdf48d 2026-04-18 19:16:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:16:01,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3d3be7f5347282fbdf48d HTTP/1.1" 200 None 2026-04-18 19:16:01,344 - lava_callback - DEBUG - Processing node 69e3d3be7f5347282fbdf48d: baseline-nfs-arm64 2026-04-18 19:16:02,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:16:02,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:16:02,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3be7f5347282fbdf48d/log.txt.gz 2026-04-18 19:16:03,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:16:03,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:16:03,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3be7f5347282fbdf48d/lava-logs.yaml 2026-04-18 19:16:03,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:16:03,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:16:03,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e3d3be7f5347282fbdf48d/lava_callback.json.gz DEBUG: Setup failed for 69e3d3be7f5347282fbdf48d. Transitting job node result: incomplete -> fail 2026-04-18 19:16:03,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:16:03,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3d3be7f5347282fbdf48d HTTP/1.1" 200 None 2026-04-18 19:16:03,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:16:03,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 19:16:03,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:16:03,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3d3be7f5347282fbdf48d HTTP/1.1" 200 None 2026-04-18 19:16:03,898 - lava_callback - INFO - Completed processing callback for node 69e3d3be7f5347282fbdf48d INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:16:23,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:16:23,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 19:17:16,285 - lava_callback - INFO - Received callback for node 69e135ab7cc280ca7299d4f8 INFO: 172.21.0.1:46956 - "POST /node/69e135ab7cc280ca7299d4f8 HTTP/1.0" 202 Accepted 2026-04-18 19:17:16,292 - lava_callback - INFO - Starting async job submit for node 69e135ab7cc280ca7299d4f8 2026-04-18 19:17:16,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:17:16,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135ab7cc280ca7299d4f8 HTTP/1.1" 200 None 2026-04-18 19:17:16,308 - lava_callback - DEBUG - Processing node 69e135ab7cc280ca7299d4f8: baseline-arm64-clabbe 2026-04-18 19:17:16,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e135ab7cc280ca7299d4f8 2026-04-18 19:17:16,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:17:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135ab7cc280ca7299d4f8 HTTP/1.1" 200 None 2026-04-18 19:17:16,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:17:16,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:17:16,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:17:16,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e135ab7cc280ca7299d4f8 HTTP/1.1" 200 None 2026-04-18 19:17:16,372 - lava_callback - ERROR - Error processing callback for node 69e135ab7cc280ca7299d4f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-18 19:18:16,288 - lava_callback - INFO - Received callback for node 69e135f57cc280ca7299d531 INFO: 172.21.0.1:59408 - "POST /node/69e135f57cc280ca7299d531 HTTP/1.0" 202 Accepted 2026-04-18 19:18:16,294 - lava_callback - INFO - Starting async job submit for node 69e135f57cc280ca7299d531 2026-04-18 19:18:16,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:18:16,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135f57cc280ca7299d531 HTTP/1.1" 200 None 2026-04-18 19:18:16,310 - lava_callback - DEBUG - Processing node 69e135f57cc280ca7299d531: baseline-arm64-clabbe 2026-04-18 19:18:16,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e135f57cc280ca7299d531 2026-04-18 19:18:16,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:18:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e135f57cc280ca7299d531 HTTP/1.1" 200 None 2026-04-18 19:18:16,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:18:16,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:18:16,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:18:16,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e135f57cc280ca7299d531 HTTP/1.1" 200 None 2026-04-18 19:18:16,371 - lava_callback - ERROR - Error processing callback for node 69e135f57cc280ca7299d531: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET /node/69936c26cebe99dd8e067781%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:19:36,336 - lava_callback - INFO - Received callback for node 69e136417cc280ca7299d559 INFO: 172.21.0.1:60922 - "POST /node/69e136417cc280ca7299d559 HTTP/1.0" 202 Accepted 2026-04-18 19:19:36,342 - lava_callback - INFO - Starting async job submit for node 69e136417cc280ca7299d559 2026-04-18 19:19:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:19:36,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e136417cc280ca7299d559 HTTP/1.1" 200 None 2026-04-18 19:19:36,358 - lava_callback - DEBUG - Processing node 69e136417cc280ca7299d559: baseline-arm64-clabbe 2026-04-18 19:19:36,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e136417cc280ca7299d559 2026-04-18 19:19:36,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:19:36,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e136417cc280ca7299d559 HTTP/1.1" 200 None 2026-04-18 19:19:36,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:19:36,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-18 19:19:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:19:36,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e136417cc280ca7299d559 HTTP/1.1" 200 None 2026-04-18 19:19:36,428 - lava_callback - ERROR - Error processing callback for node 69e136417cc280ca7299d559: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:45:12,343 - lava_callback - INFO - Received callback for node 69e13c367cc280ca7299d675 INFO: 172.21.0.1:33354 - "POST /node/69e13c367cc280ca7299d675 HTTP/1.0" 202 Accepted 2026-04-18 19:45:12,349 - lava_callback - INFO - Starting async job submit for node 69e13c367cc280ca7299d675 2026-04-18 19:45:12,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:45:12,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13c367cc280ca7299d675 HTTP/1.1" 200 None 2026-04-18 19:45:12,365 - lava_callback - DEBUG - Processing node 69e13c367cc280ca7299d675: baseline-arm64-baylibre 2026-04-18 19:45:12,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13c367cc280ca7299d675 2026-04-18 19:45:12,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:45:12,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13c367cc280ca7299d675 HTTP/1.1" 200 None 2026-04-18 19:45:12,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:45:12,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:45:12,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:45:12,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13c367cc280ca7299d675 HTTP/1.1" 200 None 2026-04-18 19:45:12,412 - lava_callback - ERROR - Error processing callback for node 69e13c367cc280ca7299d675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:46:12,340 - lava_callback - INFO - Received callback for node 69e13c817cc280ca7299d6a8 INFO: 172.21.0.1:48766 - "POST /node/69e13c817cc280ca7299d6a8 HTTP/1.0" 202 Accepted 2026-04-18 19:46:12,345 - lava_callback - INFO - Starting async job submit for node 69e13c817cc280ca7299d6a8 2026-04-18 19:46:12,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:46:12,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13c817cc280ca7299d6a8 HTTP/1.1" 200 None 2026-04-18 19:46:12,367 - lava_callback - DEBUG - Processing node 69e13c817cc280ca7299d6a8: baseline-arm64-baylibre 2026-04-18 19:46:12,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13c817cc280ca7299d6a8 2026-04-18 19:46:12,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:46:12,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13c817cc280ca7299d6a8 HTTP/1.1" 200 None 2026-04-18 19:46:12,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:46:12,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:46:12,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:46:12,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13c817cc280ca7299d6a8 HTTP/1.1" 200 None 2026-04-18 19:46:12,420 - lava_callback - ERROR - Error processing callback for node 69e13c817cc280ca7299d6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:47:32,468 - lava_callback - INFO - Received callback for node 69e13ccb7cc280ca7299d6d3 INFO: 172.21.0.1:39016 - "POST /node/69e13ccb7cc280ca7299d6d3 HTTP/1.0" 202 Accepted 2026-04-18 19:47:32,473 - lava_callback - INFO - Starting async job submit for node 69e13ccb7cc280ca7299d6d3 2026-04-18 19:47:32,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:47:32,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13ccb7cc280ca7299d6d3 HTTP/1.1" 200 None 2026-04-18 19:47:32,491 - lava_callback - DEBUG - Processing node 69e13ccb7cc280ca7299d6d3: baseline-arm64-baylibre 2026-04-18 19:47:32,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13ccb7cc280ca7299d6d3 2026-04-18 19:47:32,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:47:32,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13ccb7cc280ca7299d6d3 HTTP/1.1" 200 None 2026-04-18 19:47:32,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:47:32,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:47:32,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:47:32,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13ccb7cc280ca7299d6d3 HTTP/1.1" 200 None 2026-04-18 19:47:32,543 - lava_callback - ERROR - Error processing callback for node 69e13ccb7cc280ca7299d6d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:49:12,564 - lava_callback - INFO - Received callback for node 69e13d287cc280ca7299d702 INFO: 172.21.0.1:51926 - "POST /node/69e13d287cc280ca7299d702 HTTP/1.0" 202 Accepted 2026-04-18 19:49:12,570 - lava_callback - INFO - Starting async job submit for node 69e13d287cc280ca7299d702 2026-04-18 19:49:12,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:12,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13d287cc280ca7299d702 HTTP/1.1" 200 None 2026-04-18 19:49:12,586 - lava_callback - DEBUG - Processing node 69e13d287cc280ca7299d702: baseline-arm64-baylibre 2026-04-18 19:49:12,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13d287cc280ca7299d702 2026-04-18 19:49:12,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:12,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13d287cc280ca7299d702 HTTP/1.1" 200 None 2026-04-18 19:49:12,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:12,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:49:12,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:12,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13d287cc280ca7299d702 HTTP/1.1" 200 None 2026-04-18 19:49:12,632 - lava_callback - ERROR - Error processing callback for node 69e13d287cc280ca7299d702: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:49:23,354 - lava_callback - INFO - Received callback for node 69e353893745d1193f228379 INFO: 172.21.0.1:39018 - "POST /node/69e353893745d1193f228379 HTTP/1.0" 202 Accepted 2026-04-18 19:49:23,360 - lava_callback - INFO - Starting async job submit for node 69e353893745d1193f228379 2026-04-18 19:49:23,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:23,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e353893745d1193f228379 HTTP/1.1" 200 None 2026-04-18 19:49:23,425 - lava_callback - DEBUG - Processing node 69e353893745d1193f228379: baseline-arm64-broonie 2026-04-18 19:49:23,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:49:23,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:49:23,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e353893745d1193f228379/log.txt.gz 2026-04-18 19:49:23,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:49:24,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:49:24,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e353893745d1193f228379/lava-logs.yaml 2026-04-18 19:49:24,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:49:24,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:49:24,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e353893745d1193f228379/lava_callback.json.gz 2026-04-18 19:49:24,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:24,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e353893745d1193f228379 HTTP/1.1" 200 None 2026-04-18 19:49:24,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:24,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-18 19:49:24,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:24,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e353893745d1193f228379 HTTP/1.1" 200 None 2026-04-18 19:49:24,326 - lava_callback - INFO - Completed processing callback for node 69e353893745d1193f228379 INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:49:53,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:49:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:50:32,591 - lava_callback - INFO - Received callback for node 69e13d767cc280ca7299d734 INFO: 172.21.0.1:50386 - "POST /node/69e13d767cc280ca7299d734 HTTP/1.0" 202 Accepted 2026-04-18 19:50:32,597 - lava_callback - INFO - Starting async job submit for node 69e13d767cc280ca7299d734 2026-04-18 19:50:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:50:32,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13d767cc280ca7299d734 HTTP/1.1" 200 None 2026-04-18 19:50:32,613 - lava_callback - DEBUG - Processing node 69e13d767cc280ca7299d734: baseline-arm64-baylibre 2026-04-18 19:50:32,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13d767cc280ca7299d734 2026-04-18 19:50:32,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:50:32,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13d767cc280ca7299d734 HTTP/1.1" 200 None 2026-04-18 19:50:32,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:50:32,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:50:32,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:50:32,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13d767cc280ca7299d734 HTTP/1.1" 200 None 2026-04-18 19:50:32,665 - lava_callback - ERROR - Error processing callback for node 69e13d767cc280ca7299d734: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:51:32,624 - lava_callback - INFO - Received callback for node 69e13dc07cc280ca7299d760 INFO: 172.21.0.1:48958 - "POST /node/69e13dc07cc280ca7299d760 HTTP/1.0" 202 Accepted 2026-04-18 19:51:32,630 - lava_callback - INFO - Starting async job submit for node 69e13dc07cc280ca7299d760 2026-04-18 19:51:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:51:32,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13dc07cc280ca7299d760 HTTP/1.1" 200 None 2026-04-18 19:51:32,649 - lava_callback - DEBUG - Processing node 69e13dc07cc280ca7299d760: baseline-arm64-baylibre 2026-04-18 19:51:32,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13dc07cc280ca7299d760 2026-04-18 19:51:32,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:51:32,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13dc07cc280ca7299d760 HTTP/1.1" 200 None 2026-04-18 19:51:32,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:51:32,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:51:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:51:32,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13dc07cc280ca7299d760 HTTP/1.1" 200 None 2026-04-18 19:51:32,695 - lava_callback - ERROR - Error processing callback for node 69e13dc07cc280ca7299d760: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:53:17,734 - lava_callback - INFO - Received callback for node 69e13e207cc280ca7299d790 INFO: 172.21.0.1:49002 - "POST /node/69e13e207cc280ca7299d790 HTTP/1.0" 202 Accepted 2026-04-18 19:53:17,742 - lava_callback - INFO - Starting async job submit for node 69e13e207cc280ca7299d790 2026-04-18 19:53:17,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:53:17,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13e207cc280ca7299d790 HTTP/1.1" 200 None 2026-04-18 19:53:17,757 - lava_callback - DEBUG - Processing node 69e13e207cc280ca7299d790: baseline-arm64-clabbe 2026-04-18 19:53:17,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13e207cc280ca7299d790 2026-04-18 19:53:17,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:53:17,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13e207cc280ca7299d790 HTTP/1.1" 200 None 2026-04-18 19:53:17,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:53:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:53:17,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:53:17,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13e207cc280ca7299d790 HTTP/1.1" 200 None 2026-04-18 19:53:17,812 - lava_callback - ERROR - Error processing callback for node 69e13e207cc280ca7299d790: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:54:37,776 - lava_callback - INFO - Received callback for node 69e13e6b7cc280ca7299d7c1 INFO: 172.21.0.1:55456 - "POST /node/69e13e6b7cc280ca7299d7c1 HTTP/1.0" 202 Accepted 2026-04-18 19:54:37,782 - lava_callback - INFO - Starting async job submit for node 69e13e6b7cc280ca7299d7c1 2026-04-18 19:54:37,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:54:37,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13e6b7cc280ca7299d7c1 HTTP/1.1" 200 None 2026-04-18 19:54:37,806 - lava_callback - DEBUG - Processing node 69e13e6b7cc280ca7299d7c1: baseline-arm64-clabbe 2026-04-18 19:54:37,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13e6b7cc280ca7299d7c1 2026-04-18 19:54:37,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:54:37,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13e6b7cc280ca7299d7c1 HTTP/1.1" 200 None 2026-04-18 19:54:37,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:54:37,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:54:37,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:54:37,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13e6b7cc280ca7299d7c1 HTTP/1.1" 200 None 2026-04-18 19:54:37,870 - lava_callback - ERROR - Error processing callback for node 69e13e6b7cc280ca7299d7c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:55:43,730 - lava_callback - INFO - Received callback for node 69e3a82a3745d1193f229649 INFO: 172.21.0.1:36838 - "POST /node/69e3a82a3745d1193f229649 HTTP/1.0" 202 Accepted 2026-04-18 19:55:43,737 - lava_callback - INFO - Starting async job submit for node 69e3a82a3745d1193f229649 2026-04-18 19:55:43,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:55:43,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3a82a3745d1193f229649 HTTP/1.1" 200 None 2026-04-18 19:55:43,805 - lava_callback - DEBUG - Processing node 69e3a82a3745d1193f229649: baseline-arm64-broonie 2026-04-18 19:55:44,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:55:44,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:55:44,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3a82a3745d1193f229649/log.txt.gz 2026-04-18 19:55:44,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:55:44,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:55:44,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3a82a3745d1193f229649/lava-logs.yaml 2026-04-18 19:55:44,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:55:45,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:55:45,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3a82a3745d1193f229649/lava_callback.json.gz 2026-04-18 19:55:45,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:55:45,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3a82a3745d1193f229649 HTTP/1.1" 200 None 2026-04-18 19:55:45,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:55:45,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-18 19:55:45,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:55:45,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3a82a3745d1193f229649 HTTP/1.1" 200 None 2026-04-18 19:55:45,261 - lava_callback - INFO - Completed processing callback for node 69e3a82a3745d1193f229649 INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:55:53,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:55:53,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:56:17,890 - lava_callback - INFO - Received callback for node 69e13ed37cc280ca7299d7ee INFO: 172.21.0.1:53862 - "POST /node/69e13ed37cc280ca7299d7ee HTTP/1.0" 202 Accepted 2026-04-18 19:56:17,895 - lava_callback - INFO - Starting async job submit for node 69e13ed37cc280ca7299d7ee 2026-04-18 19:56:17,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:56:17,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13ed37cc280ca7299d7ee HTTP/1.1" 200 None 2026-04-18 19:56:17,912 - lava_callback - DEBUG - Processing node 69e13ed37cc280ca7299d7ee: baseline-arm64-clabbe 2026-04-18 19:56:17,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13ed37cc280ca7299d7ee 2026-04-18 19:56:17,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:56:17,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13ed37cc280ca7299d7ee HTTP/1.1" 200 None 2026-04-18 19:56:17,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:56:17,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:56:17,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:56:17,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13ed37cc280ca7299d7ee HTTP/1.1" 200 None 2026-04-18 19:56:17,960 - lava_callback - ERROR - Error processing callback for node 69e13ed37cc280ca7299d7ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:57:23,764 - lava_callback - INFO - Received callback for node 69e3bcc27f5347282fbdea73 INFO: 172.21.0.1:44162 - "POST /node/69e3bcc27f5347282fbdea73 HTTP/1.0" 202 Accepted 2026-04-18 19:57:23,770 - lava_callback - INFO - Starting async job submit for node 69e3bcc27f5347282fbdea73 2026-04-18 19:57:23,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:23,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc27f5347282fbdea73 HTTP/1.1" 200 None 2026-04-18 19:57:23,829 - lava_callback - DEBUG - Processing node 69e3bcc27f5347282fbdea73: baseline-arm64-broonie 2026-04-18 19:57:24,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:57:24,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:57:24,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc27f5347282fbdea73/log.txt.gz 2026-04-18 19:57:24,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:57:24,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:57:24,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc27f5347282fbdea73/lava-logs.yaml 2026-04-18 19:57:24,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-18 19:57:24,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-18 19:57:24,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e3bcc27f5347282fbdea73/lava_callback.json.gz 2026-04-18 19:57:24,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:24,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3bcc27f5347282fbdea73 HTTP/1.1" 200 None 2026-04-18 19:57:24,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:24,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-18 19:57:24,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:24,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e3bcc27f5347282fbdea73 HTTP/1.1" 200 None 2026-04-18 19:57:25,045 - lava_callback - INFO - Completed processing callback for node 69e3bcc27f5347282fbdea73 INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:57:37,928 - lava_callback - INFO - Received callback for node 69e13f1d7cc280ca7299d81f INFO: 172.21.0.1:47170 - "POST /node/69e13f1d7cc280ca7299d81f HTTP/1.0" 202 Accepted 2026-04-18 19:57:37,934 - lava_callback - INFO - Starting async job submit for node 69e13f1d7cc280ca7299d81f 2026-04-18 19:57:37,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:37,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13f1d7cc280ca7299d81f HTTP/1.1" 200 None 2026-04-18 19:57:37,955 - lava_callback - DEBUG - Processing node 69e13f1d7cc280ca7299d81f: baseline-arm64-clabbe 2026-04-18 19:57:37,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13f1d7cc280ca7299d81f 2026-04-18 19:57:37,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:37,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13f1d7cc280ca7299d81f HTTP/1.1" 200 None 2026-04-18 19:57:37,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:37,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:57:37,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:38,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13f1d7cc280ca7299d81f HTTP/1.1" 200 None 2026-04-18 19:57:38,006 - lava_callback - ERROR - Error processing callback for node 69e13f1d7cc280ca7299d81f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:57:53,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:57:54,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK 2026-04-18 19:58:38,002 - lava_callback - INFO - Received callback for node 69e13f677cc280ca7299d84b INFO: 172.21.0.1:41818 - "POST /node/69e13f677cc280ca7299d84b HTTP/1.0" 202 Accepted 2026-04-18 19:58:38,008 - lava_callback - INFO - Starting async job submit for node 69e13f677cc280ca7299d84b 2026-04-18 19:58:38,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:58:38,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13f677cc280ca7299d84b HTTP/1.1" 200 None 2026-04-18 19:58:38,032 - lava_callback - DEBUG - Processing node 69e13f677cc280ca7299d84b: baseline-arm64-clabbe 2026-04-18 19:58:38,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13f677cc280ca7299d84b 2026-04-18 19:58:38,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:58:38,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13f677cc280ca7299d84b HTTP/1.1" 200 None 2026-04-18 19:58:38,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:58:38,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 19:58:38,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 19:58:38,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13f677cc280ca7299d84b HTTP/1.1" 200 None 2026-04-18 19:58:38,082 - lava_callback - ERROR - Error processing callback for node 69e13f677cc280ca7299d84b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:00:18,089 - lava_callback - INFO - Received callback for node 69e13fc47cc280ca7299d87b INFO: 172.21.0.1:57652 - "POST /node/69e13fc47cc280ca7299d87b HTTP/1.0" 202 Accepted 2026-04-18 20:00:18,099 - lava_callback - INFO - Starting async job submit for node 69e13fc47cc280ca7299d87b 2026-04-18 20:00:18,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:00:18,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13fc47cc280ca7299d87b HTTP/1.1" 200 None 2026-04-18 20:00:18,117 - lava_callback - DEBUG - Processing node 69e13fc47cc280ca7299d87b: baseline-arm64-clabbe 2026-04-18 20:00:18,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e13fc47cc280ca7299d87b 2026-04-18 20:00:18,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:00:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e13fc47cc280ca7299d87b HTTP/1.1" 200 None 2026-04-18 20:00:18,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:00:18,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 20:00:18,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:00:18,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e13fc47cc280ca7299d87b HTTP/1.1" 200 None 2026-04-18 20:00:18,182 - lava_callback - ERROR - Error processing callback for node 69e13fc47cc280ca7299d87b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:01:38,160 - lava_callback - INFO - Received callback for node 69e1400e7cc280ca7299d8ac INFO: 172.21.0.1:43878 - "POST /node/69e1400e7cc280ca7299d8ac HTTP/1.0" 202 Accepted 2026-04-18 20:01:38,166 - lava_callback - INFO - Starting async job submit for node 69e1400e7cc280ca7299d8ac 2026-04-18 20:01:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:01:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1400e7cc280ca7299d8ac HTTP/1.1" 200 None 2026-04-18 20:01:38,182 - lava_callback - DEBUG - Processing node 69e1400e7cc280ca7299d8ac: baseline-arm64-clabbe 2026-04-18 20:01:38,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1400e7cc280ca7299d8ac 2026-04-18 20:01:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:01:38,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1400e7cc280ca7299d8ac HTTP/1.1" 200 None 2026-04-18 20:01:38,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:01:38,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-18 20:01:38,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:01:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1400e7cc280ca7299d8ac HTTP/1.1" 200 None 2026-04-18 20:01:38,236 - lava_callback - ERROR - Error processing callback for node 69e1400e7cc280ca7299d8ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:18:34,117 - lava_callback - INFO - Received callback for node 69e144177cc280ca7299d8ee INFO: 172.21.0.1:47574 - "POST /node/69e144177cc280ca7299d8ee HTTP/1.0" 202 Accepted 2026-04-18 20:18:34,122 - lava_callback - INFO - Starting async job submit for node 69e144177cc280ca7299d8ee 2026-04-18 20:18:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:18:34,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144177cc280ca7299d8ee HTTP/1.1" 200 None 2026-04-18 20:18:34,139 - lava_callback - DEBUG - Processing node 69e144177cc280ca7299d8ee: baseline-arm64-baylibre 2026-04-18 20:18:34,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e144177cc280ca7299d8ee 2026-04-18 20:18:34,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:18:34,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144177cc280ca7299d8ee HTTP/1.1" 200 None 2026-04-18 20:18:34,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:18:34,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:18:34,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:18:34,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e144177cc280ca7299d8ee HTTP/1.1" 200 None 2026-04-18 20:18:34,186 - lava_callback - ERROR - Error processing callback for node 69e144177cc280ca7299d8ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:19:54,118 - lava_callback - INFO - Received callback for node 69e144667cc280ca7299d920 INFO: 172.21.0.1:60228 - "POST /node/69e144667cc280ca7299d920 HTTP/1.0" 202 Accepted 2026-04-18 20:19:54,123 - lava_callback - INFO - Starting async job submit for node 69e144667cc280ca7299d920 2026-04-18 20:19:54,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:19:54,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144667cc280ca7299d920 HTTP/1.1" 200 None 2026-04-18 20:19:54,139 - lava_callback - DEBUG - Processing node 69e144667cc280ca7299d920: baseline-arm64-baylibre 2026-04-18 20:19:54,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e144667cc280ca7299d920 2026-04-18 20:19:54,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:19:54,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144667cc280ca7299d920 HTTP/1.1" 200 None 2026-04-18 20:19:54,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:19:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:19:54,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:19:54,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e144667cc280ca7299d920 HTTP/1.1" 200 None 2026-04-18 20:19:54,193 - lava_callback - ERROR - Error processing callback for node 69e144667cc280ca7299d920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:21:14,172 - lava_callback - INFO - Received callback for node 69e144b47cc280ca7299d945 INFO: 172.21.0.1:35976 - "POST /node/69e144b47cc280ca7299d945 HTTP/1.0" 202 Accepted 2026-04-18 20:21:14,182 - lava_callback - INFO - Starting async job submit for node 69e144b47cc280ca7299d945 2026-04-18 20:21:14,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:21:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144b47cc280ca7299d945 HTTP/1.1" 200 None 2026-04-18 20:21:14,201 - lava_callback - DEBUG - Processing node 69e144b47cc280ca7299d945: baseline-arm64-baylibre 2026-04-18 20:21:14,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e144b47cc280ca7299d945 2026-04-18 20:21:14,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:21:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e144b47cc280ca7299d945 HTTP/1.1" 200 None 2026-04-18 20:21:14,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:21:14,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:21:14,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:21:14,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e144b47cc280ca7299d945 HTTP/1.1" 200 None 2026-04-18 20:21:14,256 - lava_callback - ERROR - Error processing callback for node 69e144b47cc280ca7299d945: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:22:34,303 - lava_callback - INFO - Received callback for node 69e145027cc280ca7299d965 INFO: 172.21.0.1:56216 - "POST /node/69e145027cc280ca7299d965 HTTP/1.0" 202 Accepted 2026-04-18 20:22:34,308 - lava_callback - INFO - Starting async job submit for node 69e145027cc280ca7299d965 2026-04-18 20:22:34,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:22:34,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e145027cc280ca7299d965 HTTP/1.1" 200 None 2026-04-18 20:22:34,324 - lava_callback - DEBUG - Processing node 69e145027cc280ca7299d965: baseline-arm64-baylibre 2026-04-18 20:22:34,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e145027cc280ca7299d965 2026-04-18 20:22:34,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:22:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e145027cc280ca7299d965 HTTP/1.1" 200 None 2026-04-18 20:22:34,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:22:34,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:22:34,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:22:34,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e145027cc280ca7299d965 HTTP/1.1" 200 None 2026-04-18 20:22:34,376 - lava_callback - ERROR - Error processing callback for node 69e145027cc280ca7299d965: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:23:54,368 - lava_callback - INFO - Received callback for node 69e1454f7cc280ca7299d98a INFO: 172.21.0.1:55054 - "POST /node/69e1454f7cc280ca7299d98a HTTP/1.0" 202 Accepted 2026-04-18 20:23:54,376 - lava_callback - INFO - Starting async job submit for node 69e1454f7cc280ca7299d98a 2026-04-18 20:23:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:23:54,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1454f7cc280ca7299d98a HTTP/1.1" 200 None 2026-04-18 20:23:54,396 - lava_callback - DEBUG - Processing node 69e1454f7cc280ca7299d98a: baseline-arm64-baylibre 2026-04-18 20:23:54,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1454f7cc280ca7299d98a 2026-04-18 20:23:54,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:23:54,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1454f7cc280ca7299d98a HTTP/1.1" 200 None 2026-04-18 20:23:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:23:54,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:23:54,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:23:54,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1454f7cc280ca7299d98a HTTP/1.1" 200 None 2026-04-18 20:23:54,444 - lava_callback - ERROR - Error processing callback for node 69e1454f7cc280ca7299d98a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:25:14,439 - lava_callback - INFO - Received callback for node 69e1459d7cc280ca7299d9ab INFO: 172.21.0.1:56604 - "POST /node/69e1459d7cc280ca7299d9ab HTTP/1.0" 202 Accepted 2026-04-18 20:25:14,444 - lava_callback - INFO - Starting async job submit for node 69e1459d7cc280ca7299d9ab 2026-04-18 20:25:14,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:25:14,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1459d7cc280ca7299d9ab HTTP/1.1" 200 None 2026-04-18 20:25:14,460 - lava_callback - DEBUG - Processing node 69e1459d7cc280ca7299d9ab: baseline-arm64-baylibre 2026-04-18 20:25:14,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1459d7cc280ca7299d9ab 2026-04-18 20:25:14,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:25:14,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1459d7cc280ca7299d9ab HTTP/1.1" 200 None 2026-04-18 20:25:14,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:25:14,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:25:14,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:25:14,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1459d7cc280ca7299d9ab HTTP/1.1" 200 None 2026-04-18 20:25:14,530 - lava_callback - ERROR - Error processing callback for node 69e1459d7cc280ca7299d9ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET /node/699366aecebe99dd8e065732%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:26:39,198 - lava_callback - INFO - Received callback for node 69e145ef7cc280ca7299d9d0 INFO: 172.21.0.1:57426 - "POST /node/69e145ef7cc280ca7299d9d0 HTTP/1.0" 202 Accepted 2026-04-18 20:26:39,203 - lava_callback - INFO - Starting async job submit for node 69e145ef7cc280ca7299d9d0 2026-04-18 20:26:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:26:39,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e145ef7cc280ca7299d9d0 HTTP/1.1" 200 None 2026-04-18 20:26:39,219 - lava_callback - DEBUG - Processing node 69e145ef7cc280ca7299d9d0: baseline-arm64-clabbe 2026-04-18 20:26:39,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e145ef7cc280ca7299d9d0 2026-04-18 20:26:39,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:26:39,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e145ef7cc280ca7299d9d0 HTTP/1.1" 200 None 2026-04-18 20:26:39,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:26:39,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:26:39,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:26:39,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e145ef7cc280ca7299d9d0 HTTP/1.1" 200 None 2026-04-18 20:26:39,268 - lava_callback - ERROR - Error processing callback for node 69e145ef7cc280ca7299d9d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:27:59,229 - lava_callback - INFO - Received callback for node 69e1463b7cc280ca7299d9fa INFO: 172.21.0.1:55504 - "POST /node/69e1463b7cc280ca7299d9fa HTTP/1.0" 202 Accepted 2026-04-18 20:27:59,235 - lava_callback - INFO - Starting async job submit for node 69e1463b7cc280ca7299d9fa 2026-04-18 20:27:59,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:27:59,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1463b7cc280ca7299d9fa HTTP/1.1" 200 None 2026-04-18 20:27:59,252 - lava_callback - DEBUG - Processing node 69e1463b7cc280ca7299d9fa: baseline-arm64-clabbe 2026-04-18 20:27:59,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1463b7cc280ca7299d9fa 2026-04-18 20:27:59,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:27:59,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1463b7cc280ca7299d9fa HTTP/1.1" 200 None 2026-04-18 20:27:59,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:27:59,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:27:59,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:27:59,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1463b7cc280ca7299d9fa HTTP/1.1" 200 None 2026-04-18 20:27:59,329 - lava_callback - ERROR - Error processing callback for node 69e1463b7cc280ca7299d9fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET /node/69867c88177ca0f097bd514d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:28:59,384 - lava_callback - INFO - Received callback for node 69e146857cc280ca7299da20 INFO: 172.21.0.1:41444 - "POST /node/69e146857cc280ca7299da20 HTTP/1.0" 202 Accepted 2026-04-18 20:28:59,390 - lava_callback - INFO - Starting async job submit for node 69e146857cc280ca7299da20 2026-04-18 20:28:59,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:28:59,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e146857cc280ca7299da20 HTTP/1.1" 200 None 2026-04-18 20:28:59,405 - lava_callback - DEBUG - Processing node 69e146857cc280ca7299da20: baseline-arm64-clabbe 2026-04-18 20:28:59,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e146857cc280ca7299da20 2026-04-18 20:28:59,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:28:59,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e146857cc280ca7299da20 HTTP/1.1" 200 None 2026-04-18 20:28:59,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:28:59,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:28:59,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:28:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e146857cc280ca7299da20 HTTP/1.1" 200 None 2026-04-18 20:28:59,488 - lava_callback - ERROR - Error processing callback for node 69e146857cc280ca7299da20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:30:19,315 - lava_callback - INFO - Received callback for node 69e146ce7cc280ca7299da57 INFO: 172.21.0.1:54624 - "POST /node/69e146ce7cc280ca7299da57 HTTP/1.0" 202 Accepted 2026-04-18 20:30:19,321 - lava_callback - INFO - Starting async job submit for node 69e146ce7cc280ca7299da57 2026-04-18 20:30:19,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:30:19,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e146ce7cc280ca7299da57 HTTP/1.1" 200 None 2026-04-18 20:30:19,337 - lava_callback - DEBUG - Processing node 69e146ce7cc280ca7299da57: baseline-arm64-clabbe 2026-04-18 20:30:19,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e146ce7cc280ca7299da57 2026-04-18 20:30:19,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:30:19,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e146ce7cc280ca7299da57 HTTP/1.1" 200 None 2026-04-18 20:30:19,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:30:19,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:30:19,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:30:19,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e146ce7cc280ca7299da57 HTTP/1.1" 200 None 2026-04-18 20:30:19,390 - lava_callback - ERROR - Error processing callback for node 69e146ce7cc280ca7299da57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET /node/6990a6d7c45febfe44520aca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40320 - "GET /node/6990a625c45febfe445208e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET /node/698e24c4952a14bf500e3df0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:31:39,391 - lava_callback - INFO - Received callback for node 69e1471a7cc280ca7299da79 INFO: 172.21.0.1:47794 - "POST /node/69e1471a7cc280ca7299da79 HTTP/1.0" 202 Accepted 2026-04-18 20:31:39,398 - lava_callback - INFO - Starting async job submit for node 69e1471a7cc280ca7299da79 2026-04-18 20:31:39,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:31:39,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1471a7cc280ca7299da79 HTTP/1.1" 200 None 2026-04-18 20:31:39,414 - lava_callback - DEBUG - Processing node 69e1471a7cc280ca7299da79: baseline-arm64-clabbe 2026-04-18 20:31:39,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1471a7cc280ca7299da79 2026-04-18 20:31:39,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:31:39,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1471a7cc280ca7299da79 HTTP/1.1" 200 None 2026-04-18 20:31:39,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:31:39,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:31:39,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:31:39,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1471a7cc280ca7299da79 HTTP/1.1" 200 None 2026-04-18 20:31:39,467 - lava_callback - ERROR - Error processing callback for node 69e1471a7cc280ca7299da79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:32:39,457 - lava_callback - INFO - Received callback for node 69e147647cc280ca7299daa2 INFO: 172.21.0.1:34588 - "POST /node/69e147647cc280ca7299daa2 HTTP/1.0" 202 Accepted 2026-04-18 20:32:39,462 - lava_callback - INFO - Starting async job submit for node 69e147647cc280ca7299daa2 2026-04-18 20:32:39,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:32:39,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e147647cc280ca7299daa2 HTTP/1.1" 200 None 2026-04-18 20:32:39,478 - lava_callback - DEBUG - Processing node 69e147647cc280ca7299daa2: baseline-arm64-clabbe 2026-04-18 20:32:39,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e147647cc280ca7299daa2 2026-04-18 20:32:39,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:32:39,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e147647cc280ca7299daa2 HTTP/1.1" 200 None 2026-04-18 20:32:39,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:32:39,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:32:39,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:32:39,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e147647cc280ca7299daa2 HTTP/1.1" 200 None 2026-04-18 20:32:39,525 - lava_callback - ERROR - Error processing callback for node 69e147647cc280ca7299daa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET /node/698a7f51d9a1cfa777a22a88%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK 2026-04-18 20:33:59,473 - lava_callback - INFO - Received callback for node 69e147b17cc280ca7299dac9 INFO: 172.21.0.1:41562 - "POST /node/69e147b17cc280ca7299dac9 HTTP/1.0" 202 Accepted 2026-04-18 20:33:59,479 - lava_callback - INFO - Starting async job submit for node 69e147b17cc280ca7299dac9 2026-04-18 20:33:59,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:33:59,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e147b17cc280ca7299dac9 HTTP/1.1" 200 None 2026-04-18 20:33:59,498 - lava_callback - DEBUG - Processing node 69e147b17cc280ca7299dac9: baseline-arm64-clabbe 2026-04-18 20:33:59,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e147b17cc280ca7299dac9 2026-04-18 20:33:59,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:33:59,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e147b17cc280ca7299dac9 HTTP/1.1" 200 None 2026-04-18 20:33:59,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:33:59,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-18 20:33:59,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 20:33:59,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e147b17cc280ca7299dac9 HTTP/1.1" 200 None 2026-04-18 20:33:59,570 - lava_callback - ERROR - Error processing callback for node 69e147b17cc280ca7299dac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET /node/698af6713b3beb19e76171a0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET /node/69192224ef36f328cfd416cc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET /node/6928cbd73a49357e496c8eea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36752 - "GET /node/6949e6ec2060d3d84791d128%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET /node/693f64da0d8ce4018da8fddf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET /node/694a4eda2060d3d8479237ce%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57594 - "GET /node/6985dbc771989fb14149adb6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET /node/6952f60d9912bd6bbcea5fed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET /node/69903ccd985e4efca431e0cb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:15:57,336 - lava_callback - INFO - Received callback for node 69e151807cc280ca7299dafd INFO: 172.21.0.1:55148 - "POST /node/69e151807cc280ca7299dafd HTTP/1.0" 202 Accepted 2026-04-18 21:15:57,341 - lava_callback - INFO - Starting async job submit for node 69e151807cc280ca7299dafd 2026-04-18 21:15:57,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:15:57,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151807cc280ca7299dafd HTTP/1.1" 200 None 2026-04-18 21:15:57,363 - lava_callback - DEBUG - Processing node 69e151807cc280ca7299dafd: baseline-arm-baylibre 2026-04-18 21:15:57,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e151807cc280ca7299dafd 2026-04-18 21:15:57,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:15:57,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151807cc280ca7299dafd HTTP/1.1" 200 None 2026-04-18 21:15:57,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:15:57,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:15:57,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:15:57,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e151807cc280ca7299dafd HTTP/1.1" 200 None 2026-04-18 21:15:57,411 - lava_callback - ERROR - Error processing callback for node 69e151807cc280ca7299dafd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:16:37,172 - lava_callback - INFO - Received callback for node 69e151a57cc280ca7299db1b INFO: 172.21.0.1:39726 - "POST /node/69e151a57cc280ca7299db1b HTTP/1.0" 202 Accepted 2026-04-18 21:16:37,178 - lava_callback - INFO - Starting async job submit for node 69e151a57cc280ca7299db1b 2026-04-18 21:16:37,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:16:37,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151a57cc280ca7299db1b HTTP/1.1" 200 None 2026-04-18 21:16:37,194 - lava_callback - DEBUG - Processing node 69e151a57cc280ca7299db1b: baseline-arm-baylibre 2026-04-18 21:16:37,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e151a57cc280ca7299db1b 2026-04-18 21:16:37,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:16:37,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151a57cc280ca7299db1b HTTP/1.1" 200 None 2026-04-18 21:16:37,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:16:37,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:16:37,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:16:37,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e151a57cc280ca7299db1b HTTP/1.1" 200 None 2026-04-18 21:16:37,249 - lava_callback - ERROR - Error processing callback for node 69e151a57cc280ca7299db1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:17:17,230 - lava_callback - INFO - Received callback for node 69e151c97cc280ca7299db27 INFO: 172.21.0.1:50768 - "POST /node/69e151c97cc280ca7299db27 HTTP/1.0" 202 Accepted 2026-04-18 21:17:17,236 - lava_callback - INFO - Starting async job submit for node 69e151c97cc280ca7299db27 2026-04-18 21:17:17,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:17,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151c97cc280ca7299db27 HTTP/1.1" 200 None 2026-04-18 21:17:17,252 - lava_callback - DEBUG - Processing node 69e151c97cc280ca7299db27: baseline-arm-baylibre 2026-04-18 21:17:17,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e151c97cc280ca7299db27 2026-04-18 21:17:17,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:17,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151c97cc280ca7299db27 HTTP/1.1" 200 None 2026-04-18 21:17:17,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:17,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:17:17,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:17,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e151c97cc280ca7299db27 HTTP/1.1" 200 None 2026-04-18 21:17:17,304 - lava_callback - ERROR - Error processing callback for node 69e151c97cc280ca7299db27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:17:37,225 - lava_callback - INFO - Received callback for node 69e151ed7cc280ca7299db33 INFO: 172.21.0.1:33430 - "POST /node/69e151ed7cc280ca7299db33 HTTP/1.0" 202 Accepted 2026-04-18 21:17:37,232 - lava_callback - INFO - Starting async job submit for node 69e151ed7cc280ca7299db33 2026-04-18 21:17:37,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:37,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151ed7cc280ca7299db33 HTTP/1.1" 200 None 2026-04-18 21:17:37,264 - lava_callback - DEBUG - Processing node 69e151ed7cc280ca7299db33: baseline-arm-baylibre 2026-04-18 21:17:37,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e151ed7cc280ca7299db33 2026-04-18 21:17:37,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:37,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e151ed7cc280ca7299db33 HTTP/1.1" 200 None 2026-04-18 21:17:37,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:17:37,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:17:37,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e151ed7cc280ca7299db33 HTTP/1.1" 200 None 2026-04-18 21:17:37,339 - lava_callback - ERROR - Error processing callback for node 69e151ed7cc280ca7299db33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:18:17,295 - lava_callback - INFO - Received callback for node 69e152127cc280ca7299db41 INFO: 172.21.0.1:38640 - "POST /node/69e152127cc280ca7299db41 HTTP/1.0" 202 Accepted 2026-04-18 21:18:17,301 - lava_callback - INFO - Starting async job submit for node 69e152127cc280ca7299db41 2026-04-18 21:18:17,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:17,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152127cc280ca7299db41 HTTP/1.1" 200 None 2026-04-18 21:18:17,317 - lava_callback - DEBUG - Processing node 69e152127cc280ca7299db41: baseline-arm-baylibre 2026-04-18 21:18:17,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152127cc280ca7299db41 2026-04-18 21:18:17,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:17,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152127cc280ca7299db41 HTTP/1.1" 200 None 2026-04-18 21:18:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:17,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:18:17,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:17,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152127cc280ca7299db41 HTTP/1.1" 200 None 2026-04-18 21:18:17,367 - lava_callback - ERROR - Error processing callback for node 69e152127cc280ca7299db41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:18:57,389 - lava_callback - INFO - Received callback for node 69e152367cc280ca7299db4b INFO: 172.21.0.1:34142 - "POST /node/69e152367cc280ca7299db4b HTTP/1.0" 202 Accepted 2026-04-18 21:18:57,394 - lava_callback - INFO - Starting async job submit for node 69e152367cc280ca7299db4b 2026-04-18 21:18:57,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:57,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152367cc280ca7299db4b HTTP/1.1" 200 None 2026-04-18 21:18:57,410 - lava_callback - DEBUG - Processing node 69e152367cc280ca7299db4b: baseline-arm-baylibre 2026-04-18 21:18:57,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152367cc280ca7299db4b 2026-04-18 21:18:57,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:57,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152367cc280ca7299db4b HTTP/1.1" 200 None 2026-04-18 21:18:57,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:57,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:18:57,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:18:57,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152367cc280ca7299db4b HTTP/1.1" 200 None 2026-04-18 21:18:57,457 - lava_callback - ERROR - Error processing callback for node 69e152367cc280ca7299db4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:19:41,406 - lava_callback - INFO - Received callback for node 69e1525c7cc280ca7299db57 INFO: 172.21.0.1:44836 - "POST /node/69e1525c7cc280ca7299db57 HTTP/1.0" 202 Accepted 2026-04-18 21:19:41,412 - lava_callback - INFO - Starting async job submit for node 69e1525c7cc280ca7299db57 2026-04-18 21:19:41,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:19:41,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1525c7cc280ca7299db57 HTTP/1.1" 200 None 2026-04-18 21:19:41,427 - lava_callback - DEBUG - Processing node 69e1525c7cc280ca7299db57: baseline-arm-clabbe 2026-04-18 21:19:41,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1525c7cc280ca7299db57 2026-04-18 21:19:41,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:19:41,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1525c7cc280ca7299db57 HTTP/1.1" 200 None 2026-04-18 21:19:41,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:19:41,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:19:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:19:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1525c7cc280ca7299db57 HTTP/1.1" 200 None 2026-04-18 21:19:41,495 - lava_callback - ERROR - Error processing callback for node 69e1525c7cc280ca7299db57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:20:21,339 - lava_callback - INFO - Received callback for node 69e152817cc280ca7299db63 INFO: 172.21.0.1:48168 - "POST /node/69e152817cc280ca7299db63 HTTP/1.0" 202 Accepted 2026-04-18 21:20:21,345 - lava_callback - INFO - Starting async job submit for node 69e152817cc280ca7299db63 2026-04-18 21:20:21,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:21,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152817cc280ca7299db63 HTTP/1.1" 200 None 2026-04-18 21:20:21,366 - lava_callback - DEBUG - Processing node 69e152817cc280ca7299db63: baseline-arm-clabbe 2026-04-18 21:20:21,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152817cc280ca7299db63 2026-04-18 21:20:21,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:21,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152817cc280ca7299db63 HTTP/1.1" 200 None 2026-04-18 21:20:21,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:20:21,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:21,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152817cc280ca7299db63 HTTP/1.1" 200 None 2026-04-18 21:20:21,414 - lava_callback - ERROR - Error processing callback for node 69e152817cc280ca7299db63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:20:41,380 - lava_callback - INFO - Received callback for node 69e152a67cc280ca7299db71 INFO: 172.21.0.1:36886 - "POST /node/69e152a67cc280ca7299db71 HTTP/1.0" 202 Accepted 2026-04-18 21:20:41,386 - lava_callback - INFO - Starting async job submit for node 69e152a67cc280ca7299db71 2026-04-18 21:20:41,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:41,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152a67cc280ca7299db71 HTTP/1.1" 200 None 2026-04-18 21:20:41,422 - lava_callback - DEBUG - Processing node 69e152a67cc280ca7299db71: baseline-arm-clabbe 2026-04-18 21:20:41,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152a67cc280ca7299db71 2026-04-18 21:20:41,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:41,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152a67cc280ca7299db71 HTTP/1.1" 200 None 2026-04-18 21:20:41,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:41,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:20:41,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:20:41,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152a67cc280ca7299db71 HTTP/1.1" 200 None 2026-04-18 21:20:41,486 - lava_callback - ERROR - Error processing callback for node 69e152a67cc280ca7299db71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:21:21,398 - lava_callback - INFO - Received callback for node 69e152cb7cc280ca7299db7b INFO: 172.21.0.1:60748 - "POST /node/69e152cb7cc280ca7299db7b HTTP/1.0" 202 Accepted 2026-04-18 21:21:21,403 - lava_callback - INFO - Starting async job submit for node 69e152cb7cc280ca7299db7b 2026-04-18 21:21:21,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:21:21,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152cb7cc280ca7299db7b HTTP/1.1" 200 None 2026-04-18 21:21:21,419 - lava_callback - DEBUG - Processing node 69e152cb7cc280ca7299db7b: baseline-arm-clabbe 2026-04-18 21:21:21,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152cb7cc280ca7299db7b 2026-04-18 21:21:21,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:21:21,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152cb7cc280ca7299db7b HTTP/1.1" 200 None 2026-04-18 21:21:21,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:21:21,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:21:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:21:21,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152cb7cc280ca7299db7b HTTP/1.1" 200 None 2026-04-18 21:21:21,468 - lava_callback - ERROR - Error processing callback for node 69e152cb7cc280ca7299db7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:22:01,457 - lava_callback - INFO - Received callback for node 69e152f07cc280ca7299db87 INFO: 172.21.0.1:33986 - "POST /node/69e152f07cc280ca7299db87 HTTP/1.0" 202 Accepted 2026-04-18 21:22:01,463 - lava_callback - INFO - Starting async job submit for node 69e152f07cc280ca7299db87 2026-04-18 21:22:01,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:01,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152f07cc280ca7299db87 HTTP/1.1" 200 None 2026-04-18 21:22:01,478 - lava_callback - DEBUG - Processing node 69e152f07cc280ca7299db87: baseline-arm-clabbe 2026-04-18 21:22:01,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e152f07cc280ca7299db87 2026-04-18 21:22:01,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:01,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e152f07cc280ca7299db87 HTTP/1.1" 200 None 2026-04-18 21:22:01,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:01,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:22:01,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:01,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e152f07cc280ca7299db87 HTTP/1.1" 200 None 2026-04-18 21:22:01,530 - lava_callback - ERROR - Error processing callback for node 69e152f07cc280ca7299db87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:22:41,471 - lava_callback - INFO - Received callback for node 69e153157cc280ca7299db93 INFO: 172.21.0.1:41852 - "POST /node/69e153157cc280ca7299db93 HTTP/1.0" 202 Accepted 2026-04-18 21:22:41,477 - lava_callback - INFO - Starting async job submit for node 69e153157cc280ca7299db93 2026-04-18 21:22:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:41,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e153157cc280ca7299db93 HTTP/1.1" 200 None 2026-04-18 21:22:41,492 - lava_callback - DEBUG - Processing node 69e153157cc280ca7299db93: baseline-arm-clabbe 2026-04-18 21:22:41,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e153157cc280ca7299db93 2026-04-18 21:22:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e153157cc280ca7299db93 HTTP/1.1" 200 None 2026-04-18 21:22:41,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:41,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:22:41,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:22:41,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e153157cc280ca7299db93 HTTP/1.1" 200 None 2026-04-18 21:22:41,547 - lava_callback - ERROR - Error processing callback for node 69e153157cc280ca7299db93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:23:21,521 - lava_callback - INFO - Received callback for node 69e1533a7cc280ca7299db9f INFO: 172.21.0.1:47074 - "POST /node/69e1533a7cc280ca7299db9f HTTP/1.0" 202 Accepted 2026-04-18 21:23:21,530 - lava_callback - INFO - Starting async job submit for node 69e1533a7cc280ca7299db9f 2026-04-18 21:23:21,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:23:21,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1533a7cc280ca7299db9f HTTP/1.1" 200 None 2026-04-18 21:23:21,548 - lava_callback - DEBUG - Processing node 69e1533a7cc280ca7299db9f: baseline-arm-clabbe 2026-04-18 21:23:21,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1533a7cc280ca7299db9f 2026-04-18 21:23:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:23:21,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1533a7cc280ca7299db9f HTTP/1.1" 200 None 2026-04-18 21:23:21,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:23:21,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:23:21,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:23:21,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1533a7cc280ca7299db9f HTTP/1.1" 200 None 2026-04-18 21:23:21,596 - lava_callback - ERROR - Error processing callback for node 69e1533a7cc280ca7299db9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:24:01,495 - lava_callback - INFO - Received callback for node 69e1535f7cc280ca7299dbad INFO: 172.21.0.1:60260 - "POST /node/69e1535f7cc280ca7299dbad HTTP/1.0" 202 Accepted 2026-04-18 21:24:01,501 - lava_callback - INFO - Starting async job submit for node 69e1535f7cc280ca7299dbad 2026-04-18 21:24:01,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:01,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1535f7cc280ca7299dbad HTTP/1.1" 200 None 2026-04-18 21:24:01,516 - lava_callback - DEBUG - Processing node 69e1535f7cc280ca7299dbad: baseline-arm-clabbe 2026-04-18 21:24:01,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1535f7cc280ca7299dbad 2026-04-18 21:24:01,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:01,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1535f7cc280ca7299dbad HTTP/1.1" 200 None 2026-04-18 21:24:01,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:01,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:24:01,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:01,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1535f7cc280ca7299dbad HTTP/1.1" 200 None 2026-04-18 21:24:01,564 - lava_callback - ERROR - Error processing callback for node 69e1535f7cc280ca7299dbad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK 2026-04-18 21:24:41,541 - lava_callback - INFO - Received callback for node 69e153847cc280ca7299dbb7 INFO: 172.21.0.1:48522 - "POST /node/69e153847cc280ca7299dbb7 HTTP/1.0" 202 Accepted 2026-04-18 21:24:41,546 - lava_callback - INFO - Starting async job submit for node 69e153847cc280ca7299dbb7 2026-04-18 21:24:41,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:41,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e153847cc280ca7299dbb7 HTTP/1.1" 200 None 2026-04-18 21:24:41,563 - lava_callback - DEBUG - Processing node 69e153847cc280ca7299dbb7: baseline-arm-clabbe 2026-04-18 21:24:41,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e153847cc280ca7299dbb7 2026-04-18 21:24:41,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:41,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e153847cc280ca7299dbb7 HTTP/1.1" 200 None 2026-04-18 21:24:41,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:41,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-18 21:24:41,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 21:24:41,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e153847cc280ca7299dbb7 HTTP/1.1" 200 None 2026-04-18 21:24:41,620 - lava_callback - ERROR - Error processing callback for node 69e153847cc280ca7299dbb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET /node/694a589883c67c43d1ed9d24%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET /node/69845a2b3a8748f282085456%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48972 - "GET /node/698ef6dff0e3ffbba67d3266%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET /node/693e3c90407f32424eb5c730%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET /node/69876d81e31b58f834f19d30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57936 - "GET /node/6919d7af40db568ee36c886c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET /node/693f70c30d8ce4018da930ba%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET /node/698fd71a76d4b6342e9d8f2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET /node/6983f227969566dcb0d2a7e3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET /node/693af4c1fee8383e92b6b011%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /node/69865d33177ca0f097bd45e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET /node/698458503a8748f282084e07%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:41:01,786 - lava_callback - INFO - Received callback for node 69e165717cc280ca7299dbd0 INFO: 172.21.0.1:59954 - "POST /node/69e165717cc280ca7299dbd0 HTTP/1.0" 202 Accepted 2026-04-18 22:41:01,792 - lava_callback - INFO - Starting async job submit for node 69e165717cc280ca7299dbd0 2026-04-18 22:41:01,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:01,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165717cc280ca7299dbd0 HTTP/1.1" 200 None 2026-04-18 22:41:01,808 - lava_callback - DEBUG - Processing node 69e165717cc280ca7299dbd0: baseline-arm-baylibre 2026-04-18 22:41:01,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e165717cc280ca7299dbd0 2026-04-18 22:41:01,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:01,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165717cc280ca7299dbd0 HTTP/1.1" 200 None 2026-04-18 22:41:01,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:01,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:41:01,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:01,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e165717cc280ca7299dbd0 HTTP/1.1" 200 None 2026-04-18 22:41:01,859 - lava_callback - ERROR - Error processing callback for node 69e165717cc280ca7299dbd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:41:41,792 - lava_callback - INFO - Received callback for node 69e165967cc280ca7299dbdf INFO: 172.21.0.1:41908 - "POST /node/69e165967cc280ca7299dbdf HTTP/1.0" 202 Accepted 2026-04-18 22:41:41,798 - lava_callback - INFO - Starting async job submit for node 69e165967cc280ca7299dbdf 2026-04-18 22:41:41,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:41,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165967cc280ca7299dbdf HTTP/1.1" 200 None 2026-04-18 22:41:41,818 - lava_callback - DEBUG - Processing node 69e165967cc280ca7299dbdf: baseline-arm-baylibre 2026-04-18 22:41:41,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e165967cc280ca7299dbdf 2026-04-18 22:41:41,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:41,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165967cc280ca7299dbdf HTTP/1.1" 200 None 2026-04-18 22:41:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:41,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:41:41,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:41:41,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e165967cc280ca7299dbdf HTTP/1.1" 200 None 2026-04-18 22:41:41,878 - lava_callback - ERROR - Error processing callback for node 69e165967cc280ca7299dbdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:42:21,830 - lava_callback - INFO - Received callback for node 69e165ba7cc280ca7299dbf0 INFO: 172.21.0.1:57518 - "POST /node/69e165ba7cc280ca7299dbf0 HTTP/1.0" 202 Accepted 2026-04-18 22:42:21,836 - lava_callback - INFO - Starting async job submit for node 69e165ba7cc280ca7299dbf0 2026-04-18 22:42:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:21,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165ba7cc280ca7299dbf0 HTTP/1.1" 200 None 2026-04-18 22:42:21,851 - lava_callback - DEBUG - Processing node 69e165ba7cc280ca7299dbf0: baseline-arm-baylibre 2026-04-18 22:42:21,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e165ba7cc280ca7299dbf0 2026-04-18 22:42:21,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:21,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165ba7cc280ca7299dbf0 HTTP/1.1" 200 None 2026-04-18 22:42:21,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:21,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:42:21,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:21,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e165ba7cc280ca7299dbf0 HTTP/1.1" 200 None 2026-04-18 22:42:21,897 - lava_callback - ERROR - Error processing callback for node 69e165ba7cc280ca7299dbf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:42:41,856 - lava_callback - INFO - Received callback for node 69e165de7cc280ca7299dc00 INFO: 172.21.0.1:51842 - "POST /node/69e165de7cc280ca7299dc00 HTTP/1.0" 202 Accepted 2026-04-18 22:42:41,861 - lava_callback - INFO - Starting async job submit for node 69e165de7cc280ca7299dc00 2026-04-18 22:42:41,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:41,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165de7cc280ca7299dc00 HTTP/1.1" 200 None 2026-04-18 22:42:41,879 - lava_callback - DEBUG - Processing node 69e165de7cc280ca7299dc00: baseline-arm-baylibre 2026-04-18 22:42:41,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e165de7cc280ca7299dc00 2026-04-18 22:42:41,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:41,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e165de7cc280ca7299dc00 HTTP/1.1" 200 None 2026-04-18 22:42:41,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:41,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:42:41,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:42:41,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e165de7cc280ca7299dc00 HTTP/1.1" 200 None 2026-04-18 22:42:41,934 - lava_callback - ERROR - Error processing callback for node 69e165de7cc280ca7299dc00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:43:21,852 - lava_callback - INFO - Received callback for node 69e166017cc280ca7299dc12 INFO: 172.21.0.1:40444 - "POST /node/69e166017cc280ca7299dc12 HTTP/1.0" 202 Accepted 2026-04-18 22:43:21,857 - lava_callback - INFO - Starting async job submit for node 69e166017cc280ca7299dc12 2026-04-18 22:43:21,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:43:21,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166017cc280ca7299dc12 HTTP/1.1" 200 None 2026-04-18 22:43:21,873 - lava_callback - DEBUG - Processing node 69e166017cc280ca7299dc12: baseline-arm-baylibre 2026-04-18 22:43:21,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166017cc280ca7299dc12 2026-04-18 22:43:21,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:43:21,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166017cc280ca7299dc12 HTTP/1.1" 200 None 2026-04-18 22:43:21,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:43:21,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:43:21,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:43:21,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166017cc280ca7299dc12 HTTP/1.1" 200 None 2026-04-18 22:43:21,921 - lava_callback - ERROR - Error processing callback for node 69e166017cc280ca7299dc12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:44:02,009 - lava_callback - INFO - Received callback for node 69e166267cc280ca7299dc20 INFO: 172.21.0.1:45022 - "POST /node/69e166267cc280ca7299dc20 HTTP/1.0" 202 Accepted 2026-04-18 22:44:02,014 - lava_callback - INFO - Starting async job submit for node 69e166267cc280ca7299dc20 2026-04-18 22:44:02,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:02,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166267cc280ca7299dc20 HTTP/1.1" 200 None 2026-04-18 22:44:02,029 - lava_callback - DEBUG - Processing node 69e166267cc280ca7299dc20: baseline-arm-baylibre 2026-04-18 22:44:02,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166267cc280ca7299dc20 2026-04-18 22:44:02,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:02,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166267cc280ca7299dc20 HTTP/1.1" 200 None 2026-04-18 22:44:02,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:02,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:44:02,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:02,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166267cc280ca7299dc20 HTTP/1.1" 200 None 2026-04-18 22:44:02,087 - lava_callback - ERROR - Error processing callback for node 69e166267cc280ca7299dc20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:44:41,922 - lava_callback - INFO - Received callback for node 69e1664b7cc280ca7299dc31 INFO: 172.21.0.1:49112 - "POST /node/69e1664b7cc280ca7299dc31 HTTP/1.0" 202 Accepted 2026-04-18 22:44:41,927 - lava_callback - INFO - Starting async job submit for node 69e1664b7cc280ca7299dc31 2026-04-18 22:44:41,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:41,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1664b7cc280ca7299dc31 HTTP/1.1" 200 None 2026-04-18 22:44:41,943 - lava_callback - DEBUG - Processing node 69e1664b7cc280ca7299dc31: baseline-arm-baylibre 2026-04-18 22:44:41,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1664b7cc280ca7299dc31 2026-04-18 22:44:41,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1664b7cc280ca7299dc31 HTTP/1.1" 200 None 2026-04-18 22:44:41,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:41,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:44:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:44:41,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1664b7cc280ca7299dc31 HTTP/1.1" 200 None 2026-04-18 22:44:41,990 - lava_callback - ERROR - Error processing callback for node 69e1664b7cc280ca7299dc31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:45:21,980 - lava_callback - INFO - Received callback for node 69e1666d7cc280ca7299dc4e INFO: 172.21.0.1:57052 - "POST /node/69e1666d7cc280ca7299dc4e HTTP/1.0" 202 Accepted 2026-04-18 22:45:21,986 - lava_callback - INFO - Starting async job submit for node 69e1666d7cc280ca7299dc4e 2026-04-18 22:45:21,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:22,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1666d7cc280ca7299dc4e HTTP/1.1" 200 None 2026-04-18 22:45:22,007 - lava_callback - DEBUG - Processing node 69e1666d7cc280ca7299dc4e: baseline-arm-baylibre 2026-04-18 22:45:22,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1666d7cc280ca7299dc4e 2026-04-18 22:45:22,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:22,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1666d7cc280ca7299dc4e HTTP/1.1" 200 None 2026-04-18 22:45:22,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:22,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:45:22,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:22,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1666d7cc280ca7299dc4e HTTP/1.1" 200 None 2026-04-18 22:45:22,055 - lava_callback - ERROR - Error processing callback for node 69e1666d7cc280ca7299dc4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:45:41,971 - lava_callback - INFO - Received callback for node 69e166927cc280ca7299dc5e INFO: 172.21.0.1:33392 - "POST /node/69e166927cc280ca7299dc5e HTTP/1.0" 202 Accepted 2026-04-18 22:45:41,976 - lava_callback - INFO - Starting async job submit for node 69e166927cc280ca7299dc5e 2026-04-18 22:45:41,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:41,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166927cc280ca7299dc5e HTTP/1.1" 200 None 2026-04-18 22:45:41,995 - lava_callback - DEBUG - Processing node 69e166927cc280ca7299dc5e: baseline-arm-baylibre 2026-04-18 22:45:41,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166927cc280ca7299dc5e 2026-04-18 22:45:41,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:42,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166927cc280ca7299dc5e HTTP/1.1" 200 None 2026-04-18 22:45:42,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:42,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:45:42,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:45:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166927cc280ca7299dc5e HTTP/1.1" 200 None 2026-04-18 22:45:42,052 - lava_callback - ERROR - Error processing callback for node 69e166927cc280ca7299dc5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:46:22,021 - lava_callback - INFO - Received callback for node 69e166b77cc280ca7299dc94 INFO: 172.21.0.1:36162 - "POST /node/69e166b77cc280ca7299dc94 HTTP/1.0" 202 Accepted 2026-04-18 22:46:22,027 - lava_callback - INFO - Starting async job submit for node 69e166b77cc280ca7299dc94 2026-04-18 22:46:22,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:46:22,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166b77cc280ca7299dc94 HTTP/1.1" 200 None 2026-04-18 22:46:22,043 - lava_callback - DEBUG - Processing node 69e166b77cc280ca7299dc94: baseline-arm-baylibre 2026-04-18 22:46:22,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166b77cc280ca7299dc94 2026-04-18 22:46:22,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:46:22,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166b77cc280ca7299dc94 HTTP/1.1" 200 None 2026-04-18 22:46:22,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:46:22,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:46:22,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:46:22,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166b77cc280ca7299dc94 HTTP/1.1" 200 None 2026-04-18 22:46:22,093 - lava_callback - ERROR - Error processing callback for node 69e166b77cc280ca7299dc94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:47:02,091 - lava_callback - INFO - Received callback for node 69e166d97cc280ca7299dca3 INFO: 172.21.0.1:39014 - "POST /node/69e166d97cc280ca7299dca3 HTTP/1.0" 202 Accepted 2026-04-18 22:47:02,098 - lava_callback - INFO - Starting async job submit for node 69e166d97cc280ca7299dca3 2026-04-18 22:47:02,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:02,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166d97cc280ca7299dca3 HTTP/1.1" 200 None 2026-04-18 22:47:02,117 - lava_callback - DEBUG - Processing node 69e166d97cc280ca7299dca3: baseline-arm-baylibre 2026-04-18 22:47:02,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166d97cc280ca7299dca3 2026-04-18 22:47:02,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:02,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166d97cc280ca7299dca3 HTTP/1.1" 200 None 2026-04-18 22:47:02,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:02,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:47:02,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:02,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166d97cc280ca7299dca3 HTTP/1.1" 200 None 2026-04-18 22:47:02,177 - lava_callback - ERROR - Error processing callback for node 69e166d97cc280ca7299dca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:47:42,078 - lava_callback - INFO - Received callback for node 69e166fd7cc280ca7299dcb2 INFO: 172.21.0.1:59516 - "POST /node/69e166fd7cc280ca7299dcb2 HTTP/1.0" 202 Accepted 2026-04-18 22:47:42,083 - lava_callback - INFO - Starting async job submit for node 69e166fd7cc280ca7299dcb2 2026-04-18 22:47:42,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:42,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166fd7cc280ca7299dcb2 HTTP/1.1" 200 None 2026-04-18 22:47:42,099 - lava_callback - DEBUG - Processing node 69e166fd7cc280ca7299dcb2: baseline-arm-baylibre 2026-04-18 22:47:42,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e166fd7cc280ca7299dcb2 2026-04-18 22:47:42,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:42,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e166fd7cc280ca7299dcb2 HTTP/1.1" 200 None 2026-04-18 22:47:42,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:42,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:47:42,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:47:42,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e166fd7cc280ca7299dcb2 HTTP/1.1" 200 None 2026-04-18 22:47:42,148 - lava_callback - ERROR - Error processing callback for node 69e166fd7cc280ca7299dcb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:48:02,084 - lava_callback - INFO - Received callback for node 69e1671f7cc280ca7299dcc0 INFO: 172.21.0.1:43732 - "POST /node/69e1671f7cc280ca7299dcc0 HTTP/1.0" 202 Accepted 2026-04-18 22:48:02,089 - lava_callback - INFO - Starting async job submit for node 69e1671f7cc280ca7299dcc0 2026-04-18 22:48:02,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:48:02,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1671f7cc280ca7299dcc0 HTTP/1.1" 200 None 2026-04-18 22:48:02,119 - lava_callback - DEBUG - Processing node 69e1671f7cc280ca7299dcc0: baseline-arm-baylibre 2026-04-18 22:48:02,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1671f7cc280ca7299dcc0 2026-04-18 22:48:02,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:48:02,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1671f7cc280ca7299dcc0 HTTP/1.1" 200 None 2026-04-18 22:48:02,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:48:02,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:48:02,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:48:02,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1671f7cc280ca7299dcc0 HTTP/1.1" 200 None 2026-04-18 22:48:02,176 - lava_callback - ERROR - Error processing callback for node 69e1671f7cc280ca7299dcc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:53:42,472 - lava_callback - INFO - Received callback for node 69e1686c7cc280ca7299dd70 INFO: 172.21.0.1:40280 - "POST /node/69e1686c7cc280ca7299dd70 HTTP/1.0" 202 Accepted 2026-04-18 22:53:42,477 - lava_callback - INFO - Starting async job submit for node 69e1686c7cc280ca7299dd70 2026-04-18 22:53:42,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:53:42,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1686c7cc280ca7299dd70 HTTP/1.1" 200 None 2026-04-18 22:53:42,512 - lava_callback - DEBUG - Processing node 69e1686c7cc280ca7299dd70: baseline-arm-baylibre 2026-04-18 22:53:42,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1686c7cc280ca7299dd70 2026-04-18 22:53:42,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:53:42,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1686c7cc280ca7299dd70 HTTP/1.1" 200 None 2026-04-18 22:53:42,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:53:42,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:53:42,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:53:42,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1686c7cc280ca7299dd70 HTTP/1.1" 200 None 2026-04-18 22:53:42,608 - lava_callback - ERROR - Error processing callback for node 69e1686c7cc280ca7299dd70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:54:22,457 - lava_callback - INFO - Received callback for node 69e1688c7cc280ca7299dd80 INFO: 172.21.0.1:43278 - "POST /node/69e1688c7cc280ca7299dd80 HTTP/1.0" 202 Accepted 2026-04-18 22:54:22,462 - lava_callback - INFO - Starting async job submit for node 69e1688c7cc280ca7299dd80 2026-04-18 22:54:22,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:54:22,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1688c7cc280ca7299dd80 HTTP/1.1" 200 None 2026-04-18 22:54:22,478 - lava_callback - DEBUG - Processing node 69e1688c7cc280ca7299dd80: baseline-arm-baylibre 2026-04-18 22:54:22,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1688c7cc280ca7299dd80 2026-04-18 22:54:22,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:54:22,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1688c7cc280ca7299dd80 HTTP/1.1" 200 None 2026-04-18 22:54:22,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:54:22,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:54:22,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:54:22,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1688c7cc280ca7299dd80 HTTP/1.1" 200 None 2026-04-18 22:54:22,524 - lava_callback - ERROR - Error processing callback for node 69e1688c7cc280ca7299dd80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:55:05,524 - lava_callback - INFO - Received callback for node 69e168b47cc280ca7299dd93 INFO: 172.21.0.1:44704 - "POST /node/69e168b47cc280ca7299dd93 HTTP/1.0" 202 Accepted 2026-04-18 22:55:05,530 - lava_callback - INFO - Starting async job submit for node 69e168b47cc280ca7299dd93 2026-04-18 22:55:05,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:05,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e168b47cc280ca7299dd93 HTTP/1.1" 200 None 2026-04-18 22:55:05,550 - lava_callback - DEBUG - Processing node 69e168b47cc280ca7299dd93: baseline-arm-clabbe 2026-04-18 22:55:05,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e168b47cc280ca7299dd93 2026-04-18 22:55:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:05,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e168b47cc280ca7299dd93 HTTP/1.1" 200 None 2026-04-18 22:55:05,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:05,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 22:55:05,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:05,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e168b47cc280ca7299dd93 HTTP/1.1" 200 None 2026-04-18 22:55:05,598 - lava_callback - ERROR - Error processing callback for node 69e168b47cc280ca7299dd93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:55:42,573 - lava_callback - INFO - Received callback for node 69e168de7cc280ca7299dda1 INFO: 172.21.0.1:52538 - "POST /node/69e168de7cc280ca7299dda1 HTTP/1.0" 202 Accepted 2026-04-18 22:55:42,579 - lava_callback - INFO - Starting async job submit for node 69e168de7cc280ca7299dda1 2026-04-18 22:55:42,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e168de7cc280ca7299dda1 HTTP/1.1" 200 None 2026-04-18 22:55:42,595 - lava_callback - DEBUG - Processing node 69e168de7cc280ca7299dda1: baseline-arm64-baylibre 2026-04-18 22:55:42,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e168de7cc280ca7299dda1 2026-04-18 22:55:42,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:42,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e168de7cc280ca7299dda1 HTTP/1.1" 200 None 2026-04-18 22:55:42,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:42,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 22:55:42,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:55:42,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e168de7cc280ca7299dda1 HTTP/1.1" 200 None 2026-04-18 22:55:42,644 - lava_callback - ERROR - Error processing callback for node 69e168de7cc280ca7299dda1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:56:42,583 - lava_callback - INFO - Received callback for node 69e169287cc280ca7299ddcb INFO: 172.21.0.1:36230 - "POST /node/69e169287cc280ca7299ddcb HTTP/1.0" 202 Accepted 2026-04-18 22:56:42,589 - lava_callback - INFO - Starting async job submit for node 69e169287cc280ca7299ddcb 2026-04-18 22:56:42,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:56:42,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169287cc280ca7299ddcb HTTP/1.1" 200 None 2026-04-18 22:56:42,609 - lava_callback - DEBUG - Processing node 69e169287cc280ca7299ddcb: baseline-arm64-baylibre 2026-04-18 22:56:42,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e169287cc280ca7299ddcb 2026-04-18 22:56:42,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:56:42,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169287cc280ca7299ddcb HTTP/1.1" 200 None 2026-04-18 22:56:42,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:56:42,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 22:56:42,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:56:42,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e169287cc280ca7299ddcb HTTP/1.1" 200 None 2026-04-18 22:56:42,676 - lava_callback - ERROR - Error processing callback for node 69e169287cc280ca7299ddcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:58:02,719 - lava_callback - INFO - Received callback for node 69e169717cc280ca7299ddf2 INFO: 172.21.0.1:49756 - "POST /node/69e169717cc280ca7299ddf2 HTTP/1.0" 202 Accepted 2026-04-18 22:58:02,725 - lava_callback - INFO - Starting async job submit for node 69e169717cc280ca7299ddf2 2026-04-18 22:58:02,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:58:02,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169717cc280ca7299ddf2 HTTP/1.1" 200 None 2026-04-18 22:58:02,746 - lava_callback - DEBUG - Processing node 69e169717cc280ca7299ddf2: baseline-arm64-baylibre 2026-04-18 22:58:02,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e169717cc280ca7299ddf2 2026-04-18 22:58:02,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:58:02,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169717cc280ca7299ddf2 HTTP/1.1" 200 None 2026-04-18 22:58:02,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:58:02,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 22:58:02,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:58:02,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e169717cc280ca7299ddf2 HTTP/1.1" 200 None 2026-04-18 22:58:02,793 - lava_callback - ERROR - Error processing callback for node 69e169717cc280ca7299ddf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET /node/69b8a54dfbe29c53ae85f43f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK 2026-04-18 22:59:22,775 - lava_callback - INFO - Received callback for node 69e169bb7cc280ca7299de13 INFO: 172.21.0.1:34954 - "POST /node/69e169bb7cc280ca7299de13 HTTP/1.0" 202 Accepted 2026-04-18 22:59:22,781 - lava_callback - INFO - Starting async job submit for node 69e169bb7cc280ca7299de13 2026-04-18 22:59:22,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:59:22,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169bb7cc280ca7299de13 HTTP/1.1" 200 None 2026-04-18 22:59:22,803 - lava_callback - DEBUG - Processing node 69e169bb7cc280ca7299de13: baseline-arm64-baylibre 2026-04-18 22:59:22,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e169bb7cc280ca7299de13 2026-04-18 22:59:22,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:59:22,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e169bb7cc280ca7299de13 HTTP/1.1" 200 None 2026-04-18 22:59:22,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:59:22,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 22:59:22,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 22:59:22,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e169bb7cc280ca7299de13 HTTP/1.1" 200 None 2026-04-18 22:59:22,851 - lava_callback - ERROR - Error processing callback for node 69e169bb7cc280ca7299de13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:00:42,928 - lava_callback - INFO - Received callback for node 69e16a077cc280ca7299de3e INFO: 172.21.0.1:40436 - "POST /node/69e16a077cc280ca7299de3e HTTP/1.0" 202 Accepted 2026-04-18 23:00:42,934 - lava_callback - INFO - Starting async job submit for node 69e16a077cc280ca7299de3e 2026-04-18 23:00:42,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:00:42,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16a077cc280ca7299de3e HTTP/1.1" 200 None 2026-04-18 23:00:42,955 - lava_callback - DEBUG - Processing node 69e16a077cc280ca7299de3e: baseline-arm64-baylibre 2026-04-18 23:00:42,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16a077cc280ca7299de3e 2026-04-18 23:00:42,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:00:42,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16a077cc280ca7299de3e HTTP/1.1" 200 None 2026-04-18 23:00:42,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:00:42,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:00:42,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:00:43,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16a077cc280ca7299de3e HTTP/1.1" 200 None 2026-04-18 23:00:43,003 - lava_callback - ERROR - Error processing callback for node 69e16a077cc280ca7299de3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:01:42,876 - lava_callback - INFO - Received callback for node 69e16a517cc280ca7299de63 INFO: 172.21.0.1:47188 - "POST /node/69e16a517cc280ca7299de63 HTTP/1.0" 202 Accepted 2026-04-18 23:01:42,882 - lava_callback - INFO - Starting async job submit for node 69e16a517cc280ca7299de63 2026-04-18 23:01:42,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:01:42,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16a517cc280ca7299de63 HTTP/1.1" 200 None 2026-04-18 23:01:42,899 - lava_callback - DEBUG - Processing node 69e16a517cc280ca7299de63: baseline-arm64-baylibre 2026-04-18 23:01:42,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16a517cc280ca7299de63 2026-04-18 23:01:42,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:01:42,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16a517cc280ca7299de63 HTTP/1.1" 200 None 2026-04-18 23:01:42,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:01:42,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:01:42,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:01:42,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16a517cc280ca7299de63 HTTP/1.1" 200 None 2026-04-18 23:01:42,946 - lava_callback - ERROR - Error processing callback for node 69e16a517cc280ca7299de63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:03:05,642 - lava_callback - INFO - Received callback for node 69e16aa27cc280ca7299de8e INFO: 172.21.0.1:47972 - "POST /node/69e16aa27cc280ca7299de8e HTTP/1.0" 202 Accepted 2026-04-18 23:03:05,650 - lava_callback - INFO - Starting async job submit for node 69e16aa27cc280ca7299de8e 2026-04-18 23:03:05,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:03:05,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16aa27cc280ca7299de8e HTTP/1.1" 200 None 2026-04-18 23:03:05,679 - lava_callback - DEBUG - Processing node 69e16aa27cc280ca7299de8e: baseline-arm64-clabbe 2026-04-18 23:03:05,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16aa27cc280ca7299de8e 2026-04-18 23:03:05,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:03:05,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16aa27cc280ca7299de8e HTTP/1.1" 200 None 2026-04-18 23:03:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:03:05,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:03:05,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:03:05,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16aa27cc280ca7299de8e HTTP/1.1" 200 None 2026-04-18 23:03:05,734 - lava_callback - ERROR - Error processing callback for node 69e16aa27cc280ca7299de8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET /node/69862ad1177ca0f097bd21bf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:04:25,752 - lava_callback - INFO - Received callback for node 69e16aee7cc280ca7299debf INFO: 172.21.0.1:54902 - "POST /node/69e16aee7cc280ca7299debf HTTP/1.0" 202 Accepted 2026-04-18 23:04:25,757 - lava_callback - INFO - Starting async job submit for node 69e16aee7cc280ca7299debf 2026-04-18 23:04:25,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:04:25,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16aee7cc280ca7299debf HTTP/1.1" 200 None 2026-04-18 23:04:25,780 - lava_callback - DEBUG - Processing node 69e16aee7cc280ca7299debf: baseline-arm64-clabbe 2026-04-18 23:04:25,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16aee7cc280ca7299debf 2026-04-18 23:04:25,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:04:25,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16aee7cc280ca7299debf HTTP/1.1" 200 None 2026-04-18 23:04:25,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:04:25,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:04:25,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:04:25,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16aee7cc280ca7299debf HTTP/1.1" 200 None 2026-04-18 23:04:25,828 - lava_callback - ERROR - Error processing callback for node 69e16aee7cc280ca7299debf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:05:45,745 - lava_callback - INFO - Received callback for node 69e16b397cc280ca7299dedf INFO: 172.21.0.1:38700 - "POST /node/69e16b397cc280ca7299dedf HTTP/1.0" 202 Accepted 2026-04-18 23:05:45,751 - lava_callback - INFO - Starting async job submit for node 69e16b397cc280ca7299dedf 2026-04-18 23:05:45,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:05:45,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16b397cc280ca7299dedf HTTP/1.1" 200 None 2026-04-18 23:05:45,767 - lava_callback - DEBUG - Processing node 69e16b397cc280ca7299dedf: baseline-arm64-clabbe 2026-04-18 23:05:45,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16b397cc280ca7299dedf 2026-04-18 23:05:45,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:05:45,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16b397cc280ca7299dedf HTTP/1.1" 200 None 2026-04-18 23:05:45,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:05:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:05:45,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:05:45,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16b397cc280ca7299dedf HTTP/1.1" 200 None 2026-04-18 23:05:45,827 - lava_callback - ERROR - Error processing callback for node 69e16b397cc280ca7299dedf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET /node/6988c1079fc35f969e1edaac%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-18 23:07:05,825 - lava_callback - INFO - Received callback for node 69e16b857cc280ca7299df08 INFO: 172.21.0.1:36400 - "POST /node/69e16b857cc280ca7299df08 HTTP/1.0" 202 Accepted 2026-04-18 23:07:05,830 - lava_callback - INFO - Starting async job submit for node 69e16b857cc280ca7299df08 2026-04-18 23:07:05,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:07:05,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16b857cc280ca7299df08 HTTP/1.1" 200 None 2026-04-18 23:07:05,848 - lava_callback - DEBUG - Processing node 69e16b857cc280ca7299df08: baseline-arm64-clabbe 2026-04-18 23:07:05,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16b857cc280ca7299df08 2026-04-18 23:07:05,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:07:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16b857cc280ca7299df08 HTTP/1.1" 200 None 2026-04-18 23:07:05,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:07:05,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:07:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:07:05,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16b857cc280ca7299df08 HTTP/1.1" 200 None 2026-04-18 23:07:05,900 - lava_callback - ERROR - Error processing callback for node 69e16b857cc280ca7299df08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:08:05,929 - lava_callback - INFO - Received callback for node 69e16bd17cc280ca7299df29 INFO: 172.21.0.1:43428 - "POST /node/69e16bd17cc280ca7299df29 HTTP/1.0" 202 Accepted 2026-04-18 23:08:05,935 - lava_callback - INFO - Starting async job submit for node 69e16bd17cc280ca7299df29 2026-04-18 23:08:05,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:08:05,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16bd17cc280ca7299df29 HTTP/1.1" 200 None 2026-04-18 23:08:05,951 - lava_callback - DEBUG - Processing node 69e16bd17cc280ca7299df29: baseline-arm64-clabbe 2026-04-18 23:08:05,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16bd17cc280ca7299df29 2026-04-18 23:08:05,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:08:05,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16bd17cc280ca7299df29 HTTP/1.1" 200 None 2026-04-18 23:08:05,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:08:05,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:08:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:08:05,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16bd17cc280ca7299df29 HTTP/1.1" 200 None 2026-04-18 23:08:06,000 - lava_callback - ERROR - Error processing callback for node 69e16bd17cc280ca7299df29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:09:25,931 - lava_callback - INFO - Received callback for node 69e16c1b7cc280ca7299df52 INFO: 172.21.0.1:47126 - "POST /node/69e16c1b7cc280ca7299df52 HTTP/1.0" 202 Accepted 2026-04-18 23:09:25,937 - lava_callback - INFO - Starting async job submit for node 69e16c1b7cc280ca7299df52 2026-04-18 23:09:25,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:09:25,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c1b7cc280ca7299df52 HTTP/1.1" 200 None 2026-04-18 23:09:25,953 - lava_callback - DEBUG - Processing node 69e16c1b7cc280ca7299df52: baseline-arm64-clabbe 2026-04-18 23:09:25,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16c1b7cc280ca7299df52 2026-04-18 23:09:25,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:09:25,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c1b7cc280ca7299df52 HTTP/1.1" 200 None 2026-04-18 23:09:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:09:25,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:09:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:09:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16c1b7cc280ca7299df52 HTTP/1.1" 200 None 2026-04-18 23:09:26,004 - lava_callback - ERROR - Error processing callback for node 69e16c1b7cc280ca7299df52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:10:45,963 - lava_callback - INFO - Received callback for node 69e16c667cc280ca7299df71 INFO: 172.21.0.1:39050 - "POST /node/69e16c667cc280ca7299df71 HTTP/1.0" 202 Accepted 2026-04-18 23:10:45,968 - lava_callback - INFO - Starting async job submit for node 69e16c667cc280ca7299df71 2026-04-18 23:10:45,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:10:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c667cc280ca7299df71 HTTP/1.1" 200 None 2026-04-18 23:10:45,984 - lava_callback - DEBUG - Processing node 69e16c667cc280ca7299df71: baseline-arm64-clabbe 2026-04-18 23:10:45,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16c667cc280ca7299df71 2026-04-18 23:10:45,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:10:45,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c667cc280ca7299df71 HTTP/1.1" 200 None 2026-04-18 23:10:45,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:10:46,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-18 23:10:46,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:10:46,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16c667cc280ca7299df71 HTTP/1.1" 200 None 2026-04-18 23:10:46,042 - lava_callback - ERROR - Error processing callback for node 69e16c667cc280ca7299df71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:11:43,435 - lava_callback - INFO - Received callback for node 69e16c9f7cc280ca7299df94 INFO: 172.21.0.1:40572 - "POST /node/69e16c9f7cc280ca7299df94 HTTP/1.0" 202 Accepted 2026-04-18 23:11:43,441 - lava_callback - INFO - Starting async job submit for node 69e16c9f7cc280ca7299df94 2026-04-18 23:11:43,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:11:43,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c9f7cc280ca7299df94 HTTP/1.1" 200 None 2026-04-18 23:11:43,457 - lava_callback - DEBUG - Processing node 69e16c9f7cc280ca7299df94: baseline-arm-baylibre 2026-04-18 23:11:43,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16c9f7cc280ca7299df94 2026-04-18 23:11:43,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:11:43,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16c9f7cc280ca7299df94 HTTP/1.1" 200 None 2026-04-18 23:11:43,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:11:43,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:11:43,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:11:43,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16c9f7cc280ca7299df94 HTTP/1.1" 200 None 2026-04-18 23:11:43,519 - lava_callback - ERROR - Error processing callback for node 69e16c9f7cc280ca7299df94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:12:25,999 - lava_callback - INFO - Received callback for node 69e16cc67cc280ca7299dfa4 INFO: 172.21.0.1:43134 - "POST /node/69e16cc67cc280ca7299dfa4 HTTP/1.0" 202 Accepted 2026-04-18 23:12:26,005 - lava_callback - INFO - Starting async job submit for node 69e16cc67cc280ca7299dfa4 2026-04-18 23:12:26,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:26,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16cc67cc280ca7299dfa4 HTTP/1.1" 200 None 2026-04-18 23:12:26,021 - lava_callback - DEBUG - Processing node 69e16cc67cc280ca7299dfa4: baseline-arm-clabbe 2026-04-18 23:12:26,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16cc67cc280ca7299dfa4 2026-04-18 23:12:26,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:26,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16cc67cc280ca7299dfa4 HTTP/1.1" 200 None 2026-04-18 23:12:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:26,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:12:26,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:26,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16cc67cc280ca7299dfa4 HTTP/1.1" 200 None 2026-04-18 23:12:26,076 - lava_callback - ERROR - Error processing callback for node 69e16cc67cc280ca7299dfa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:12:43,400 - lava_callback - INFO - Received callback for node 69e16ce87cc280ca7299dfb3 INFO: 172.21.0.1:42362 - "POST /node/69e16ce87cc280ca7299dfb3 HTTP/1.0" 202 Accepted 2026-04-18 23:12:43,406 - lava_callback - INFO - Starting async job submit for node 69e16ce87cc280ca7299dfb3 2026-04-18 23:12:43,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:43,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ce87cc280ca7299dfb3 HTTP/1.1" 200 None 2026-04-18 23:12:43,429 - lava_callback - DEBUG - Processing node 69e16ce87cc280ca7299dfb3: baseline-arm-baylibre 2026-04-18 23:12:43,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16ce87cc280ca7299dfb3 2026-04-18 23:12:43,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:43,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ce87cc280ca7299dfb3 HTTP/1.1" 200 None 2026-04-18 23:12:43,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:43,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:12:43,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:12:43,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16ce87cc280ca7299dfb3 HTTP/1.1" 200 None 2026-04-18 23:12:43,479 - lava_callback - ERROR - Error processing callback for node 69e16ce87cc280ca7299dfb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:13:26,096 - lava_callback - INFO - Received callback for node 69e16d0f7cc280ca7299dfbe INFO: 172.21.0.1:59910 - "POST /node/69e16d0f7cc280ca7299dfbe HTTP/1.0" 202 Accepted 2026-04-18 23:13:26,101 - lava_callback - INFO - Starting async job submit for node 69e16d0f7cc280ca7299dfbe 2026-04-18 23:13:26,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:13:26,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d0f7cc280ca7299dfbe HTTP/1.1" 200 None 2026-04-18 23:13:26,117 - lava_callback - DEBUG - Processing node 69e16d0f7cc280ca7299dfbe: baseline-arm-clabbe 2026-04-18 23:13:26,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16d0f7cc280ca7299dfbe 2026-04-18 23:13:26,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:13:26,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d0f7cc280ca7299dfbe HTTP/1.1" 200 None 2026-04-18 23:13:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:13:26,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:13:26,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:13:26,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16d0f7cc280ca7299dfbe HTTP/1.1" 200 None 2026-04-18 23:13:26,166 - lava_callback - ERROR - Error processing callback for node 69e16d0f7cc280ca7299dfbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:14:03,487 - lava_callback - INFO - Received callback for node 69e16d327cc280ca7299dfcb INFO: 172.21.0.1:33748 - "POST /node/69e16d327cc280ca7299dfcb HTTP/1.0" 202 Accepted 2026-04-18 23:14:03,492 - lava_callback - INFO - Starting async job submit for node 69e16d327cc280ca7299dfcb 2026-04-18 23:14:03,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:03,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d327cc280ca7299dfcb HTTP/1.1" 200 None 2026-04-18 23:14:03,509 - lava_callback - DEBUG - Processing node 69e16d327cc280ca7299dfcb: baseline-arm-baylibre 2026-04-18 23:14:03,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16d327cc280ca7299dfcb 2026-04-18 23:14:03,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:03,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d327cc280ca7299dfcb HTTP/1.1" 200 None 2026-04-18 23:14:03,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:03,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:14:03,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:03,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16d327cc280ca7299dfcb HTTP/1.1" 200 None 2026-04-18 23:14:03,563 - lava_callback - ERROR - Error processing callback for node 69e16d327cc280ca7299dfcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:14:46,082 - lava_callback - INFO - Received callback for node 69e16d587cc280ca7299dfd8 INFO: 172.21.0.1:46432 - "POST /node/69e16d587cc280ca7299dfd8 HTTP/1.0" 202 Accepted 2026-04-18 23:14:46,087 - lava_callback - INFO - Starting async job submit for node 69e16d587cc280ca7299dfd8 2026-04-18 23:14:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:46,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d587cc280ca7299dfd8 HTTP/1.1" 200 None 2026-04-18 23:14:46,103 - lava_callback - DEBUG - Processing node 69e16d587cc280ca7299dfd8: baseline-arm-clabbe 2026-04-18 23:14:46,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16d587cc280ca7299dfd8 2026-04-18 23:14:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:46,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d587cc280ca7299dfd8 HTTP/1.1" 200 None 2026-04-18 23:14:46,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:46,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:14:46,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:14:46,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16d587cc280ca7299dfd8 HTTP/1.1" 200 None 2026-04-18 23:14:46,175 - lava_callback - ERROR - Error processing callback for node 69e16d587cc280ca7299dfd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:15:26,095 - lava_callback - INFO - Received callback for node 69e16d7d7cc280ca7299dfea INFO: 172.21.0.1:34020 - "POST /node/69e16d7d7cc280ca7299dfea HTTP/1.0" 202 Accepted 2026-04-18 23:15:26,101 - lava_callback - INFO - Starting async job submit for node 69e16d7d7cc280ca7299dfea 2026-04-18 23:15:26,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:15:26,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d7d7cc280ca7299dfea HTTP/1.1" 200 None 2026-04-18 23:15:26,117 - lava_callback - DEBUG - Processing node 69e16d7d7cc280ca7299dfea: baseline-arm-clabbe 2026-04-18 23:15:26,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16d7d7cc280ca7299dfea 2026-04-18 23:15:26,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:15:26,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16d7d7cc280ca7299dfea HTTP/1.1" 200 None 2026-04-18 23:15:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:15:26,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:15:26,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:15:26,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16d7d7cc280ca7299dfea HTTP/1.1" 200 None 2026-04-18 23:15:26,167 - lava_callback - ERROR - Error processing callback for node 69e16d7d7cc280ca7299dfea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:16:06,156 - lava_callback - INFO - Received callback for node 69e16da37cc280ca7299dff5 INFO: 172.21.0.1:36640 - "POST /node/69e16da37cc280ca7299dff5 HTTP/1.0" 202 Accepted 2026-04-18 23:16:06,162 - lava_callback - INFO - Starting async job submit for node 69e16da37cc280ca7299dff5 2026-04-18 23:16:06,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:06,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16da37cc280ca7299dff5 HTTP/1.1" 200 None 2026-04-18 23:16:06,177 - lava_callback - DEBUG - Processing node 69e16da37cc280ca7299dff5: baseline-arm-clabbe 2026-04-18 23:16:06,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16da37cc280ca7299dff5 2026-04-18 23:16:06,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16da37cc280ca7299dff5 HTTP/1.1" 200 None 2026-04-18 23:16:06,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:06,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:16:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:06,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16da37cc280ca7299dff5 HTTP/1.1" 200 None 2026-04-18 23:16:06,227 - lava_callback - ERROR - Error processing callback for node 69e16da37cc280ca7299dff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:16:46,136 - lava_callback - INFO - Received callback for node 69e16dc77cc280ca7299e003 INFO: 172.21.0.1:46002 - "POST /node/69e16dc77cc280ca7299e003 HTTP/1.0" 202 Accepted 2026-04-18 23:16:46,141 - lava_callback - INFO - Starting async job submit for node 69e16dc77cc280ca7299e003 2026-04-18 23:16:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:46,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16dc77cc280ca7299e003 HTTP/1.1" 200 None 2026-04-18 23:16:46,158 - lava_callback - DEBUG - Processing node 69e16dc77cc280ca7299e003: baseline-arm-clabbe 2026-04-18 23:16:46,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16dc77cc280ca7299e003 2026-04-18 23:16:46,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:46,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16dc77cc280ca7299e003 HTTP/1.1" 200 None 2026-04-18 23:16:46,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:46,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:16:46,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:16:46,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16dc77cc280ca7299e003 HTTP/1.1" 200 None 2026-04-18 23:16:46,205 - lava_callback - ERROR - Error processing callback for node 69e16dc77cc280ca7299e003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:17:06,170 - lava_callback - INFO - Received callback for node 69e16deb7cc280ca7299e011 INFO: 172.21.0.1:49648 - "POST /node/69e16deb7cc280ca7299e011 HTTP/1.0" 202 Accepted 2026-04-18 23:17:06,176 - lava_callback - INFO - Starting async job submit for node 69e16deb7cc280ca7299e011 2026-04-18 23:17:06,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16deb7cc280ca7299e011 HTTP/1.1" 200 None 2026-04-18 23:17:06,191 - lava_callback - DEBUG - Processing node 69e16deb7cc280ca7299e011: baseline-arm-clabbe 2026-04-18 23:17:06,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16deb7cc280ca7299e011 2026-04-18 23:17:06,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:06,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16deb7cc280ca7299e011 HTTP/1.1" 200 None 2026-04-18 23:17:06,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:06,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:17:06,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:06,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16deb7cc280ca7299e011 HTTP/1.1" 200 None 2026-04-18 23:17:06,237 - lava_callback - ERROR - Error processing callback for node 69e16deb7cc280ca7299e011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:17:46,183 - lava_callback - INFO - Received callback for node 69e16e107cc280ca7299e020 INFO: 172.21.0.1:39960 - "POST /node/69e16e107cc280ca7299e020 HTTP/1.0" 202 Accepted 2026-04-18 23:17:46,188 - lava_callback - INFO - Starting async job submit for node 69e16e107cc280ca7299e020 2026-04-18 23:17:46,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:46,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e107cc280ca7299e020 HTTP/1.1" 200 None 2026-04-18 23:17:46,204 - lava_callback - DEBUG - Processing node 69e16e107cc280ca7299e020: baseline-arm-clabbe 2026-04-18 23:17:46,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16e107cc280ca7299e020 2026-04-18 23:17:46,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:46,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e107cc280ca7299e020 HTTP/1.1" 200 None 2026-04-18 23:17:46,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:46,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:17:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:17:46,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16e107cc280ca7299e020 HTTP/1.1" 200 None 2026-04-18 23:17:46,254 - lava_callback - ERROR - Error processing callback for node 69e16e107cc280ca7299e020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:18:26,206 - lava_callback - INFO - Received callback for node 69e16e357cc280ca7299e032 INFO: 172.21.0.1:39412 - "POST /node/69e16e357cc280ca7299e032 HTTP/1.0" 202 Accepted 2026-04-18 23:18:26,212 - lava_callback - INFO - Starting async job submit for node 69e16e357cc280ca7299e032 2026-04-18 23:18:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:18:26,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e357cc280ca7299e032 HTTP/1.1" 200 None 2026-04-18 23:18:26,237 - lava_callback - DEBUG - Processing node 69e16e357cc280ca7299e032: baseline-arm-clabbe 2026-04-18 23:18:26,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16e357cc280ca7299e032 2026-04-18 23:18:26,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:18:26,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e357cc280ca7299e032 HTTP/1.1" 200 None 2026-04-18 23:18:26,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:18:26,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:18:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:18:26,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16e357cc280ca7299e032 HTTP/1.1" 200 None 2026-04-18 23:18:26,287 - lava_callback - ERROR - Error processing callback for node 69e16e357cc280ca7299e032: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:19:06,196 - lava_callback - INFO - Received callback for node 69e16e5a7cc280ca7299e03d INFO: 172.21.0.1:48966 - "POST /node/69e16e5a7cc280ca7299e03d HTTP/1.0" 202 Accepted 2026-04-18 23:19:06,203 - lava_callback - INFO - Starting async job submit for node 69e16e5a7cc280ca7299e03d 2026-04-18 23:19:06,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:06,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e5a7cc280ca7299e03d HTTP/1.1" 200 None 2026-04-18 23:19:06,220 - lava_callback - DEBUG - Processing node 69e16e5a7cc280ca7299e03d: baseline-arm-clabbe 2026-04-18 23:19:06,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16e5a7cc280ca7299e03d 2026-04-18 23:19:06,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:06,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e5a7cc280ca7299e03d HTTP/1.1" 200 None 2026-04-18 23:19:06,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:06,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:19:06,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:06,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16e5a7cc280ca7299e03d HTTP/1.1" 200 None 2026-04-18 23:19:06,269 - lava_callback - ERROR - Error processing callback for node 69e16e5a7cc280ca7299e03d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:19:46,273 - lava_callback - INFO - Received callback for node 69e16e7f7cc280ca7299e04e INFO: 172.21.0.1:37054 - "POST /node/69e16e7f7cc280ca7299e04e HTTP/1.0" 202 Accepted 2026-04-18 23:19:46,278 - lava_callback - INFO - Starting async job submit for node 69e16e7f7cc280ca7299e04e 2026-04-18 23:19:46,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:46,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e7f7cc280ca7299e04e HTTP/1.1" 200 None 2026-04-18 23:19:46,294 - lava_callback - DEBUG - Processing node 69e16e7f7cc280ca7299e04e: baseline-arm-clabbe 2026-04-18 23:19:46,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16e7f7cc280ca7299e04e 2026-04-18 23:19:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:46,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16e7f7cc280ca7299e04e HTTP/1.1" 200 None 2026-04-18 23:19:46,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:46,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:19:46,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:19:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16e7f7cc280ca7299e04e HTTP/1.1" 200 None 2026-04-18 23:19:46,344 - lava_callback - ERROR - Error processing callback for node 69e16e7f7cc280ca7299e04e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:20:26,250 - lava_callback - INFO - Received callback for node 69e16ea57cc280ca7299e05c INFO: 172.21.0.1:57982 - "POST /node/69e16ea57cc280ca7299e05c HTTP/1.0" 202 Accepted 2026-04-18 23:20:26,256 - lava_callback - INFO - Starting async job submit for node 69e16ea57cc280ca7299e05c 2026-04-18 23:20:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:26,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ea57cc280ca7299e05c HTTP/1.1" 200 None 2026-04-18 23:20:26,280 - lava_callback - DEBUG - Processing node 69e16ea57cc280ca7299e05c: baseline-arm-clabbe 2026-04-18 23:20:26,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16ea57cc280ca7299e05c 2026-04-18 23:20:26,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:26,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ea57cc280ca7299e05c HTTP/1.1" 200 None 2026-04-18 23:20:26,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:26,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:20:26,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:26,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16ea57cc280ca7299e05c HTTP/1.1" 200 None 2026-04-18 23:20:26,328 - lava_callback - ERROR - Error processing callback for node 69e16ea57cc280ca7299e05c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:20:46,324 - lava_callback - INFO - Received callback for node 69e16eca7cc280ca7299e06a INFO: 172.21.0.1:33208 - "POST /node/69e16eca7cc280ca7299e06a HTTP/1.0" 202 Accepted 2026-04-18 23:20:46,333 - lava_callback - INFO - Starting async job submit for node 69e16eca7cc280ca7299e06a 2026-04-18 23:20:46,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:46,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16eca7cc280ca7299e06a HTTP/1.1" 200 None 2026-04-18 23:20:46,351 - lava_callback - DEBUG - Processing node 69e16eca7cc280ca7299e06a: baseline-arm-clabbe 2026-04-18 23:20:46,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16eca7cc280ca7299e06a 2026-04-18 23:20:46,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:46,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16eca7cc280ca7299e06a HTTP/1.1" 200 None 2026-04-18 23:20:46,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:46,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:20:46,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:20:46,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16eca7cc280ca7299e06a HTTP/1.1" 200 None 2026-04-18 23:20:46,420 - lava_callback - ERROR - Error processing callback for node 69e16eca7cc280ca7299e06a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:21:26,337 - lava_callback - INFO - Received callback for node 69e16eef7cc280ca7299e075 INFO: 172.21.0.1:57688 - "POST /node/69e16eef7cc280ca7299e075 HTTP/1.0" 202 Accepted 2026-04-18 23:21:26,346 - lava_callback - INFO - Starting async job submit for node 69e16eef7cc280ca7299e075 2026-04-18 23:21:26,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:21:26,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16eef7cc280ca7299e075 HTTP/1.1" 200 None 2026-04-18 23:21:26,364 - lava_callback - DEBUG - Processing node 69e16eef7cc280ca7299e075: baseline-arm-clabbe 2026-04-18 23:21:26,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16eef7cc280ca7299e075 2026-04-18 23:21:26,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:21:26,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16eef7cc280ca7299e075 HTTP/1.1" 200 None 2026-04-18 23:21:26,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:21:26,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:21:26,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:21:26,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16eef7cc280ca7299e075 HTTP/1.1" 200 None 2026-04-18 23:21:26,440 - lava_callback - ERROR - Error processing callback for node 69e16eef7cc280ca7299e075: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:22:06,385 - lava_callback - INFO - Received callback for node 69e16f147cc280ca7299e083 INFO: 172.21.0.1:36656 - "POST /node/69e16f147cc280ca7299e083 HTTP/1.0" 202 Accepted 2026-04-18 23:22:06,391 - lava_callback - INFO - Starting async job submit for node 69e16f147cc280ca7299e083 2026-04-18 23:22:06,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:06,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f147cc280ca7299e083 HTTP/1.1" 200 None 2026-04-18 23:22:06,407 - lava_callback - DEBUG - Processing node 69e16f147cc280ca7299e083: baseline-arm-clabbe 2026-04-18 23:22:06,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16f147cc280ca7299e083 2026-04-18 23:22:06,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:06,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f147cc280ca7299e083 HTTP/1.1" 200 None 2026-04-18 23:22:06,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:06,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:22:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16f147cc280ca7299e083 HTTP/1.1" 200 None 2026-04-18 23:22:06,459 - lava_callback - ERROR - Error processing callback for node 69e16f147cc280ca7299e083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:22:46,390 - lava_callback - INFO - Received callback for node 69e16f387cc280ca7299e094 INFO: 172.21.0.1:32940 - "POST /node/69e16f387cc280ca7299e094 HTTP/1.0" 202 Accepted 2026-04-18 23:22:46,395 - lava_callback - INFO - Starting async job submit for node 69e16f387cc280ca7299e094 2026-04-18 23:22:46,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:46,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f387cc280ca7299e094 HTTP/1.1" 200 None 2026-04-18 23:22:46,430 - lava_callback - DEBUG - Processing node 69e16f387cc280ca7299e094: baseline-arm-clabbe 2026-04-18 23:22:46,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16f387cc280ca7299e094 2026-04-18 23:22:46,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:46,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f387cc280ca7299e094 HTTP/1.1" 200 None 2026-04-18 23:22:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:46,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:22:46,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:22:46,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16f387cc280ca7299e094 HTTP/1.1" 200 None 2026-04-18 23:22:46,478 - lava_callback - ERROR - Error processing callback for node 69e16f387cc280ca7299e094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:23:26,487 - lava_callback - INFO - Received callback for node 69e16f5d7cc280ca7299e0a5 INFO: 172.21.0.1:33812 - "POST /node/69e16f5d7cc280ca7299e0a5 HTTP/1.0" 202 Accepted 2026-04-18 23:23:26,493 - lava_callback - INFO - Starting async job submit for node 69e16f5d7cc280ca7299e0a5 2026-04-18 23:23:26,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:23:26,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f5d7cc280ca7299e0a5 HTTP/1.1" 200 None 2026-04-18 23:23:26,510 - lava_callback - DEBUG - Processing node 69e16f5d7cc280ca7299e0a5: baseline-arm-clabbe 2026-04-18 23:23:26,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16f5d7cc280ca7299e0a5 2026-04-18 23:23:26,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:23:26,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f5d7cc280ca7299e0a5 HTTP/1.1" 200 None 2026-04-18 23:23:26,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:23:26,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:23:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:23:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16f5d7cc280ca7299e0a5 HTTP/1.1" 200 None 2026-04-18 23:23:26,557 - lava_callback - ERROR - Error processing callback for node 69e16f5d7cc280ca7299e0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:24:06,420 - lava_callback - INFO - Received callback for node 69e16f827cc280ca7299e0af INFO: 172.21.0.1:44978 - "POST /node/69e16f827cc280ca7299e0af HTTP/1.0" 202 Accepted 2026-04-18 23:24:06,426 - lava_callback - INFO - Starting async job submit for node 69e16f827cc280ca7299e0af 2026-04-18 23:24:06,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:06,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f827cc280ca7299e0af HTTP/1.1" 200 None 2026-04-18 23:24:06,441 - lava_callback - DEBUG - Processing node 69e16f827cc280ca7299e0af: baseline-arm-clabbe 2026-04-18 23:24:06,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16f827cc280ca7299e0af 2026-04-18 23:24:06,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:06,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16f827cc280ca7299e0af HTTP/1.1" 200 None 2026-04-18 23:24:06,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:06,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:24:06,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:06,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16f827cc280ca7299e0af HTTP/1.1" 200 None 2026-04-18 23:24:06,499 - lava_callback - ERROR - Error processing callback for node 69e16f827cc280ca7299e0af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:24:26,454 - lava_callback - INFO - Received callback for node 69e16fa77cc280ca7299e0bf INFO: 172.21.0.1:43516 - "POST /node/69e16fa77cc280ca7299e0bf HTTP/1.0" 202 Accepted 2026-04-18 23:24:26,460 - lava_callback - INFO - Starting async job submit for node 69e16fa77cc280ca7299e0bf 2026-04-18 23:24:26,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:26,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16fa77cc280ca7299e0bf HTTP/1.1" 200 None 2026-04-18 23:24:26,482 - lava_callback - DEBUG - Processing node 69e16fa77cc280ca7299e0bf: baseline-arm-clabbe 2026-04-18 23:24:26,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16fa77cc280ca7299e0bf 2026-04-18 23:24:26,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:24:26,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16fa77cc280ca7299e0bf HTTP/1.1" 200 None 2026-04-18 23:24:26,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:26,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:24:26,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:24:26,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16fa77cc280ca7299e0bf HTTP/1.1" 200 None 2026-04-18 23:24:26,530 - lava_callback - ERROR - Error processing callback for node 69e16fa77cc280ca7299e0bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:25:06,478 - lava_callback - INFO - Received callback for node 69e16fcb7cc280ca7299e0cc INFO: 172.21.0.1:54690 - "POST /node/69e16fcb7cc280ca7299e0cc HTTP/1.0" 202 Accepted 2026-04-18 23:25:06,483 - lava_callback - INFO - Starting async job submit for node 69e16fcb7cc280ca7299e0cc 2026-04-18 23:25:06,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:06,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16fcb7cc280ca7299e0cc HTTP/1.1" 200 None 2026-04-18 23:25:06,502 - lava_callback - DEBUG - Processing node 69e16fcb7cc280ca7299e0cc: baseline-arm-clabbe 2026-04-18 23:25:06,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16fcb7cc280ca7299e0cc 2026-04-18 23:25:06,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:06,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16fcb7cc280ca7299e0cc HTTP/1.1" 200 None 2026-04-18 23:25:06,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:25:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:25:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:06,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16fcb7cc280ca7299e0cc HTTP/1.1" 200 None 2026-04-18 23:25:06,560 - lava_callback - ERROR - Error processing callback for node 69e16fcb7cc280ca7299e0cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:25:46,548 - lava_callback - INFO - Received callback for node 69e16ff07cc280ca7299e0da INFO: 172.21.0.1:57744 - "POST /node/69e16ff07cc280ca7299e0da HTTP/1.0" 202 Accepted 2026-04-18 23:25:46,554 - lava_callback - INFO - Starting async job submit for node 69e16ff07cc280ca7299e0da 2026-04-18 23:25:46,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:46,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ff07cc280ca7299e0da HTTP/1.1" 200 None 2026-04-18 23:25:46,594 - lava_callback - DEBUG - Processing node 69e16ff07cc280ca7299e0da: baseline-arm-clabbe 2026-04-18 23:25:46,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e16ff07cc280ca7299e0da 2026-04-18 23:25:46,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:46,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e16ff07cc280ca7299e0da HTTP/1.1" 200 None 2026-04-18 23:25:46,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:25:46,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:25:46,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e16ff07cc280ca7299e0da HTTP/1.1" 200 None 2026-04-18 23:25:46,676 - lava_callback - ERROR - Error processing callback for node 69e16ff07cc280ca7299e0da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:26:26,511 - lava_callback - INFO - Received callback for node 69e170157cc280ca7299e0ec INFO: 172.21.0.1:49536 - "POST /node/69e170157cc280ca7299e0ec HTTP/1.0" 202 Accepted 2026-04-18 23:26:26,517 - lava_callback - INFO - Starting async job submit for node 69e170157cc280ca7299e0ec 2026-04-18 23:26:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:26:26,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170157cc280ca7299e0ec HTTP/1.1" 200 None 2026-04-18 23:26:26,532 - lava_callback - DEBUG - Processing node 69e170157cc280ca7299e0ec: baseline-arm-clabbe 2026-04-18 23:26:26,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e170157cc280ca7299e0ec 2026-04-18 23:26:26,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:26:26,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170157cc280ca7299e0ec HTTP/1.1" 200 None 2026-04-18 23:26:26,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:26:26,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:26:26,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:26:26,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e170157cc280ca7299e0ec HTTP/1.1" 200 None 2026-04-18 23:26:26,580 - lava_callback - ERROR - Error processing callback for node 69e170157cc280ca7299e0ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:27:06,543 - lava_callback - INFO - Received callback for node 69e170397cc280ca7299e0f7 INFO: 172.21.0.1:41382 - "POST /node/69e170397cc280ca7299e0f7 HTTP/1.0" 202 Accepted 2026-04-18 23:27:06,548 - lava_callback - INFO - Starting async job submit for node 69e170397cc280ca7299e0f7 2026-04-18 23:27:06,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170397cc280ca7299e0f7 HTTP/1.1" 200 None 2026-04-18 23:27:06,564 - lava_callback - DEBUG - Processing node 69e170397cc280ca7299e0f7: baseline-arm-clabbe 2026-04-18 23:27:06,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e170397cc280ca7299e0f7 2026-04-18 23:27:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:06,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170397cc280ca7299e0f7 HTTP/1.1" 200 None 2026-04-18 23:27:06,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:27:06,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:06,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e170397cc280ca7299e0f7 HTTP/1.1" 200 None 2026-04-18 23:27:06,618 - lava_callback - ERROR - Error processing callback for node 69e170397cc280ca7299e0f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:27:46,568 - lava_callback - INFO - Received callback for node 69e1705e7cc280ca7299e105 INFO: 172.21.0.1:49138 - "POST /node/69e1705e7cc280ca7299e105 HTTP/1.0" 202 Accepted 2026-04-18 23:27:46,576 - lava_callback - INFO - Starting async job submit for node 69e1705e7cc280ca7299e105 2026-04-18 23:27:46,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:46,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1705e7cc280ca7299e105 HTTP/1.1" 200 None 2026-04-18 23:27:46,593 - lava_callback - DEBUG - Processing node 69e1705e7cc280ca7299e105: baseline-arm-clabbe 2026-04-18 23:27:46,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1705e7cc280ca7299e105 2026-04-18 23:27:46,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:46,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1705e7cc280ca7299e105 HTTP/1.1" 200 None 2026-04-18 23:27:46,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:46,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:27:46,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:27:46,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1705e7cc280ca7299e105 HTTP/1.1" 200 None 2026-04-18 23:27:46,664 - lava_callback - ERROR - Error processing callback for node 69e1705e7cc280ca7299e105: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:28:06,555 - lava_callback - INFO - Received callback for node 69e170837cc280ca7299e111 INFO: 172.21.0.1:33562 - "POST /node/69e170837cc280ca7299e111 HTTP/1.0" 202 Accepted 2026-04-18 23:28:06,560 - lava_callback - INFO - Starting async job submit for node 69e170837cc280ca7299e111 2026-04-18 23:28:06,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170837cc280ca7299e111 HTTP/1.1" 200 None 2026-04-18 23:28:06,575 - lava_callback - DEBUG - Processing node 69e170837cc280ca7299e111: baseline-arm-clabbe 2026-04-18 23:28:06,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e170837cc280ca7299e111 2026-04-18 23:28:06,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:06,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170837cc280ca7299e111 HTTP/1.1" 200 None 2026-04-18 23:28:06,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:06,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:28:06,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e170837cc280ca7299e111 HTTP/1.1" 200 None 2026-04-18 23:28:06,624 - lava_callback - ERROR - Error processing callback for node 69e170837cc280ca7299e111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:28:46,591 - lava_callback - INFO - Received callback for node 69e170a87cc280ca7299e121 INFO: 172.21.0.1:44404 - "POST /node/69e170a87cc280ca7299e121 HTTP/1.0" 202 Accepted 2026-04-18 23:28:46,596 - lava_callback - INFO - Starting async job submit for node 69e170a87cc280ca7299e121 2026-04-18 23:28:46,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:46,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170a87cc280ca7299e121 HTTP/1.1" 200 None 2026-04-18 23:28:46,637 - lava_callback - DEBUG - Processing node 69e170a87cc280ca7299e121: baseline-arm-clabbe 2026-04-18 23:28:46,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e170a87cc280ca7299e121 2026-04-18 23:28:46,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:46,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e170a87cc280ca7299e121 HTTP/1.1" 200 None 2026-04-18 23:28:46,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:46,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-18 23:28:46,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:28:46,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e170a87cc280ca7299e121 HTTP/1.1" 200 None 2026-04-18 23:28:46,727 - lava_callback - ERROR - Error processing callback for node 69e170a87cc280ca7299e121: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:30:44,441 - lava_callback - INFO - Received callback for node 69e171137cc280ca7299e133 INFO: 172.21.0.1:43774 - "POST /node/69e171137cc280ca7299e133 HTTP/1.0" 202 Accepted 2026-04-18 23:30:44,447 - lava_callback - INFO - Starting async job submit for node 69e171137cc280ca7299e133 2026-04-18 23:30:44,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:30:44,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171137cc280ca7299e133 HTTP/1.1" 200 None 2026-04-18 23:30:44,462 - lava_callback - DEBUG - Processing node 69e171137cc280ca7299e133: baseline-arm64-baylibre 2026-04-18 23:30:44,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e171137cc280ca7299e133 2026-04-18 23:30:44,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:30:44,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171137cc280ca7299e133 HTTP/1.1" 200 None 2026-04-18 23:30:44,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:30:44,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:30:44,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:30:44,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e171137cc280ca7299e133 HTTP/1.1" 200 None 2026-04-18 23:30:44,514 - lava_callback - ERROR - Error processing callback for node 69e171137cc280ca7299e133: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:32:04,478 - lava_callback - INFO - Received callback for node 69e171607cc280ca7299e15e INFO: 172.21.0.1:58076 - "POST /node/69e171607cc280ca7299e15e HTTP/1.0" 202 Accepted 2026-04-18 23:32:04,484 - lava_callback - INFO - Starting async job submit for node 69e171607cc280ca7299e15e 2026-04-18 23:32:04,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:32:04,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171607cc280ca7299e15e HTTP/1.1" 200 None 2026-04-18 23:32:04,500 - lava_callback - DEBUG - Processing node 69e171607cc280ca7299e15e: baseline-arm64-baylibre 2026-04-18 23:32:04,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e171607cc280ca7299e15e 2026-04-18 23:32:04,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:32:04,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171607cc280ca7299e15e HTTP/1.1" 200 None 2026-04-18 23:32:04,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:32:04,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:32:04,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:32:04,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e171607cc280ca7299e15e HTTP/1.1" 200 None 2026-04-18 23:32:04,548 - lava_callback - ERROR - Error processing callback for node 69e171607cc280ca7299e15e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:33:04,473 - lava_callback - INFO - Received callback for node 69e171ac7cc280ca7299e182 INFO: 172.21.0.1:52930 - "POST /node/69e171ac7cc280ca7299e182 HTTP/1.0" 202 Accepted 2026-04-18 23:33:04,479 - lava_callback - INFO - Starting async job submit for node 69e171ac7cc280ca7299e182 2026-04-18 23:33:04,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:33:04,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171ac7cc280ca7299e182 HTTP/1.1" 200 None 2026-04-18 23:33:04,501 - lava_callback - DEBUG - Processing node 69e171ac7cc280ca7299e182: baseline-arm64-baylibre 2026-04-18 23:33:04,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e171ac7cc280ca7299e182 2026-04-18 23:33:04,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:33:04,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171ac7cc280ca7299e182 HTTP/1.1" 200 None 2026-04-18 23:33:04,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:33:04,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:33:04,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:33:04,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e171ac7cc280ca7299e182 HTTP/1.1" 200 None 2026-04-18 23:33:04,575 - lava_callback - ERROR - Error processing callback for node 69e171ac7cc280ca7299e182: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:34:24,610 - lava_callback - INFO - Received callback for node 69e171f47cc280ca7299e1aa INFO: 172.21.0.1:40982 - "POST /node/69e171f47cc280ca7299e1aa HTTP/1.0" 202 Accepted 2026-04-18 23:34:24,616 - lava_callback - INFO - Starting async job submit for node 69e171f47cc280ca7299e1aa 2026-04-18 23:34:24,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:34:24,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171f47cc280ca7299e1aa HTTP/1.1" 200 None 2026-04-18 23:34:24,638 - lava_callback - DEBUG - Processing node 69e171f47cc280ca7299e1aa: baseline-arm64-baylibre 2026-04-18 23:34:24,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e171f47cc280ca7299e1aa 2026-04-18 23:34:24,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:34:24,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e171f47cc280ca7299e1aa HTTP/1.1" 200 None 2026-04-18 23:34:24,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:34:24,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:34:24,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:34:24,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e171f47cc280ca7299e1aa HTTP/1.1" 200 None 2026-04-18 23:34:24,687 - lava_callback - ERROR - Error processing callback for node 69e171f47cc280ca7299e1aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:35:44,703 - lava_callback - INFO - Received callback for node 69e1723f7cc280ca7299e1cf INFO: 172.21.0.1:44366 - "POST /node/69e1723f7cc280ca7299e1cf HTTP/1.0" 202 Accepted 2026-04-18 23:35:44,709 - lava_callback - INFO - Starting async job submit for node 69e1723f7cc280ca7299e1cf 2026-04-18 23:35:44,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:35:44,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1723f7cc280ca7299e1cf HTTP/1.1" 200 None 2026-04-18 23:35:44,725 - lava_callback - DEBUG - Processing node 69e1723f7cc280ca7299e1cf: baseline-arm64-baylibre 2026-04-18 23:35:44,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1723f7cc280ca7299e1cf 2026-04-18 23:35:44,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:35:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1723f7cc280ca7299e1cf HTTP/1.1" 200 None 2026-04-18 23:35:44,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:35:44,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:35:44,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:35:44,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1723f7cc280ca7299e1cf HTTP/1.1" 200 None 2026-04-18 23:35:44,821 - lava_callback - ERROR - Error processing callback for node 69e1723f7cc280ca7299e1cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:36:44,648 - lava_callback - INFO - Received callback for node 69e172897cc280ca7299e1fb INFO: 172.21.0.1:50866 - "POST /node/69e172897cc280ca7299e1fb HTTP/1.0" 202 Accepted 2026-04-18 23:36:44,654 - lava_callback - INFO - Starting async job submit for node 69e172897cc280ca7299e1fb 2026-04-18 23:36:44,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:36:44,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e172897cc280ca7299e1fb HTTP/1.1" 200 None 2026-04-18 23:36:44,669 - lava_callback - DEBUG - Processing node 69e172897cc280ca7299e1fb: baseline-arm64-baylibre 2026-04-18 23:36:44,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e172897cc280ca7299e1fb 2026-04-18 23:36:44,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:36:44,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e172897cc280ca7299e1fb HTTP/1.1" 200 None 2026-04-18 23:36:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:36:44,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:36:44,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:36:44,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e172897cc280ca7299e1fb HTTP/1.1" 200 None 2026-04-18 23:36:44,746 - lava_callback - ERROR - Error processing callback for node 69e172897cc280ca7299e1fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:38:07,070 - lava_callback - INFO - Received callback for node 69e172da7cc280ca7299e21e INFO: 172.21.0.1:32824 - "POST /node/69e172da7cc280ca7299e21e HTTP/1.0" 202 Accepted 2026-04-18 23:38:07,080 - lava_callback - INFO - Starting async job submit for node 69e172da7cc280ca7299e21e 2026-04-18 23:38:07,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:38:07,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e172da7cc280ca7299e21e HTTP/1.1" 200 None 2026-04-18 23:38:07,105 - lava_callback - DEBUG - Processing node 69e172da7cc280ca7299e21e: baseline-arm64-clabbe 2026-04-18 23:38:07,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e172da7cc280ca7299e21e 2026-04-18 23:38:07,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:38:07,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e172da7cc280ca7299e21e HTTP/1.1" 200 None 2026-04-18 23:38:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:38:07,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:38:07,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:38:07,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e172da7cc280ca7299e21e HTTP/1.1" 200 None 2026-04-18 23:38:07,166 - lava_callback - ERROR - Error processing callback for node 69e172da7cc280ca7299e21e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:39:27,110 - lava_callback - INFO - Received callback for node 69e173267cc280ca7299e249 INFO: 172.21.0.1:48616 - "POST /node/69e173267cc280ca7299e249 HTTP/1.0" 202 Accepted 2026-04-18 23:39:27,116 - lava_callback - INFO - Starting async job submit for node 69e173267cc280ca7299e249 2026-04-18 23:39:27,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:39:27,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173267cc280ca7299e249 HTTP/1.1" 200 None 2026-04-18 23:39:27,157 - lava_callback - DEBUG - Processing node 69e173267cc280ca7299e249: baseline-arm64-clabbe 2026-04-18 23:39:27,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e173267cc280ca7299e249 2026-04-18 23:39:27,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:39:27,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173267cc280ca7299e249 HTTP/1.1" 200 None 2026-04-18 23:39:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:39:27,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:39:27,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:39:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e173267cc280ca7299e249 HTTP/1.1" 200 None 2026-04-18 23:39:27,208 - lava_callback - ERROR - Error processing callback for node 69e173267cc280ca7299e249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:40:47,171 - lava_callback - INFO - Received callback for node 69e173727cc280ca7299e26c INFO: 172.21.0.1:45570 - "POST /node/69e173727cc280ca7299e26c HTTP/1.0" 202 Accepted 2026-04-18 23:40:47,176 - lava_callback - INFO - Starting async job submit for node 69e173727cc280ca7299e26c 2026-04-18 23:40:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:40:47,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173727cc280ca7299e26c HTTP/1.1" 200 None 2026-04-18 23:40:47,192 - lava_callback - DEBUG - Processing node 69e173727cc280ca7299e26c: baseline-arm64-clabbe 2026-04-18 23:40:47,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e173727cc280ca7299e26c 2026-04-18 23:40:47,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:40:47,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173727cc280ca7299e26c HTTP/1.1" 200 None 2026-04-18 23:40:47,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:40:47,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:40:47,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:40:47,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e173727cc280ca7299e26c HTTP/1.1" 200 None 2026-04-18 23:40:47,273 - lava_callback - ERROR - Error processing callback for node 69e173727cc280ca7299e26c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:42:07,426 - lava_callback - INFO - Received callback for node 69e173bf7cc280ca7299e293 INFO: 172.21.0.1:49980 - "POST /node/69e173bf7cc280ca7299e293 HTTP/1.0" 202 Accepted 2026-04-18 23:42:07,433 - lava_callback - INFO - Starting async job submit for node 69e173bf7cc280ca7299e293 2026-04-18 23:42:07,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:42:07,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173bf7cc280ca7299e293 HTTP/1.1" 200 None 2026-04-18 23:42:07,450 - lava_callback - DEBUG - Processing node 69e173bf7cc280ca7299e293: baseline-arm64-clabbe 2026-04-18 23:42:07,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e173bf7cc280ca7299e293 2026-04-18 23:42:07,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:42:07,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e173bf7cc280ca7299e293 HTTP/1.1" 200 None 2026-04-18 23:42:07,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:42:07,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:42:07,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:42:07,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e173bf7cc280ca7299e293 HTTP/1.1" 200 None 2026-04-18 23:42:07,543 - lava_callback - ERROR - Error processing callback for node 69e173bf7cc280ca7299e293: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:43:05,090 - lava_callback - INFO - Received callback for node 69e174037cc280ca7299e2b6 INFO: 172.21.0.1:44020 - "POST /node/69e174037cc280ca7299e2b6 HTTP/1.0" 202 Accepted 2026-04-18 23:43:05,095 - lava_callback - INFO - Starting async job submit for node 69e174037cc280ca7299e2b6 2026-04-18 23:43:05,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:43:05,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174037cc280ca7299e2b6 HTTP/1.1" 200 None 2026-04-18 23:43:05,111 - lava_callback - DEBUG - Processing node 69e174037cc280ca7299e2b6: baseline-arm64-baylibre 2026-04-18 23:43:05,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e174037cc280ca7299e2b6 2026-04-18 23:43:05,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:43:05,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174037cc280ca7299e2b6 HTTP/1.1" 200 None 2026-04-18 23:43:05,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:43:05,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:43:05,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:43:05,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e174037cc280ca7299e2b6 HTTP/1.1" 200 None 2026-04-18 23:43:05,170 - lava_callback - ERROR - Error processing callback for node 69e174037cc280ca7299e2b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:44:27,324 - lava_callback - INFO - Received callback for node 69e174567cc280ca7299e2df INFO: 172.21.0.1:36706 - "POST /node/69e174567cc280ca7299e2df HTTP/1.0" 202 Accepted 2026-04-18 23:44:27,331 - lava_callback - INFO - Starting async job submit for node 69e174567cc280ca7299e2df 2026-04-18 23:44:27,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:44:27,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174567cc280ca7299e2df HTTP/1.1" 200 None 2026-04-18 23:44:27,347 - lava_callback - DEBUG - Processing node 69e174567cc280ca7299e2df: baseline-arm64-clabbe 2026-04-18 23:44:27,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e174567cc280ca7299e2df 2026-04-18 23:44:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:44:27,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174567cc280ca7299e2df HTTP/1.1" 200 None 2026-04-18 23:44:27,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:44:27,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:44:27,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:44:27,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e174567cc280ca7299e2df HTTP/1.1" 200 None 2026-04-18 23:44:27,407 - lava_callback - ERROR - Error processing callback for node 69e174567cc280ca7299e2df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:45:45,184 - lava_callback - INFO - Received callback for node 69e174987cc280ca7299e301 INFO: 172.21.0.1:51054 - "POST /node/69e174987cc280ca7299e301 HTTP/1.0" 202 Accepted 2026-04-18 23:45:45,189 - lava_callback - INFO - Starting async job submit for node 69e174987cc280ca7299e301 2026-04-18 23:45:45,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:45:45,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174987cc280ca7299e301 HTTP/1.1" 200 None 2026-04-18 23:45:45,204 - lava_callback - DEBUG - Processing node 69e174987cc280ca7299e301: baseline-arm64-baylibre 2026-04-18 23:45:45,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e174987cc280ca7299e301 2026-04-18 23:45:45,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:45:45,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174987cc280ca7299e301 HTTP/1.1" 200 None 2026-04-18 23:45:45,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:45:45,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:45:45,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:45:45,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e174987cc280ca7299e301 HTTP/1.1" 200 None 2026-04-18 23:45:45,260 - lava_callback - ERROR - Error processing callback for node 69e174987cc280ca7299e301: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:47:07,504 - lava_callback - INFO - Received callback for node 69e174ea7cc280ca7299e32b INFO: 172.21.0.1:48812 - "POST /node/69e174ea7cc280ca7299e32b HTTP/1.0" 202 Accepted 2026-04-18 23:47:07,509 - lava_callback - INFO - Starting async job submit for node 69e174ea7cc280ca7299e32b 2026-04-18 23:47:07,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:47:07,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174ea7cc280ca7299e32b HTTP/1.1" 200 None 2026-04-18 23:47:07,526 - lava_callback - DEBUG - Processing node 69e174ea7cc280ca7299e32b: baseline-arm64-clabbe 2026-04-18 23:47:07,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e174ea7cc280ca7299e32b 2026-04-18 23:47:07,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:47:07,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e174ea7cc280ca7299e32b HTTP/1.1" 200 None 2026-04-18 23:47:07,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:47:07,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:47:07,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:47:07,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e174ea7cc280ca7299e32b HTTP/1.1" 200 None 2026-04-18 23:47:07,577 - lava_callback - ERROR - Error processing callback for node 69e174ea7cc280ca7299e32b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:48:05,297 - lava_callback - INFO - Received callback for node 69e1752e7cc280ca7299e34b INFO: 172.21.0.1:45900 - "POST /node/69e1752e7cc280ca7299e34b HTTP/1.0" 202 Accepted 2026-04-18 23:48:05,304 - lava_callback - INFO - Starting async job submit for node 69e1752e7cc280ca7299e34b 2026-04-18 23:48:05,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:48:05,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1752e7cc280ca7299e34b HTTP/1.1" 200 None 2026-04-18 23:48:05,322 - lava_callback - DEBUG - Processing node 69e1752e7cc280ca7299e34b: baseline-arm64-baylibre 2026-04-18 23:48:05,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1752e7cc280ca7299e34b 2026-04-18 23:48:05,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:48:05,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1752e7cc280ca7299e34b HTTP/1.1" 200 None 2026-04-18 23:48:05,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:48:05,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:48:05,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:48:05,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1752e7cc280ca7299e34b HTTP/1.1" 200 None 2026-04-18 23:48:05,377 - lava_callback - ERROR - Error processing callback for node 69e1752e7cc280ca7299e34b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:49:27,557 - lava_callback - INFO - Received callback for node 69e1757e7cc280ca7299e376 INFO: 172.21.0.1:60848 - "POST /node/69e1757e7cc280ca7299e376 HTTP/1.0" 202 Accepted 2026-04-18 23:49:27,563 - lava_callback - INFO - Starting async job submit for node 69e1757e7cc280ca7299e376 2026-04-18 23:49:27,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:49:27,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1757e7cc280ca7299e376 HTTP/1.1" 200 None 2026-04-18 23:49:27,579 - lava_callback - DEBUG - Processing node 69e1757e7cc280ca7299e376: baseline-arm64-clabbe 2026-04-18 23:49:27,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1757e7cc280ca7299e376 2026-04-18 23:49:27,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:49:27,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1757e7cc280ca7299e376 HTTP/1.1" 200 None 2026-04-18 23:49:27,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:49:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:49:27,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:49:27,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1757e7cc280ca7299e376 HTTP/1.1" 200 None 2026-04-18 23:49:27,638 - lava_callback - ERROR - Error processing callback for node 69e1757e7cc280ca7299e376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:50:45,493 - lava_callback - INFO - Received callback for node 69e175c17cc280ca7299e399 INFO: 172.21.0.1:35914 - "POST /node/69e175c17cc280ca7299e399 HTTP/1.0" 202 Accepted 2026-04-18 23:50:45,498 - lava_callback - INFO - Starting async job submit for node 69e175c17cc280ca7299e399 2026-04-18 23:50:45,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:50:45,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e175c17cc280ca7299e399 HTTP/1.1" 200 None 2026-04-18 23:50:45,515 - lava_callback - DEBUG - Processing node 69e175c17cc280ca7299e399: baseline-arm64-baylibre 2026-04-18 23:50:45,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e175c17cc280ca7299e399 2026-04-18 23:50:45,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:50:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e175c17cc280ca7299e399 HTTP/1.1" 200 None 2026-04-18 23:50:45,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:50:45,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:50:45,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:50:45,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e175c17cc280ca7299e399 HTTP/1.1" 200 None 2026-04-18 23:50:45,571 - lava_callback - ERROR - Error processing callback for node 69e175c17cc280ca7299e399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:51:45,541 - lava_callback - INFO - Received callback for node 69e1760d7cc280ca7299e3c5 INFO: 172.21.0.1:40410 - "POST /node/69e1760d7cc280ca7299e3c5 HTTP/1.0" 202 Accepted 2026-04-18 23:51:45,547 - lava_callback - INFO - Starting async job submit for node 69e1760d7cc280ca7299e3c5 2026-04-18 23:51:45,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:51:45,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1760d7cc280ca7299e3c5 HTTP/1.1" 200 None 2026-04-18 23:51:45,570 - lava_callback - DEBUG - Processing node 69e1760d7cc280ca7299e3c5: baseline-arm64-baylibre 2026-04-18 23:51:45,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1760d7cc280ca7299e3c5 2026-04-18 23:51:45,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:51:45,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1760d7cc280ca7299e3c5 HTTP/1.1" 200 None 2026-04-18 23:51:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:51:45,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:51:45,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:51:45,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1760d7cc280ca7299e3c5 HTTP/1.1" 200 None 2026-04-18 23:51:45,618 - lava_callback - ERROR - Error processing callback for node 69e1760d7cc280ca7299e3c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:53:05,668 - lava_callback - INFO - Received callback for node 69e176587cc280ca7299e3ea INFO: 172.21.0.1:47080 - "POST /node/69e176587cc280ca7299e3ea HTTP/1.0" 202 Accepted 2026-04-18 23:53:05,673 - lava_callback - INFO - Starting async job submit for node 69e176587cc280ca7299e3ea 2026-04-18 23:53:05,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:53:05,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176587cc280ca7299e3ea HTTP/1.1" 200 None 2026-04-18 23:53:05,690 - lava_callback - DEBUG - Processing node 69e176587cc280ca7299e3ea: baseline-arm64-baylibre 2026-04-18 23:53:05,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e176587cc280ca7299e3ea 2026-04-18 23:53:05,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:53:05,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176587cc280ca7299e3ea HTTP/1.1" 200 None 2026-04-18 23:53:05,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:53:05,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:53:05,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:53:05,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e176587cc280ca7299e3ea HTTP/1.1" 200 None 2026-04-18 23:53:05,740 - lava_callback - ERROR - Error processing callback for node 69e176587cc280ca7299e3ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:54:27,744 - lava_callback - INFO - Received callback for node 69e176a77cc280ca7299e413 INFO: 172.21.0.1:44966 - "POST /node/69e176a77cc280ca7299e413 HTTP/1.0" 202 Accepted 2026-04-18 23:54:27,750 - lava_callback - INFO - Starting async job submit for node 69e176a77cc280ca7299e413 2026-04-18 23:54:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:54:27,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176a77cc280ca7299e413 HTTP/1.1" 200 None 2026-04-18 23:54:27,766 - lava_callback - DEBUG - Processing node 69e176a77cc280ca7299e413: baseline-arm64-clabbe 2026-04-18 23:54:27,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e176a77cc280ca7299e413 2026-04-18 23:54:27,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:54:27,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176a77cc280ca7299e413 HTTP/1.1" 200 None 2026-04-18 23:54:27,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:54:27,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:54:27,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:54:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e176a77cc280ca7299e413 HTTP/1.1" 200 None 2026-04-18 23:54:27,813 - lava_callback - ERROR - Error processing callback for node 69e176a77cc280ca7299e413: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:55:47,805 - lava_callback - INFO - Received callback for node 69e176f37cc280ca7299e437 INFO: 172.21.0.1:34244 - "POST /node/69e176f37cc280ca7299e437 HTTP/1.0" 202 Accepted 2026-04-18 23:55:47,811 - lava_callback - INFO - Starting async job submit for node 69e176f37cc280ca7299e437 2026-04-18 23:55:47,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:55:47,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176f37cc280ca7299e437 HTTP/1.1" 200 None 2026-04-18 23:55:47,843 - lava_callback - DEBUG - Processing node 69e176f37cc280ca7299e437: baseline-arm64-clabbe 2026-04-18 23:55:47,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e176f37cc280ca7299e437 2026-04-18 23:55:47,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:55:47,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e176f37cc280ca7299e437 HTTP/1.1" 200 None 2026-04-18 23:55:47,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:55:47,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:55:47,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:55:47,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e176f37cc280ca7299e437 HTTP/1.1" 200 None 2026-04-18 23:55:47,930 - lava_callback - ERROR - Error processing callback for node 69e176f37cc280ca7299e437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:57:08,036 - lava_callback - INFO - Received callback for node 69e177407cc280ca7299e461 INFO: 172.21.0.1:44166 - "POST /node/69e177407cc280ca7299e461 HTTP/1.0" 202 Accepted 2026-04-18 23:57:08,042 - lava_callback - INFO - Starting async job submit for node 69e177407cc280ca7299e461 2026-04-18 23:57:08,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:57:08,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177407cc280ca7299e461 HTTP/1.1" 200 None 2026-04-18 23:57:08,059 - lava_callback - DEBUG - Processing node 69e177407cc280ca7299e461: baseline-arm64-clabbe 2026-04-18 23:57:08,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e177407cc280ca7299e461 2026-04-18 23:57:08,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:57:08,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177407cc280ca7299e461 HTTP/1.1" 200 None 2026-04-18 23:57:08,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:57:08,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:57:08,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:57:08,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e177407cc280ca7299e461 HTTP/1.1" 200 None 2026-04-18 23:57:08,131 - lava_callback - ERROR - Error processing callback for node 69e177407cc280ca7299e461: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:58:05,951 - lava_callback - INFO - Received callback for node 69e177837cc280ca7299e482 INFO: 172.21.0.1:36744 - "POST /node/69e177837cc280ca7299e482 HTTP/1.0" 202 Accepted 2026-04-18 23:58:05,956 - lava_callback - INFO - Starting async job submit for node 69e177837cc280ca7299e482 2026-04-18 23:58:05,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:58:05,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177837cc280ca7299e482 HTTP/1.1" 200 None 2026-04-18 23:58:05,973 - lava_callback - DEBUG - Processing node 69e177837cc280ca7299e482: baseline-arm64-baylibre 2026-04-18 23:58:05,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e177837cc280ca7299e482 2026-04-18 23:58:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:58:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177837cc280ca7299e482 HTTP/1.1" 200 None 2026-04-18 23:58:05,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:58:06,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:58:06,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:58:06,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e177837cc280ca7299e482 HTTP/1.1" 200 None 2026-04-18 23:58:06,021 - lava_callback - ERROR - Error processing callback for node 69e177837cc280ca7299e482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK 2026-04-18 23:59:28,010 - lava_callback - INFO - Received callback for node 69e177d67cc280ca7299e4ac INFO: 172.21.0.1:60356 - "POST /node/69e177d67cc280ca7299e4ac HTTP/1.0" 202 Accepted 2026-04-18 23:59:28,016 - lava_callback - INFO - Starting async job submit for node 69e177d67cc280ca7299e4ac 2026-04-18 23:59:28,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:59:28,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177d67cc280ca7299e4ac HTTP/1.1" 200 None 2026-04-18 23:59:28,032 - lava_callback - DEBUG - Processing node 69e177d67cc280ca7299e4ac: baseline-arm64-clabbe 2026-04-18 23:59:28,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e177d67cc280ca7299e4ac 2026-04-18 23:59:28,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:59:28,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e177d67cc280ca7299e4ac HTTP/1.1" 200 None 2026-04-18 23:59:28,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:59:28,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-18 23:59:28,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-18 23:59:28,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e177d67cc280ca7299e4ac HTTP/1.1" 200 None 2026-04-18 23:59:28,089 - lava_callback - ERROR - Error processing callback for node 69e177d67cc280ca7299e4ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:00:48,025 - lava_callback - INFO - Received callback for node 69e1782a7cc280ca7299e4d6 INFO: 172.21.0.1:54696 - "POST /node/69e1782a7cc280ca7299e4d6 HTTP/1.0" 202 Accepted 2026-04-19 00:00:48,031 - lava_callback - INFO - Starting async job submit for node 69e1782a7cc280ca7299e4d6 2026-04-19 00:00:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:00:48,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1782a7cc280ca7299e4d6 HTTP/1.1" 200 None 2026-04-19 00:00:48,047 - lava_callback - DEBUG - Processing node 69e1782a7cc280ca7299e4d6: baseline-arm64-clabbe 2026-04-19 00:00:48,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1782a7cc280ca7299e4d6 2026-04-19 00:00:48,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:00:48,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1782a7cc280ca7299e4d6 HTTP/1.1" 200 None 2026-04-19 00:00:48,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:00:48,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:00:48,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:00:48,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1782a7cc280ca7299e4d6 HTTP/1.1" 200 None 2026-04-19 00:00:48,105 - lava_callback - ERROR - Error processing callback for node 69e1782a7cc280ca7299e4d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:02:06,617 - lava_callback - INFO - Received callback for node 69e1786f7cc280ca7299e4f4 INFO: 172.21.0.1:38088 - "POST /node/69e1786f7cc280ca7299e4f4 HTTP/1.0" 202 Accepted 2026-04-19 00:02:06,623 - lava_callback - INFO - Starting async job submit for node 69e1786f7cc280ca7299e4f4 2026-04-19 00:02:06,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:02:06,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1786f7cc280ca7299e4f4 HTTP/1.1" 200 None 2026-04-19 00:02:06,640 - lava_callback - DEBUG - Processing node 69e1786f7cc280ca7299e4f4: baseline-arm64-baylibre 2026-04-19 00:02:06,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1786f7cc280ca7299e4f4 2026-04-19 00:02:06,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:02:06,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1786f7cc280ca7299e4f4 HTTP/1.1" 200 None 2026-04-19 00:02:06,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:02:06,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:02:06,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:02:06,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1786f7cc280ca7299e4f4 HTTP/1.1" 200 None 2026-04-19 00:02:06,705 - lava_callback - ERROR - Error processing callback for node 69e1786f7cc280ca7299e4f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:03:28,154 - lava_callback - INFO - Received callback for node 69e178c77cc280ca7299e521 INFO: 172.21.0.1:58680 - "POST /node/69e178c77cc280ca7299e521 HTTP/1.0" 202 Accepted 2026-04-19 00:03:28,160 - lava_callback - INFO - Starting async job submit for node 69e178c77cc280ca7299e521 2026-04-19 00:03:28,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:03:28,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e178c77cc280ca7299e521 HTTP/1.1" 200 None 2026-04-19 00:03:28,177 - lava_callback - DEBUG - Processing node 69e178c77cc280ca7299e521: baseline-arm64-clabbe 2026-04-19 00:03:28,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e178c77cc280ca7299e521 2026-04-19 00:03:28,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:03:28,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e178c77cc280ca7299e521 HTTP/1.1" 200 None 2026-04-19 00:03:28,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:03:28,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:03:28,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:03:28,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e178c77cc280ca7299e521 HTTP/1.1" 200 None 2026-04-19 00:03:28,228 - lava_callback - ERROR - Error processing callback for node 69e178c77cc280ca7299e521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:04:46,283 - lava_callback - INFO - Received callback for node 69e1790c7cc280ca7299e541 INFO: 172.21.0.1:38740 - "POST /node/69e1790c7cc280ca7299e541 HTTP/1.0" 202 Accepted 2026-04-19 00:04:46,289 - lava_callback - INFO - Starting async job submit for node 69e1790c7cc280ca7299e541 2026-04-19 00:04:46,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:04:46,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1790c7cc280ca7299e541 HTTP/1.1" 200 None 2026-04-19 00:04:46,307 - lava_callback - DEBUG - Processing node 69e1790c7cc280ca7299e541: baseline-arm64-baylibre 2026-04-19 00:04:46,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1790c7cc280ca7299e541 2026-04-19 00:04:46,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:04:46,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1790c7cc280ca7299e541 HTTP/1.1" 200 None 2026-04-19 00:04:46,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:04:46,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:04:46,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:04:46,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1790c7cc280ca7299e541 HTTP/1.1" 200 None 2026-04-19 00:04:46,355 - lava_callback - ERROR - Error processing callback for node 69e1790c7cc280ca7299e541: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:06:08,312 - lava_callback - INFO - Received callback for node 69e1795e7cc280ca7299e56c INFO: 172.21.0.1:49388 - "POST /node/69e1795e7cc280ca7299e56c HTTP/1.0" 202 Accepted 2026-04-19 00:06:08,317 - lava_callback - INFO - Starting async job submit for node 69e1795e7cc280ca7299e56c 2026-04-19 00:06:08,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:06:08,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1795e7cc280ca7299e56c HTTP/1.1" 200 None 2026-04-19 00:06:08,336 - lava_callback - DEBUG - Processing node 69e1795e7cc280ca7299e56c: baseline-arm64-clabbe 2026-04-19 00:06:08,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1795e7cc280ca7299e56c 2026-04-19 00:06:08,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:06:08,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1795e7cc280ca7299e56c HTTP/1.1" 200 None 2026-04-19 00:06:08,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:06:08,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:06:08,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:06:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1795e7cc280ca7299e56c HTTP/1.1" 200 None 2026-04-19 00:06:08,392 - lava_callback - ERROR - Error processing callback for node 69e1795e7cc280ca7299e56c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:07:06,436 - lava_callback - INFO - Received callback for node 69e179a27cc280ca7299e5a4 INFO: 172.21.0.1:43536 - "POST /node/69e179a27cc280ca7299e5a4 HTTP/1.0" 202 Accepted 2026-04-19 00:07:06,441 - lava_callback - INFO - Starting async job submit for node 69e179a27cc280ca7299e5a4 2026-04-19 00:07:06,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:07:06,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e179a27cc280ca7299e5a4 HTTP/1.1" 200 None 2026-04-19 00:07:06,463 - lava_callback - DEBUG - Processing node 69e179a27cc280ca7299e5a4: baseline-arm64-baylibre 2026-04-19 00:07:06,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e179a27cc280ca7299e5a4 2026-04-19 00:07:06,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:07:06,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e179a27cc280ca7299e5a4 HTTP/1.1" 200 None 2026-04-19 00:07:06,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:07:06,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:07:06,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:07:06,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e179a27cc280ca7299e5a4 HTTP/1.1" 200 None 2026-04-19 00:07:06,525 - lava_callback - ERROR - Error processing callback for node 69e179a27cc280ca7299e5a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:08:26,518 - lava_callback - INFO - Received callback for node 69e179ef7cc280ca7299e5f2 INFO: 172.21.0.1:49190 - "POST /node/69e179ef7cc280ca7299e5f2 HTTP/1.0" 202 Accepted 2026-04-19 00:08:26,523 - lava_callback - INFO - Starting async job submit for node 69e179ef7cc280ca7299e5f2 2026-04-19 00:08:26,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:08:26,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e179ef7cc280ca7299e5f2 HTTP/1.1" 200 None 2026-04-19 00:08:26,540 - lava_callback - DEBUG - Processing node 69e179ef7cc280ca7299e5f2: baseline-arm64-baylibre 2026-04-19 00:08:26,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e179ef7cc280ca7299e5f2 2026-04-19 00:08:26,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:08:26,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e179ef7cc280ca7299e5f2 HTTP/1.1" 200 None 2026-04-19 00:08:26,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:08:26,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:08:26,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:08:26,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e179ef7cc280ca7299e5f2 HTTP/1.1" 200 None 2026-04-19 00:08:26,605 - lava_callback - ERROR - Error processing callback for node 69e179ef7cc280ca7299e5f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:09:46,636 - lava_callback - INFO - Received callback for node 69e17a397cc280ca7299e616 INFO: 172.21.0.1:45104 - "POST /node/69e17a397cc280ca7299e616 HTTP/1.0" 202 Accepted 2026-04-19 00:09:46,642 - lava_callback - INFO - Starting async job submit for node 69e17a397cc280ca7299e616 2026-04-19 00:09:46,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:09:46,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17a397cc280ca7299e616 HTTP/1.1" 200 None 2026-04-19 00:09:46,659 - lava_callback - DEBUG - Processing node 69e17a397cc280ca7299e616: baseline-arm64-baylibre 2026-04-19 00:09:46,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e17a397cc280ca7299e616 2026-04-19 00:09:46,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:09:46,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17a397cc280ca7299e616 HTTP/1.1" 200 None 2026-04-19 00:09:46,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:09:46,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:09:46,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:09:46,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e17a397cc280ca7299e616 HTTP/1.1" 200 None 2026-04-19 00:09:46,720 - lava_callback - ERROR - Error processing callback for node 69e17a397cc280ca7299e616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:11:08,541 - lava_callback - INFO - Received callback for node 69e17a8a7cc280ca7299e63e INFO: 172.21.0.1:47438 - "POST /node/69e17a8a7cc280ca7299e63e HTTP/1.0" 202 Accepted 2026-04-19 00:11:08,547 - lava_callback - INFO - Starting async job submit for node 69e17a8a7cc280ca7299e63e 2026-04-19 00:11:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:11:08,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17a8a7cc280ca7299e63e HTTP/1.1" 200 None 2026-04-19 00:11:08,564 - lava_callback - DEBUG - Processing node 69e17a8a7cc280ca7299e63e: baseline-arm64-clabbe 2026-04-19 00:11:08,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e17a8a7cc280ca7299e63e 2026-04-19 00:11:08,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:11:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17a8a7cc280ca7299e63e HTTP/1.1" 200 None 2026-04-19 00:11:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:11:08,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:11:08,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:11:08,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e17a8a7cc280ca7299e63e HTTP/1.1" 200 None 2026-04-19 00:11:08,612 - lava_callback - ERROR - Error processing callback for node 69e17a8a7cc280ca7299e63e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK 2026-04-19 00:12:28,768 - lava_callback - INFO - Received callback for node 69e17ad87cc280ca7299e661 INFO: 172.21.0.1:40672 - "POST /node/69e17ad87cc280ca7299e661 HTTP/1.0" 202 Accepted 2026-04-19 00:12:28,776 - lava_callback - INFO - Starting async job submit for node 69e17ad87cc280ca7299e661 2026-04-19 00:12:28,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:12:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17ad87cc280ca7299e661 HTTP/1.1" 200 None 2026-04-19 00:12:28,807 - lava_callback - DEBUG - Processing node 69e17ad87cc280ca7299e661: baseline-arm64-clabbe 2026-04-19 00:12:28,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e17ad87cc280ca7299e661 2026-04-19 00:12:28,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:12:28,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e17ad87cc280ca7299e661 HTTP/1.1" 200 None 2026-04-19 00:12:28,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:12:28,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-19 00:12:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 00:12:28,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e17ad87cc280ca7299e661 HTTP/1.1" 200 None 2026-04-19 00:12:28,885 - lava_callback - ERROR - Error processing callback for node 69e17ad87cc280ca7299e661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]