INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58344 - "GET /node/69aa3b848c4d487a0e752725%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:35:35,590 - lava_callback - INFO - Received callback for node 69dae8cb0a04df09a44e8b1c 2026-04-14 00:35:35,596 - lava_callback - INFO - Starting async job submit for node 69dae8cb0a04df09a44e8b1c INFO: 172.20.0.1:44714 - "POST /node/69dae8cb0a04df09a44e8b1c HTTP/1.0" 202 Accepted 2026-04-14 00:35:35,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:35:35,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae8cb0a04df09a44e8b1c HTTP/1.1" 200 None 2026-04-14 00:35:35,624 - lava_callback - DEBUG - Processing node 69dae8cb0a04df09a44e8b1c: baseline-arm-baylibre 2026-04-14 00:35:35,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae8cb0a04df09a44e8b1c 2026-04-14 00:35:35,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:35:35,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae8cb0a04df09a44e8b1c HTTP/1.1" 200 None 2026-04-14 00:35:35,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:35:35,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:35:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:35:35,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae8cb0a04df09a44e8b1c HTTP/1.1" 200 None 2026-04-14 00:35:35,675 - lava_callback - ERROR - Error processing callback for node 69dae8cb0a04df09a44e8b1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 00:36:15,525 - lava_callback - INFO - Received callback for node 69dae8ef0a04df09a44e8b3b INFO: 172.20.0.1:34774 - "POST /node/69dae8ef0a04df09a44e8b3b HTTP/1.0" 202 Accepted 2026-04-14 00:36:15,532 - lava_callback - INFO - Starting async job submit for node 69dae8ef0a04df09a44e8b3b 2026-04-14 00:36:15,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:15,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae8ef0a04df09a44e8b3b HTTP/1.1" 200 None 2026-04-14 00:36:15,549 - lava_callback - DEBUG - Processing node 69dae8ef0a04df09a44e8b3b: baseline-arm-baylibre 2026-04-14 00:36:15,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae8ef0a04df09a44e8b3b 2026-04-14 00:36:15,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:15,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae8ef0a04df09a44e8b3b HTTP/1.1" 200 None 2026-04-14 00:36:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:15,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:36:15,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:15,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae8ef0a04df09a44e8b3b HTTP/1.1" 200 None 2026-04-14 00:36:15,606 - lava_callback - ERROR - Error processing callback for node 69dae8ef0a04df09a44e8b3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41138 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:36:35,536 - lava_callback - INFO - Received callback for node 69dae90d0a04df09a44e8b67 INFO: 172.20.0.1:38812 - "POST /node/69dae90d0a04df09a44e8b67 HTTP/1.0" 202 Accepted 2026-04-14 00:36:35,542 - lava_callback - INFO - Starting async job submit for node 69dae90d0a04df09a44e8b67 2026-04-14 00:36:35,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:35,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae90d0a04df09a44e8b67 HTTP/1.1" 200 None 2026-04-14 00:36:35,556 - lava_callback - DEBUG - Processing node 69dae90d0a04df09a44e8b67: baseline-arm-baylibre 2026-04-14 00:36:35,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae90d0a04df09a44e8b67 2026-04-14 00:36:35,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:35,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae90d0a04df09a44e8b67 HTTP/1.1" 200 None 2026-04-14 00:36:35,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:35,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:36:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:36:35,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae90d0a04df09a44e8b67 HTTP/1.1" 200 None 2026-04-14 00:36:35,605 - lava_callback - ERROR - Error processing callback for node 69dae90d0a04df09a44e8b67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49014 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 00:37:15,591 - lava_callback - INFO - Received callback for node 69dae92f0a04df09a44e8b8f INFO: 172.20.0.1:49026 - "POST /node/69dae92f0a04df09a44e8b8f HTTP/1.0" 202 Accepted 2026-04-14 00:37:15,597 - lava_callback - INFO - Starting async job submit for node 69dae92f0a04df09a44e8b8f 2026-04-14 00:37:15,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:15,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae92f0a04df09a44e8b8f HTTP/1.1" 200 None 2026-04-14 00:37:15,613 - lava_callback - DEBUG - Processing node 69dae92f0a04df09a44e8b8f: baseline-arm-baylibre 2026-04-14 00:37:15,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae92f0a04df09a44e8b8f 2026-04-14 00:37:15,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:15,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae92f0a04df09a44e8b8f HTTP/1.1" 200 None 2026-04-14 00:37:15,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:15,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:37:15,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:15,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae92f0a04df09a44e8b8f HTTP/1.1" 200 None 2026-04-14 00:37:15,669 - lava_callback - ERROR - Error processing callback for node 69dae92f0a04df09a44e8b8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:37:35,578 - lava_callback - INFO - Received callback for node 69dae9430a04df09a44e8bc9 INFO: 172.20.0.1:40566 - "POST /node/69dae9430a04df09a44e8bc9 HTTP/1.0" 202 Accepted 2026-04-14 00:37:35,584 - lava_callback - INFO - Starting async job submit for node 69dae9430a04df09a44e8bc9 2026-04-14 00:37:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:35,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9430a04df09a44e8bc9 HTTP/1.1" 200 None 2026-04-14 00:37:35,599 - lava_callback - DEBUG - Processing node 69dae9430a04df09a44e8bc9: baseline-arm-baylibre 2026-04-14 00:37:35,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9430a04df09a44e8bc9 2026-04-14 00:37:35,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:35,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9430a04df09a44e8bc9 HTTP/1.1" 200 None 2026-04-14 00:37:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:35,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:35,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:35,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9430a04df09a44e8bc9 HTTP/1.1" 200 None 2026-04-14 00:37:35,659 - lava_callback - ERROR - Error processing callback for node 69dae9430a04df09a44e8bc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:36,225 - lava_callback - INFO - Received callback for node 69dae9440a04df09a44e8bcc INFO: 172.20.0.1:40576 - "POST /node/69dae9440a04df09a44e8bcc HTTP/1.0" 202 Accepted 2026-04-14 00:37:36,231 - lava_callback - INFO - Starting async job submit for node 69dae9440a04df09a44e8bcc 2026-04-14 00:37:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9440a04df09a44e8bcc HTTP/1.1" 200 None 2026-04-14 00:37:36,250 - lava_callback - DEBUG - Processing node 69dae9440a04df09a44e8bcc: baseline-arm-baylibre 2026-04-14 00:37:36,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9440a04df09a44e8bcc 2026-04-14 00:37:36,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9440a04df09a44e8bcc HTTP/1.1" 200 None 2026-04-14 00:37:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:36,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9440a04df09a44e8bcc HTTP/1.1" 200 None 2026-04-14 00:37:36,313 - lava_callback - ERROR - Error processing callback for node 69dae9440a04df09a44e8bcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40584 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:37:36,896 - lava_callback - INFO - Received callback for node 69dae9470a04df09a44e8bd7 INFO: 172.20.0.1:40594 - "POST /node/69dae9470a04df09a44e8bd7 HTTP/1.0" 202 Accepted 2026-04-14 00:37:36,902 - lava_callback - INFO - Starting async job submit for node 69dae9470a04df09a44e8bd7 2026-04-14 00:37:36,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9470a04df09a44e8bd7 HTTP/1.1" 200 None 2026-04-14 00:37:36,918 - lava_callback - DEBUG - Processing node 69dae9470a04df09a44e8bd7: baseline-arm-baylibre 2026-04-14 00:37:36,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9470a04df09a44e8bd7 2026-04-14 00:37:36,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9470a04df09a44e8bd7 HTTP/1.1" 200 None 2026-04-14 00:37:36,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:36,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:36,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9470a04df09a44e8bd7 HTTP/1.1" 200 None 2026-04-14 00:37:36,966 - lava_callback - ERROR - Error processing callback for node 69dae9470a04df09a44e8bd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:37,541 - lava_callback - INFO - Received callback for node 69dae9410a04df09a44e8bc6 INFO: 172.20.0.1:40600 - "POST /node/69dae9410a04df09a44e8bc6 HTTP/1.0" 202 Accepted 2026-04-14 00:37:37,547 - lava_callback - INFO - Starting async job submit for node 69dae9410a04df09a44e8bc6 2026-04-14 00:37:37,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:37,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9410a04df09a44e8bc6 HTTP/1.1" 200 None 2026-04-14 00:37:37,567 - lava_callback - DEBUG - Processing node 69dae9410a04df09a44e8bc6: baseline-arm-baylibre 2026-04-14 00:37:37,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9410a04df09a44e8bc6 2026-04-14 00:37:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:37,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9410a04df09a44e8bc6 HTTP/1.1" 200 None 2026-04-14 00:37:37,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:37,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:37,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:37,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9410a04df09a44e8bc6 HTTP/1.1" 200 None 2026-04-14 00:37:37,642 - lava_callback - ERROR - Error processing callback for node 69dae9410a04df09a44e8bc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:37:45,658 - lava_callback - INFO - Received callback for node 69dae94f0a04df09a44e8bf0 INFO: 172.20.0.1:36690 - "POST /node/69dae94f0a04df09a44e8bf0 HTTP/1.0" 202 Accepted 2026-04-14 00:37:45,664 - lava_callback - INFO - Starting async job submit for node 69dae94f0a04df09a44e8bf0 2026-04-14 00:37:45,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:45,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae94f0a04df09a44e8bf0 HTTP/1.1" 200 None 2026-04-14 00:37:45,679 - lava_callback - DEBUG - Processing node 69dae94f0a04df09a44e8bf0: baseline-arm-clabbe 2026-04-14 00:37:45,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae94f0a04df09a44e8bf0 2026-04-14 00:37:45,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:45,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae94f0a04df09a44e8bf0 HTTP/1.1" 200 None 2026-04-14 00:37:45,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:45,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:45,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae94f0a04df09a44e8bf0 HTTP/1.1" 200 None 2026-04-14 00:37:45,747 - lava_callback - ERROR - Error processing callback for node 69dae94f0a04df09a44e8bf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:46,355 - lava_callback - INFO - Received callback for node 69dae9540a04df09a44e8c35 INFO: 172.20.0.1:36700 - "POST /node/69dae9540a04df09a44e8c35 HTTP/1.0" 202 Accepted 2026-04-14 00:37:46,361 - lava_callback - INFO - Starting async job submit for node 69dae9540a04df09a44e8c35 2026-04-14 00:37:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:46,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c35 HTTP/1.1" 200 None 2026-04-14 00:37:46,376 - lava_callback - DEBUG - Processing node 69dae9540a04df09a44e8c35: baseline-arm-clabbe 2026-04-14 00:37:46,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9540a04df09a44e8c35 2026-04-14 00:37:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:46,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c35 HTTP/1.1" 200 None 2026-04-14 00:37:46,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:46,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:37:46,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:46,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9540a04df09a44e8c35 HTTP/1.1" 200 None 2026-04-14 00:37:46,438 - lava_callback - ERROR - Error processing callback for node 69dae9540a04df09a44e8c35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36708 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:37:47,015 - lava_callback - INFO - Received callback for node 69dae9510a04df09a44e8bf6 INFO: 172.20.0.1:36714 - "POST /node/69dae9510a04df09a44e8bf6 HTTP/1.0" 202 Accepted 2026-04-14 00:37:47,020 - lava_callback - INFO - Starting async job submit for node 69dae9510a04df09a44e8bf6 2026-04-14 00:37:47,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9510a04df09a44e8bf6 HTTP/1.1" 200 None 2026-04-14 00:37:47,073 - lava_callback - DEBUG - Processing node 69dae9510a04df09a44e8bf6: baseline-arm-clabbe 2026-04-14 00:37:47,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9510a04df09a44e8bf6 2026-04-14 00:37:47,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9510a04df09a44e8bf6 HTTP/1.1" 200 None 2026-04-14 00:37:47,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:47,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9510a04df09a44e8bf6 HTTP/1.1" 200 None 2026-04-14 00:37:47,123 - lava_callback - ERROR - Error processing callback for node 69dae9510a04df09a44e8bf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:47,777 - lava_callback - INFO - Received callback for node 69dae9520a04df09a44e8bfa INFO: 172.20.0.1:36716 - "POST /node/69dae9520a04df09a44e8bfa HTTP/1.0" 202 Accepted 2026-04-14 00:37:47,783 - lava_callback - INFO - Starting async job submit for node 69dae9520a04df09a44e8bfa 2026-04-14 00:37:47,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9520a04df09a44e8bfa HTTP/1.1" 200 None 2026-04-14 00:37:47,798 - lava_callback - DEBUG - Processing node 69dae9520a04df09a44e8bfa: baseline-arm-clabbe 2026-04-14 00:37:47,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9520a04df09a44e8bfa 2026-04-14 00:37:47,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9520a04df09a44e8bfa HTTP/1.1" 200 None 2026-04-14 00:37:47,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:47,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:47,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9520a04df09a44e8bfa HTTP/1.1" 200 None 2026-04-14 00:37:47,845 - lava_callback - ERROR - Error processing callback for node 69dae9520a04df09a44e8bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:48,474 - lava_callback - INFO - Received callback for node 69dae9530a04df09a44e8c2f INFO: 172.20.0.1:36726 - "POST /node/69dae9530a04df09a44e8c2f HTTP/1.0" 202 Accepted 2026-04-14 00:37:48,483 - lava_callback - INFO - Starting async job submit for node 69dae9530a04df09a44e8c2f 2026-04-14 00:37:48,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:48,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9530a04df09a44e8c2f HTTP/1.1" 200 None 2026-04-14 00:37:48,520 - lava_callback - DEBUG - Processing node 69dae9530a04df09a44e8c2f: baseline-arm-clabbe 2026-04-14 00:37:48,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9530a04df09a44e8c2f 2026-04-14 00:37:48,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:48,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9530a04df09a44e8c2f HTTP/1.1" 200 None 2026-04-14 00:37:48,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:48,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:48,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9530a04df09a44e8c2f HTTP/1.1" 200 None 2026-04-14 00:37:48,610 - lava_callback - ERROR - Error processing callback for node 69dae9530a04df09a44e8c2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:49,171 - lava_callback - INFO - Received callback for node 69dae9540a04df09a44e8c32 INFO: 172.20.0.1:36730 - "POST /node/69dae9540a04df09a44e8c32 HTTP/1.0" 202 Accepted 2026-04-14 00:37:49,181 - lava_callback - INFO - Starting async job submit for node 69dae9540a04df09a44e8c32 2026-04-14 00:37:49,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c32 HTTP/1.1" 200 None 2026-04-14 00:37:49,203 - lava_callback - DEBUG - Processing node 69dae9540a04df09a44e8c32: baseline-arm-clabbe 2026-04-14 00:37:49,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9540a04df09a44e8c32 2026-04-14 00:37:49,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c32 HTTP/1.1" 200 None 2026-04-14 00:37:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:49,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9540a04df09a44e8c32 HTTP/1.1" 200 None 2026-04-14 00:37:49,334 - lava_callback - ERROR - Error processing callback for node 69dae9540a04df09a44e8c32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:49,864 - lava_callback - INFO - Received callback for node 69dae9540a04df09a44e8c38 INFO: 172.20.0.1:37044 - "POST /node/69dae9540a04df09a44e8c38 HTTP/1.0" 202 Accepted 2026-04-14 00:37:49,875 - lava_callback - INFO - Starting async job submit for node 69dae9540a04df09a44e8c38 2026-04-14 00:37:49,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c38 HTTP/1.1" 200 None 2026-04-14 00:37:49,906 - lava_callback - DEBUG - Processing node 69dae9540a04df09a44e8c38: baseline-arm-clabbe 2026-04-14 00:37:49,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9540a04df09a44e8c38 2026-04-14 00:37:49,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9540a04df09a44e8c38 HTTP/1.1" 200 None 2026-04-14 00:37:49,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:49,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:49,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9540a04df09a44e8c38 HTTP/1.1" 200 None 2026-04-14 00:37:49,987 - lava_callback - ERROR - Error processing callback for node 69dae9540a04df09a44e8c38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:50,568 - lava_callback - INFO - Received callback for node 69dae9550a04df09a44e8c3b INFO: 172.20.0.1:37050 - "POST /node/69dae9550a04df09a44e8c3b HTTP/1.0" 202 Accepted 2026-04-14 00:37:50,576 - lava_callback - INFO - Starting async job submit for node 69dae9550a04df09a44e8c3b 2026-04-14 00:37:50,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:50,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9550a04df09a44e8c3b HTTP/1.1" 200 None 2026-04-14 00:37:50,602 - lava_callback - DEBUG - Processing node 69dae9550a04df09a44e8c3b: baseline-arm-clabbe 2026-04-14 00:37:50,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9550a04df09a44e8c3b 2026-04-14 00:37:50,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:50,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9550a04df09a44e8c3b HTTP/1.1" 200 None 2026-04-14 00:37:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:50,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:50,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:50,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9550a04df09a44e8c3b HTTP/1.1" 200 None 2026-04-14 00:37:50,692 - lava_callback - ERROR - Error processing callback for node 69dae9550a04df09a44e8c3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:51,256 - lava_callback - INFO - Received callback for node 69dae9560a04df09a44e8c3f INFO: 172.20.0.1:37052 - "POST /node/69dae9560a04df09a44e8c3f HTTP/1.0" 202 Accepted 2026-04-14 00:37:51,265 - lava_callback - INFO - Starting async job submit for node 69dae9560a04df09a44e8c3f 2026-04-14 00:37:51,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9560a04df09a44e8c3f HTTP/1.1" 200 None 2026-04-14 00:37:51,305 - lava_callback - DEBUG - Processing node 69dae9560a04df09a44e8c3f: baseline-arm-clabbe 2026-04-14 00:37:51,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9560a04df09a44e8c3f 2026-04-14 00:37:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:51,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9560a04df09a44e8c3f HTTP/1.1" 200 None 2026-04-14 00:37:51,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:51,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:51,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:51,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9560a04df09a44e8c3f HTTP/1.1" 200 None 2026-04-14 00:37:51,392 - lava_callback - ERROR - Error processing callback for node 69dae9560a04df09a44e8c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:37:51,966 - lava_callback - INFO - Received callback for node 69dae9570a04df09a44e8c42 INFO: 172.20.0.1:37062 - "POST /node/69dae9570a04df09a44e8c42 HTTP/1.0" 202 Accepted 2026-04-14 00:37:51,974 - lava_callback - INFO - Starting async job submit for node 69dae9570a04df09a44e8c42 2026-04-14 00:37:51,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:51,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9570a04df09a44e8c42 HTTP/1.1" 200 None 2026-04-14 00:37:51,997 - lava_callback - DEBUG - Processing node 69dae9570a04df09a44e8c42: baseline-arm-clabbe 2026-04-14 00:37:51,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9570a04df09a44e8c42 2026-04-14 00:37:51,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:52,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9570a04df09a44e8c42 HTTP/1.1" 200 None 2026-04-14 00:37:52,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:52,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 00:37:52,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:37:52,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9570a04df09a44e8c42 HTTP/1.1" 200 None 2026-04-14 00:37:52,083 - lava_callback - ERROR - Error processing callback for node 69dae9570a04df09a44e8c42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:38:25,611 - lava_callback - INFO - Received callback for node 69dae9740a04df09a44e8cbf INFO: 172.20.0.1:56338 - "POST /node/69dae9740a04df09a44e8cbf HTTP/1.0" 202 Accepted 2026-04-14 00:38:25,621 - lava_callback - INFO - Starting async job submit for node 69dae9740a04df09a44e8cbf 2026-04-14 00:38:25,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:38:25,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9740a04df09a44e8cbf HTTP/1.1" 200 None 2026-04-14 00:38:25,651 - lava_callback - DEBUG - Processing node 69dae9740a04df09a44e8cbf: baseline-arm-clabbe 2026-04-14 00:38:25,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9740a04df09a44e8cbf 2026-04-14 00:38:25,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:38:25,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9740a04df09a44e8cbf HTTP/1.1" 200 None 2026-04-14 00:38:25,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:38:25,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:38:25,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:38:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9740a04df09a44e8cbf HTTP/1.1" 200 None 2026-04-14 00:38:25,741 - lava_callback - ERROR - Error processing callback for node 69dae9740a04df09a44e8cbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:39:01,055 - lava_callback - INFO - Received callback for node 69dd8c97c2164e674d71f283 INFO: 172.20.0.1:36720 - "POST /node/69dd8c97c2164e674d71f283 HTTP/1.0" 202 Accepted 2026-04-14 00:39:01,062 - lava_callback - INFO - Starting async job submit for node 69dd8c97c2164e674d71f283 2026-04-14 00:39:01,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c97c2164e674d71f283 HTTP/1.1" 200 None 2026-04-14 00:39:01,083 - lava_callback - DEBUG - Processing node 69dd8c97c2164e674d71f283: baseline-arm 2026-04-14 00:39:01,088 - lava_callback - WARNING - Failed to upload log 2026-04-14 00:39:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:01,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:01,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c97c2164e674d71f283/lava-logs.yaml 2026-04-14 00:39:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:01,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:01,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c97c2164e674d71f283/lava_callback.json.gz 2026-04-14 00:39:01,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:01,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c97c2164e674d71f283 HTTP/1.1" 200 None 2026-04-14 00:39:01,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:01,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:39:01,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:01,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c97c2164e674d71f283 HTTP/1.1" 200 None 2026-04-14 00:39:01,530 - lava_callback - INFO - Completed processing callback for node 69dd8c97c2164e674d71f283 2026-04-14 00:39:05,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:05,691 - lava_callback - INFO - Received callback for node 69dae9960a04df09a44e8d3f INFO: 172.20.0.1:36732 - "POST /node/69dae9960a04df09a44e8d3f HTTP/1.0" 202 Accepted 2026-04-14 00:39:05,698 - lava_callback - INFO - Starting async job submit for node 69dae9960a04df09a44e8d3f 2026-04-14 00:39:05,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 00:39:05,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9960a04df09a44e8d3f HTTP/1.1" 200 None 2026-04-14 00:39:05,713 - lava_callback - DEBUG - Processing node 69dae9960a04df09a44e8d3f: baseline-arm-clabbe 2026-04-14 00:39:05,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9960a04df09a44e8d3f 2026-04-14 00:39:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9960a04df09a44e8d3f HTTP/1.1" 200 None 2026-04-14 00:39:05,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:05,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:39:05,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:05,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9960a04df09a44e8d3f HTTP/1.1" 200 None 2026-04-14 00:39:05,760 - lava_callback - ERROR - Error processing callback for node 69dae9960a04df09a44e8d3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47650 - "GET /node/69bd096a05e4bbd6ba635701%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47676 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:39:18,081 - lava_callback - INFO - Received callback for node 69dd8c98c2164e674d71f286 INFO: 172.20.0.1:47688 - "POST /node/69dd8c98c2164e674d71f286 HTTP/1.0" 202 Accepted 2026-04-14 00:39:18,129 - lava_callback - INFO - Starting async job submit for node 69dd8c98c2164e674d71f286 2026-04-14 00:39:18,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:18,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c98c2164e674d71f286 HTTP/1.1" 200 None 2026-04-14 00:39:18,168 - lava_callback - DEBUG - Processing node 69dd8c98c2164e674d71f286: baseline-arm 2026-04-14 00:39:18,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:18,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:18,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f286/log.txt.gz 2026-04-14 00:39:18,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:18,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:18,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f286/lava-logs.yaml 2026-04-14 00:39:18,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:18,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:18,783 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f286/lava_callback.json.gz 2026-04-14 00:39:18,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:18,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c98c2164e674d71f286 HTTP/1.1" 200 None 2026-04-14 00:39:18,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:18,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:39:18,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:18,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c98c2164e674d71f286 HTTP/1.1" 200 None 2026-04-14 00:39:18,933 - lava_callback - INFO - Completed processing callback for node 69dd8c98c2164e674d71f286 INFO: 172.20.0.1:40044 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:39:35,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:35,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37786 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:39:38,570 - lava_callback - INFO - Received callback for node 69dd8c9ac2164e674d71f28f INFO: 172.20.0.1:37792 - "POST /node/69dd8c9ac2164e674d71f28f HTTP/1.0" 202 Accepted 2026-04-14 00:39:38,617 - lava_callback - INFO - Starting async job submit for node 69dd8c9ac2164e674d71f28f 2026-04-14 00:39:38,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:38,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ac2164e674d71f28f HTTP/1.1" 200 None 2026-04-14 00:39:38,655 - lava_callback - DEBUG - Processing node 69dd8c9ac2164e674d71f28f: baseline-arm 2026-04-14 00:39:38,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:38,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:38,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c9ac2164e674d71f28f/log.txt.gz 2026-04-14 00:39:38,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:39,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:39,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c9ac2164e674d71f28f/lava-logs.yaml 2026-04-14 00:39:39,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:39:39,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:39:39,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c9ac2164e674d71f28f/lava_callback.json.gz 2026-04-14 00:39:39,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:39,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ac2164e674d71f28f HTTP/1.1" 200 None 2026-04-14 00:39:39,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:39,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:39:39,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:39,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9ac2164e674d71f28f HTTP/1.1" 200 None 2026-04-14 00:39:39,345 - lava_callback - INFO - Completed processing callback for node 69dd8c9ac2164e674d71f28f INFO: 172.20.0.1:51106 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:39:45,688 - lava_callback - INFO - Received callback for node 69dae9bc0a04df09a44e8d7f INFO: 172.20.0.1:51122 - "POST /node/69dae9bc0a04df09a44e8d7f HTTP/1.0" 202 Accepted 2026-04-14 00:39:45,695 - lava_callback - INFO - Starting async job submit for node 69dae9bc0a04df09a44e8d7f 2026-04-14 00:39:45,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:45,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9bc0a04df09a44e8d7f HTTP/1.1" 200 None 2026-04-14 00:39:45,756 - lava_callback - DEBUG - Processing node 69dae9bc0a04df09a44e8d7f: baseline-arm-clabbe 2026-04-14 00:39:45,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9bc0a04df09a44e8d7f 2026-04-14 00:39:45,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9bc0a04df09a44e8d7f HTTP/1.1" 200 None 2026-04-14 00:39:45,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:45,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:39:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:39:45,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9bc0a04df09a44e8d7f HTTP/1.1" 200 None 2026-04-14 00:39:45,811 - lava_callback - ERROR - Error processing callback for node 69dae9bc0a04df09a44e8d7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38148 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:05,700 - lava_callback - INFO - Received callback for node 69dae9e10a04df09a44e8da2 INFO: 172.20.0.1:36996 - "POST /node/69dae9e10a04df09a44e8da2 HTTP/1.0" 202 Accepted 2026-04-14 00:40:05,706 - lava_callback - INFO - Starting async job submit for node 69dae9e10a04df09a44e8da2 2026-04-14 00:40:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:05,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9e10a04df09a44e8da2 HTTP/1.1" 200 None 2026-04-14 00:40:05,728 - lava_callback - DEBUG - Processing node 69dae9e10a04df09a44e8da2: baseline-arm-clabbe 2026-04-14 00:40:05,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dae9e10a04df09a44e8da2 2026-04-14 00:40:05,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:05,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 00:40:05,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae9e10a04df09a44e8da2 HTTP/1.1" 200 None 2026-04-14 00:40:05,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:05,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:40:05,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:05,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dae9e10a04df09a44e8da2 HTTP/1.1" 200 None 2026-04-14 00:40:05,784 - lava_callback - ERROR - Error processing callback for node 69dae9e10a04df09a44e8da2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:21,586 - lava_callback - INFO - Received callback for node 69dd8c97c2164e674d71f280 INFO: 172.20.0.1:35780 - "POST /node/69dd8c97c2164e674d71f280 HTTP/1.0" 202 Accepted 2026-04-14 00:40:21,591 - lava_callback - INFO - Starting async job submit for node 69dd8c97c2164e674d71f280 2026-04-14 00:40:21,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:21,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c97c2164e674d71f280 HTTP/1.1" 200 None 2026-04-14 00:40:21,627 - lava_callback - DEBUG - Processing node 69dd8c97c2164e674d71f280: baseline-arm 2026-04-14 00:40:21,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:21,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:21,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c97c2164e674d71f280/log.txt.gz 2026-04-14 00:40:22,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:22,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:22,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c97c2164e674d71f280/lava-logs.yaml 2026-04-14 00:40:22,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:22,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:22,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c97c2164e674d71f280/lava_callback.json.gz 2026-04-14 00:40:22,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:22,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c97c2164e674d71f280 HTTP/1.1" 200 None 2026-04-14 00:40:22,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:22,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:22,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:22,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c97c2164e674d71f280 HTTP/1.1" 200 None 2026-04-14 00:40:22,523 - lava_callback - INFO - Completed processing callback for node 69dd8c97c2164e674d71f280 INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:31,352 - lava_callback - INFO - Received callback for node 69dd8ca9c2164e674d71f2f8 INFO: 172.20.0.1:32888 - "POST /node/69dd8ca9c2164e674d71f2f8 HTTP/1.0" 202 Accepted 2026-04-14 00:40:31,357 - lava_callback - INFO - Starting async job submit for node 69dd8ca9c2164e674d71f2f8 2026-04-14 00:40:31,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:31,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca9c2164e674d71f2f8 HTTP/1.1" 200 None 2026-04-14 00:40:31,413 - lava_callback - DEBUG - Processing node 69dd8ca9c2164e674d71f2f8: baseline-arm-broonie 2026-04-14 00:40:31,617 - lava_callback - INFO - Received callback for node 69dd8c99c2164e674d71f28c 2026-04-14 00:40:31,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:31,662 - lava_callback - INFO - Starting async job submit for node 69dd8c99c2164e674d71f28c INFO: 172.20.0.1:32892 - "POST /node/69dd8c99c2164e674d71f28c HTTP/1.0" 202 Accepted 2026-04-14 00:40:31,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:31,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c99c2164e674d71f28c HTTP/1.1" 200 None 2026-04-14 00:40:31,719 - lava_callback - DEBUG - Processing node 69dd8c99c2164e674d71f28c: baseline-arm 2026-04-14 00:40:31,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:31,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca9c2164e674d71f2f8/log.txt.gz 2026-04-14 00:40:32,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:32,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:32,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:32,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c99c2164e674d71f28c/log.txt.gz 2026-04-14 00:40:32,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:32,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca9c2164e674d71f2f8/lava-logs.yaml 2026-04-14 00:40:32,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:32,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:32,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:32,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca9c2164e674d71f2f8/lava_callback.json.gz 2026-04-14 00:40:32,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:32,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca9c2164e674d71f2f8 HTTP/1.1" 200 None 2026-04-14 00:40:32,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:32,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:32,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:32,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:32,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c99c2164e674d71f28c/lava-logs.yaml 2026-04-14 00:40:32,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:32,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca9c2164e674d71f2f8 HTTP/1.1" 200 None 2026-04-14 00:40:32,597 - lava_callback - INFO - Completed processing callback for node 69dd8ca9c2164e674d71f2f8 2026-04-14 00:40:32,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:32,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c99c2164e674d71f28c/lava_callback.json.gz 2026-04-14 00:40:32,949 - lava_callback - INFO - Received callback for node 69dd8caac2164e674d71f2fe INFO: 172.20.0.1:32906 - "POST /node/69dd8caac2164e674d71f2fe HTTP/1.0" 202 Accepted 2026-04-14 00:40:32,955 - lava_callback - INFO - Starting async job submit for node 69dd8caac2164e674d71f2fe 2026-04-14 00:40:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:32,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:33,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c99c2164e674d71f28c HTTP/1.1" 200 None 2026-04-14 00:40:33,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:33,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8caac2164e674d71f2fe HTTP/1.1" 200 None 2026-04-14 00:40:33,017 - lava_callback - DEBUG - Processing node 69dd8caac2164e674d71f2fe: baseline-arm-broonie 2026-04-14 00:40:33,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:33,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c99c2164e674d71f28c HTTP/1.1" 200 None 2026-04-14 00:40:33,217 - lava_callback - INFO - Completed processing callback for node 69dd8c99c2164e674d71f28c 2026-04-14 00:40:33,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:33,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:33,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8caac2164e674d71f2fe/log.txt.gz 2026-04-14 00:40:33,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:33,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:33,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8caac2164e674d71f2fe/lava-logs.yaml 2026-04-14 00:40:33,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:33,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:33,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8caac2164e674d71f2fe/lava_callback.json.gz 2026-04-14 00:40:33,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:33,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8caac2164e674d71f2fe HTTP/1.1" 200 None 2026-04-14 00:40:33,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:33,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:33,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:34,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8caac2164e674d71f2fe HTTP/1.1" 200 None 2026-04-14 00:40:34,004 - lava_callback - INFO - Completed processing callback for node 69dd8caac2164e674d71f2fe 2026-04-14 00:40:34,786 - lava_callback - INFO - Received callback for node 69dd8cbcc2164e674d71f33e INFO: 172.20.0.1:32918 - "POST /node/69dd8cbcc2164e674d71f33e HTTP/1.0" 202 Accepted 2026-04-14 00:40:34,833 - lava_callback - INFO - Starting async job submit for node 69dd8cbcc2164e674d71f33e 2026-04-14 00:40:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:34,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cbcc2164e674d71f33e HTTP/1.1" 200 None 2026-04-14 00:40:34,868 - lava_callback - DEBUG - Processing node 69dd8cbcc2164e674d71f33e: baseline-arm-pengutronix 2026-04-14 00:40:34,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:35,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:35,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbcc2164e674d71f33e/log.txt.gz 2026-04-14 00:40:35,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:35,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:35,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbcc2164e674d71f33e/lava-logs.yaml 2026-04-14 00:40:35,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:35,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:35,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbcc2164e674d71f33e/lava_callback.json.gz 2026-04-14 00:40:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:35,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cbcc2164e674d71f33e HTTP/1.1" 200 None 2026-04-14 00:40:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:35,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:35,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cbcc2164e674d71f33e HTTP/1.1" 200 None 2026-04-14 00:40:35,509 - lava_callback - INFO - Completed processing callback for node 69dd8cbcc2164e674d71f33e 2026-04-14 00:40:35,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:35,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:32926 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:41,306 - lava_callback - INFO - Received callback for node 69dd8cbac2164e674d71f33b INFO: 172.20.0.1:49964 - "POST /node/69dd8cbac2164e674d71f33b HTTP/1.0" 202 Accepted 2026-04-14 00:40:41,312 - lava_callback - INFO - Starting async job submit for node 69dd8cbac2164e674d71f33b 2026-04-14 00:40:41,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:41,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cbac2164e674d71f33b HTTP/1.1" 200 None 2026-04-14 00:40:41,357 - lava_callback - DEBUG - Processing node 69dd8cbac2164e674d71f33b: baseline-arm-pengutronix 2026-04-14 00:40:41,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:41,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:41,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbac2164e674d71f33b/log.txt.gz 2026-04-14 00:40:41,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:41,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:41,891 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbac2164e674d71f33b/lava-logs.yaml 2026-04-14 00:40:41,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:42,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:42,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69dd8cbac2164e674d71f33b/lava_callback.json.gz 2026-04-14 00:40:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:42,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cbac2164e674d71f33b HTTP/1.1" 200 None 2026-04-14 00:40:42,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:42,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:42,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:42,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cbac2164e674d71f33b HTTP/1.1" 200 None 2026-04-14 00:40:42,114 - lava_callback - INFO - Completed processing callback for node 69dd8cbac2164e674d71f33b INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:45,745 - lava_callback - INFO - Received callback for node 69daea070a04df09a44e8dda INFO: 172.20.0.1:49974 - "POST /node/69daea070a04df09a44e8dda HTTP/1.0" 202 Accepted 2026-04-14 00:40:45,755 - lava_callback - INFO - Starting async job submit for node 69daea070a04df09a44e8dda 2026-04-14 00:40:45,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:45,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea070a04df09a44e8dda HTTP/1.1" 200 None 2026-04-14 00:40:45,784 - lava_callback - DEBUG - Processing node 69daea070a04df09a44e8dda: baseline-arm-clabbe 2026-04-14 00:40:45,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daea070a04df09a44e8dda 2026-04-14 00:40:45,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:45,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea070a04df09a44e8dda HTTP/1.1" 200 None 2026-04-14 00:40:45,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:45,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:40:45,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:45,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daea070a04df09a44e8dda HTTP/1.1" 200 None 2026-04-14 00:40:45,841 - lava_callback - ERROR - Error processing callback for node 69daea070a04df09a44e8dda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:40:52,894 - lava_callback - INFO - Received callback for node 69dd8cabc2164e674d71f301 INFO: 172.20.0.1:57882 - "POST /node/69dd8cabc2164e674d71f301 HTTP/1.0" 202 Accepted 2026-04-14 00:40:52,900 - lava_callback - INFO - Starting async job submit for node 69dd8cabc2164e674d71f301 2026-04-14 00:40:52,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:52,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cabc2164e674d71f301 HTTP/1.1" 200 None 2026-04-14 00:40:52,937 - lava_callback - DEBUG - Processing node 69dd8cabc2164e674d71f301: baseline-arm-broonie 2026-04-14 00:40:53,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:53,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:53,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8cabc2164e674d71f301/log.txt.gz 2026-04-14 00:40:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:53,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:53,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8cabc2164e674d71f301/lava-logs.yaml 2026-04-14 00:40:53,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:40:53,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:40:53,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8cabc2164e674d71f301/lava_callback.json.gz 2026-04-14 00:40:53,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:53,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cabc2164e674d71f301 HTTP/1.1" 200 None 2026-04-14 00:40:53,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:53,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:40:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:40:53,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cabc2164e674d71f301 HTTP/1.1" 200 None 2026-04-14 00:40:53,844 - lava_callback - INFO - Completed processing callback for node 69dd8cabc2164e674d71f301 INFO: 172.20.0.1:57886 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:41:05,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:05,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:41:08,876 - lava_callback - INFO - Received callback for node 69dd8cb6c2164e674d71f329 INFO: 172.20.0.1:58838 - "POST /node/69dd8cb6c2164e674d71f329 HTTP/1.0" 202 Accepted 2026-04-14 00:41:08,882 - lava_callback - INFO - Starting async job submit for node 69dd8cb6c2164e674d71f329 2026-04-14 00:41:08,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:08,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb6c2164e674d71f329 HTTP/1.1" 200 None 2026-04-14 00:41:08,919 - lava_callback - DEBUG - Processing node 69dd8cb6c2164e674d71f329: baseline-arm-kontron 2026-04-14 00:41:09,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:09,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:09,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb6c2164e674d71f329/log.txt.gz 2026-04-14 00:41:09,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:09,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:09,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb6c2164e674d71f329/lava-logs.yaml 2026-04-14 00:41:09,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:09,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:09,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb6c2164e674d71f329/lava_callback.json.gz 2026-04-14 00:41:09,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:09,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb6c2164e674d71f329 HTTP/1.1" 200 None 2026-04-14 00:41:09,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:09,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:41:09,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:09,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb6c2164e674d71f329 HTTP/1.1" 200 None 2026-04-14 00:41:09,710 - lava_callback - INFO - Completed processing callback for node 69dd8cb6c2164e674d71f329 2026-04-14 00:41:10,227 - lava_callback - INFO - Received callback for node 69dd8cb8c2164e674d71f330 INFO: 172.20.0.1:35610 - "POST /node/69dd8cb8c2164e674d71f330 HTTP/1.0" 202 Accepted 2026-04-14 00:41:10,233 - lava_callback - INFO - Starting async job submit for node 69dd8cb8c2164e674d71f330 2026-04-14 00:41:10,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:10,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb8c2164e674d71f330 HTTP/1.1" 200 None 2026-04-14 00:41:10,277 - lava_callback - DEBUG - Processing node 69dd8cb8c2164e674d71f330: baseline-arm-kontron 2026-04-14 00:41:10,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:10,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:10,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb8c2164e674d71f330/log.txt.gz 2026-04-14 00:41:10,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:10,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:10,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb8c2164e674d71f330/lava-logs.yaml 2026-04-14 00:41:10,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:10,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:10,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69dd8cb8c2164e674d71f330/lava_callback.json.gz 2026-04-14 00:41:11,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:11,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb8c2164e674d71f330 HTTP/1.1" 200 None 2026-04-14 00:41:11,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:11,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:41:11,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:11,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb8c2164e674d71f330 HTTP/1.1" 200 None 2026-04-14 00:41:11,076 - lava_callback - INFO - Completed processing callback for node 69dd8cb8c2164e674d71f330 INFO: 172.20.0.1:35624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:41:26,008 - lava_callback - INFO - Received callback for node 69daea290a04df09a44e8dfa INFO: 172.20.0.1:51860 - "POST /node/69daea290a04df09a44e8dfa HTTP/1.0" 202 Accepted 2026-04-14 00:41:26,017 - lava_callback - INFO - Starting async job submit for node 69daea290a04df09a44e8dfa 2026-04-14 00:41:26,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:26,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea290a04df09a44e8dfa HTTP/1.1" 200 None 2026-04-14 00:41:26,047 - lava_callback - DEBUG - Processing node 69daea290a04df09a44e8dfa: baseline-arm-clabbe 2026-04-14 00:41:26,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daea290a04df09a44e8dfa 2026-04-14 00:41:26,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:26,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea290a04df09a44e8dfa HTTP/1.1" 200 None 2026-04-14 00:41:26,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:26,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:41:26,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:26,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daea290a04df09a44e8dfa HTTP/1.1" 200 None 2026-04-14 00:41:26,150 - lava_callback - ERROR - Error processing callback for node 69daea290a04df09a44e8dfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51870 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:41:35,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44960 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:41:53,323 - lava_callback - INFO - Received callback for node 69dd8cd4c2164e674d71f38d INFO: 172.20.0.1:45790 - "POST /node/69dd8cd4c2164e674d71f38d HTTP/1.0" 202 Accepted 2026-04-14 00:41:53,334 - lava_callback - INFO - Starting async job submit for node 69dd8cd4c2164e674d71f38d 2026-04-14 00:41:53,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:53,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd4c2164e674d71f38d HTTP/1.1" 200 None 2026-04-14 00:41:53,409 - lava_callback - DEBUG - Processing node 69dd8cd4c2164e674d71f38d: ltp-dio 2026-04-14 00:41:54,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:54,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:54,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69dd8cd4c2164e674d71f38d/log.txt.gz 2026-04-14 00:41:55,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:55,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:55,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69dd8cd4c2164e674d71f38d/lava-logs.yaml 2026-04-14 00:41:55,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:41:56,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:41:56,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69dd8cd4c2164e674d71f38d/lava_callback.json.gz 2026-04-14 00:41:56,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:56,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd4c2164e674d71f38d HTTP/1.1" 200 None 2026-04-14 00:41:56,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:56,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:41:56,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:41:56,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cd4c2164e674d71f38d HTTP/1.1" 200 None 2026-04-14 00:41:56,442 - lava_callback - INFO - Completed processing callback for node 69dd8cd4c2164e674d71f38d INFO: 172.20.0.1:45804 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:42:05,779 - lava_callback - INFO - Received callback for node 69daea510a04df09a44e8e36 INFO: 172.20.0.1:38152 - "POST /node/69daea510a04df09a44e8e36 HTTP/1.0" 202 Accepted 2026-04-14 00:42:05,789 - lava_callback - INFO - Starting async job submit for node 69daea510a04df09a44e8e36 2026-04-14 00:42:05,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:05,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea510a04df09a44e8e36 HTTP/1.1" 200 None 2026-04-14 00:42:05,837 - lava_callback - DEBUG - Processing node 69daea510a04df09a44e8e36: baseline-arm-clabbe 2026-04-14 00:42:05,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daea510a04df09a44e8e36 2026-04-14 00:42:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:05,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 00:42:05,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea510a04df09a44e8e36 HTTP/1.1" 200 None 2026-04-14 00:42:05,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:05,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:42:05,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:05,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daea510a04df09a44e8e36 HTTP/1.1" 200 None 2026-04-14 00:42:05,946 - lava_callback - ERROR - Error processing callback for node 69daea510a04df09a44e8e36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:42:45,835 - lava_callback - INFO - Received callback for node 69daea770a04df09a44e8e69 INFO: 172.20.0.1:39126 - "POST /node/69daea770a04df09a44e8e69 HTTP/1.0" 202 Accepted 2026-04-14 00:42:45,841 - lava_callback - INFO - Starting async job submit for node 69daea770a04df09a44e8e69 2026-04-14 00:42:45,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:45,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea770a04df09a44e8e69 HTTP/1.1" 200 None 2026-04-14 00:42:45,857 - lava_callback - DEBUG - Processing node 69daea770a04df09a44e8e69: baseline-arm-clabbe 2026-04-14 00:42:45,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daea770a04df09a44e8e69 2026-04-14 00:42:45,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:45,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daea770a04df09a44e8e69 HTTP/1.1" 200 None 2026-04-14 00:42:45,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:45,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 00:42:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:42:45,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daea770a04df09a44e8e69 HTTP/1.1" 200 None 2026-04-14 00:42:45,918 - lava_callback - ERROR - Error processing callback for node 69daea770a04df09a44e8e69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35058 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:44:10,821 - lava_callback - INFO - Received callback for node 69dd8cdfc2164e674d71f3a7 INFO: 172.20.0.1:45252 - "POST /node/69dd8cdfc2164e674d71f3a7 HTTP/1.0" 202 Accepted 2026-04-14 00:44:10,834 - lava_callback - INFO - Starting async job submit for node 69dd8cdfc2164e674d71f3a7 2026-04-14 00:44:10,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:44:10,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdfc2164e674d71f3a7 HTTP/1.1" 200 None 2026-04-14 00:44:10,884 - lava_callback - DEBUG - Processing node 69dd8cdfc2164e674d71f3a7: ltp-syscalls 2026-04-14 00:44:11,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:44:11,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:44:11,846 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dd8cdfc2164e674d71f3a7/log.txt.gz 2026-04-14 00:44:12,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:44:12,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:44:12,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dd8cdfc2164e674d71f3a7/lava-logs.yaml 2026-04-14 00:44:12,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:44:12,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:44:12,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69dd8cdfc2164e674d71f3a7/lava_callback.json.gz 2026-04-14 00:44:12,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:44:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdfc2164e674d71f3a7 HTTP/1.1" 200 None 2026-04-14 00:44:12,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:44:12,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:44:12,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:44:12,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cdfc2164e674d71f3a7 HTTP/1.1" 200 None 2026-04-14 00:44:12,797 - lava_callback - INFO - Completed processing callback for node 69dd8cdfc2164e674d71f3a7 INFO: 172.20.0.1:45258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:44:35,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:44:35,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET /node/6949eb632060d3d84791d840%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET /node/69d845dab28893fa2e230a74%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42190 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:53:37,739 - lava_callback - INFO - Received callback for node 69dd8ff2c2164e674d71f83c INFO: 172.20.0.1:42198 - "POST /node/69dd8ff2c2164e674d71f83c HTTP/1.0" 202 Accepted 2026-04-14 00:53:37,748 - lava_callback - INFO - Starting async job submit for node 69dd8ff2c2164e674d71f83c 2026-04-14 00:53:37,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:37,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff2c2164e674d71f83c HTTP/1.1" 200 None 2026-04-14 00:53:37,791 - lava_callback - DEBUG - Processing node 69dd8ff2c2164e674d71f83c: baseline-arm64 2026-04-14 00:53:37,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:38,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:38,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff2c2164e674d71f83c/log.txt.gz 2026-04-14 00:53:38,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:38,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:38,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff2c2164e674d71f83c/lava-logs.yaml 2026-04-14 00:53:38,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:38,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:38,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff2c2164e674d71f83c/lava_callback.json.gz 2026-04-14 00:53:38,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:38,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff2c2164e674d71f83c HTTP/1.1" 200 None 2026-04-14 00:53:38,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:38,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:53:38,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:38,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff2c2164e674d71f83c HTTP/1.1" 200 None 2026-04-14 00:53:38,701 - lava_callback - INFO - Completed processing callback for node 69dd8ff2c2164e674d71f83c INFO: 172.20.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46212 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:53:54,982 - lava_callback - INFO - Received callback for node 69dd9003c2164e674d71f860 INFO: 172.20.0.1:53258 - "POST /node/69dd9003c2164e674d71f860 HTTP/1.0" 202 Accepted 2026-04-14 00:53:54,988 - lava_callback - INFO - Starting async job submit for node 69dd9003c2164e674d71f860 2026-04-14 00:53:55,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:55,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9003c2164e674d71f860 HTTP/1.1" 200 None 2026-04-14 00:53:55,031 - lava_callback - DEBUG - Processing node 69dd9003c2164e674d71f860: baseline-arm64 2026-04-14 00:53:55,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:55,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:55,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9003c2164e674d71f860/log.txt.gz 2026-04-14 00:53:55,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:55,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:55,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9003c2164e674d71f860/lava-logs.yaml 2026-04-14 00:53:55,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:55,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:55,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9003c2164e674d71f860/lava_callback.json.gz 2026-04-14 00:53:55,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:55,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9003c2164e674d71f860 HTTP/1.1" 200 None 2026-04-14 00:53:55,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:55,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:53:55,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:55,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9003c2164e674d71f860 HTTP/1.1" 200 None 2026-04-14 00:53:55,788 - lava_callback - INFO - Completed processing callback for node 69dd9003c2164e674d71f860 INFO: 172.20.0.1:53268 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:53:58,814 - lava_callback - INFO - Received callback for node 69dd9014c2164e674d71f8bc INFO: 172.20.0.1:53270 - "POST /node/69dd9014c2164e674d71f8bc HTTP/1.0" 202 Accepted 2026-04-14 00:53:58,820 - lava_callback - INFO - Starting async job submit for node 69dd9014c2164e674d71f8bc 2026-04-14 00:53:58,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:58,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9014c2164e674d71f8bc HTTP/1.1" 200 None 2026-04-14 00:53:58,838 - lava_callback - DEBUG - Processing node 69dd9014c2164e674d71f8bc: baseline-nfs-arm64 2026-04-14 00:53:58,839 - lava_callback - WARNING - Failed to upload log 2026-04-14 00:53:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:59,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:59,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9014c2164e674d71f8bc/lava-logs.yaml 2026-04-14 00:53:59,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:53:59,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:53:59,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9014c2164e674d71f8bc/lava_callback.json.gz 2026-04-14 00:53:59,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:59,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9014c2164e674d71f8bc HTTP/1.1" 200 None 2026-04-14 00:53:59,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:59,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:53:59,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:53:59,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9014c2164e674d71f8bc HTTP/1.1" 200 None 2026-04-14 00:53:59,203 - lava_callback - INFO - Completed processing callback for node 69dd9014c2164e674d71f8bc INFO: 172.20.0.1:59962 - "GET /node/695e99b35b0eee9f47ea8185%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59974 - "GET /node/698f833e3013abef95d01551%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 00:54:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:05,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:54:18,151 - lava_callback - INFO - Received callback for node 69dd8ff7c2164e674d71f84b INFO: 172.20.0.1:54722 - "POST /node/69dd8ff7c2164e674d71f84b HTTP/1.0" 202 Accepted 2026-04-14 00:54:18,159 - lava_callback - INFO - Starting async job submit for node 69dd8ff7c2164e674d71f84b 2026-04-14 00:54:18,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:18,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff7c2164e674d71f84b HTTP/1.1" 200 None 2026-04-14 00:54:18,206 - lava_callback - DEBUG - Processing node 69dd8ff7c2164e674d71f84b: baseline-arm64 2026-04-14 00:54:18,350 - lava_callback - WARNING - Failed to upload log 2026-04-14 00:54:18,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:18,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:18,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff7c2164e674d71f84b/lava-logs.yaml 2026-04-14 00:54:18,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:18,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:18,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff7c2164e674d71f84b/lava_callback.json.gz 2026-04-14 00:54:18,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:18,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff7c2164e674d71f84b HTTP/1.1" 200 None 2026-04-14 00:54:18,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:18,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff7c2164e674d71f84b HTTP/1.1" 200 None 2026-04-14 00:54:19,024 - lava_callback - INFO - Completed processing callback for node 69dd8ff7c2164e674d71f84b 2026-04-14 00:54:20,317 - lava_callback - INFO - Received callback for node 69dd9001c2164e674d71f85a INFO: 172.20.0.1:33148 - "POST /node/69dd9001c2164e674d71f85a HTTP/1.0" 202 Accepted 2026-04-14 00:54:20,323 - lava_callback - INFO - Starting async job submit for node 69dd9001c2164e674d71f85a 2026-04-14 00:54:20,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:20,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9001c2164e674d71f85a HTTP/1.1" 200 None 2026-04-14 00:54:20,360 - lava_callback - DEBUG - Processing node 69dd9001c2164e674d71f85a: baseline-arm64 2026-04-14 00:54:20,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:20,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:20,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9001c2164e674d71f85a/log.txt.gz 2026-04-14 00:54:21,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:21,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:21,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9001c2164e674d71f85a/lava-logs.yaml 2026-04-14 00:54:21,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:21,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:21,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9001c2164e674d71f85a/lava_callback.json.gz 2026-04-14 00:54:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:21,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9001c2164e674d71f85a HTTP/1.1" 200 None 2026-04-14 00:54:21,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:21,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:21,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:21,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9001c2164e674d71f85a HTTP/1.1" 200 None 2026-04-14 00:54:21,568 - lava_callback - INFO - Completed processing callback for node 69dd9001c2164e674d71f85a 2026-04-14 00:54:22,597 - lava_callback - INFO - Received callback for node 69dd9000c2164e674d71f857 INFO: 172.20.0.1:33158 - "POST /node/69dd9000c2164e674d71f857 HTTP/1.0" 202 Accepted 2026-04-14 00:54:22,604 - lava_callback - INFO - Starting async job submit for node 69dd9000c2164e674d71f857 2026-04-14 00:54:22,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:22,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9000c2164e674d71f857 HTTP/1.1" 200 None 2026-04-14 00:54:22,642 - lava_callback - DEBUG - Processing node 69dd9000c2164e674d71f857: baseline-arm64 2026-04-14 00:54:23,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:23,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:23,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9000c2164e674d71f857/log.txt.gz 2026-04-14 00:54:23,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:23,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:23,616 - lava_callback - INFO - Received callback for node 69dd8ff5c2164e674d71f844 INFO: 172.20.0.1:33170 - "POST /node/69dd8ff5c2164e674d71f844 HTTP/1.0" 202 Accepted 2026-04-14 00:54:23,622 - lava_callback - INFO - Starting async job submit for node 69dd8ff5c2164e674d71f844 2026-04-14 00:54:23,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9000c2164e674d71f857/lava-logs.yaml 2026-04-14 00:54:23,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:23,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:23,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f844 HTTP/1.1" 200 None 2026-04-14 00:54:23,669 - lava_callback - DEBUG - Processing node 69dd8ff5c2164e674d71f844: baseline-arm64 2026-04-14 00:54:23,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:23,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9000c2164e674d71f857/lava_callback.json.gz 2026-04-14 00:54:24,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:24,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9000c2164e674d71f857 HTTP/1.1" 200 None 2026-04-14 00:54:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:24,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:24,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:24,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9000c2164e674d71f857 HTTP/1.1" 200 None 2026-04-14 00:54:24,181 - lava_callback - INFO - Completed processing callback for node 69dd9000c2164e674d71f857 2026-04-14 00:54:24,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:24,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff5c2164e674d71f844/log.txt.gz 2026-04-14 00:54:24,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:24,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:24,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff5c2164e674d71f844/lava-logs.yaml 2026-04-14 00:54:24,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:24,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:24,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff5c2164e674d71f844/lava_callback.json.gz 2026-04-14 00:54:25,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f844 HTTP/1.1" 200 None 2026-04-14 00:54:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:25,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:25,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff5c2164e674d71f844 HTTP/1.1" 200 None 2026-04-14 00:54:25,082 - lava_callback - INFO - Completed processing callback for node 69dd8ff5c2164e674d71f844 INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:54:33,824 - lava_callback - INFO - Received callback for node 69dd8ff9c2164e674d71f84e INFO: 172.20.0.1:56176 - "POST /node/69dd8ff9c2164e674d71f84e HTTP/1.0" 202 Accepted 2026-04-14 00:54:33,835 - lava_callback - INFO - Starting async job submit for node 69dd8ff9c2164e674d71f84e 2026-04-14 00:54:33,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:33,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff9c2164e674d71f84e HTTP/1.1" 200 None 2026-04-14 00:54:33,896 - lava_callback - DEBUG - Processing node 69dd8ff9c2164e674d71f84e: baseline-arm64 2026-04-14 00:54:34,114 - lava_callback - WARNING - Failed to upload log 2026-04-14 00:54:34,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:34,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:34,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff9c2164e674d71f84e/lava-logs.yaml 2026-04-14 00:54:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:34,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:34,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff9c2164e674d71f84e/lava_callback.json.gz 2026-04-14 00:54:34,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:34,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff9c2164e674d71f84e HTTP/1.1" 200 None 2026-04-14 00:54:34,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:34,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:34,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:34,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff9c2164e674d71f84e HTTP/1.1" 200 None 2026-04-14 00:54:34,669 - lava_callback - INFO - Completed processing callback for node 69dd8ff9c2164e674d71f84e 2026-04-14 00:54:35,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:35,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:54:39,067 - lava_callback - INFO - Received callback for node 69dd8ff4c2164e674d71f83f INFO: 172.20.0.1:56198 - "POST /node/69dd8ff4c2164e674d71f83f HTTP/1.0" 202 Accepted 2026-04-14 00:54:39,073 - lava_callback - INFO - Starting async job submit for node 69dd8ff4c2164e674d71f83f 2026-04-14 00:54:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:39,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff4c2164e674d71f83f HTTP/1.1" 200 None 2026-04-14 00:54:39,113 - lava_callback - DEBUG - Processing node 69dd8ff4c2164e674d71f83f: baseline-arm64 2026-04-14 00:54:39,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:39,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:39,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff4c2164e674d71f83f/log.txt.gz 2026-04-14 00:54:39,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:39,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:39,771 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff4c2164e674d71f83f/lava-logs.yaml 2026-04-14 00:54:39,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:39,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:39,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff4c2164e674d71f83f/lava_callback.json.gz 2026-04-14 00:54:39,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:39,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff4c2164e674d71f83f HTTP/1.1" 200 None 2026-04-14 00:54:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:39,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:39,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:39,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff4c2164e674d71f83f HTTP/1.1" 200 None 2026-04-14 00:54:39,991 - lava_callback - INFO - Completed processing callback for node 69dd8ff4c2164e674d71f83f INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49928 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:54:57,253 - lava_callback - INFO - Received callback for node 69dd9002c2164e674d71f85d INFO: 172.20.0.1:49934 - "POST /node/69dd9002c2164e674d71f85d HTTP/1.0" 202 Accepted 2026-04-14 00:54:57,260 - lava_callback - INFO - Starting async job submit for node 69dd9002c2164e674d71f85d 2026-04-14 00:54:57,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:57,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9002c2164e674d71f85d HTTP/1.1" 200 None 2026-04-14 00:54:57,296 - lava_callback - DEBUG - Processing node 69dd9002c2164e674d71f85d: baseline-arm64 2026-04-14 00:54:57,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:57,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:57,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9002c2164e674d71f85d/log.txt.gz 2026-04-14 00:54:58,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:58,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:58,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9002c2164e674d71f85d/lava-logs.yaml 2026-04-14 00:54:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:54:58,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:54:58,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9002c2164e674d71f85d/lava_callback.json.gz 2026-04-14 00:54:58,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:58,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9002c2164e674d71f85d HTTP/1.1" 200 None 2026-04-14 00:54:58,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:58,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:54:58,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:58,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9002c2164e674d71f85d HTTP/1.1" 200 None 2026-04-14 00:54:58,648 - lava_callback - INFO - Completed processing callback for node 69dd9002c2164e674d71f85d 2026-04-14 00:54:59,793 - lava_callback - INFO - Received callback for node 69dd900ac2164e674d71f86d INFO: 172.20.0.1:41820 - "POST /node/69dd900ac2164e674d71f86d HTTP/1.0" 202 Accepted 2026-04-14 00:54:59,799 - lava_callback - INFO - Starting async job submit for node 69dd900ac2164e674d71f86d 2026-04-14 00:54:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:54:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900ac2164e674d71f86d HTTP/1.1" 200 None 2026-04-14 00:54:59,840 - lava_callback - DEBUG - Processing node 69dd900ac2164e674d71f86d: baseline-arm64 2026-04-14 00:55:00,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:00,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:00,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900ac2164e674d71f86d/log.txt.gz 2026-04-14 00:55:00,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:00,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:00,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900ac2164e674d71f86d/lava-logs.yaml 2026-04-14 00:55:00,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:00,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:00,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900ac2164e674d71f86d/lava_callback.json.gz 2026-04-14 00:55:00,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:00,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900ac2164e674d71f86d HTTP/1.1" 200 None 2026-04-14 00:55:00,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:00,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:00,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:00,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd900ac2164e674d71f86d HTTP/1.1" 200 None 2026-04-14 00:55:00,845 - lava_callback - INFO - Completed processing callback for node 69dd900ac2164e674d71f86d 2026-04-14 00:55:01,473 - lava_callback - INFO - Received callback for node 69dd9006c2164e674d71f866 INFO: 172.20.0.1:41830 - "POST /node/69dd9006c2164e674d71f866 HTTP/1.0" 202 Accepted 2026-04-14 00:55:01,482 - lava_callback - INFO - Starting async job submit for node 69dd9006c2164e674d71f866 2026-04-14 00:55:01,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:01,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9006c2164e674d71f866 HTTP/1.1" 200 None 2026-04-14 00:55:01,527 - lava_callback - DEBUG - Processing node 69dd9006c2164e674d71f866: baseline-arm64 2026-04-14 00:55:01,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:02,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:02,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9006c2164e674d71f866/log.txt.gz 2026-04-14 00:55:02,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:02,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:02,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9006c2164e674d71f866/lava-logs.yaml 2026-04-14 00:55:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:02,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:02,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9006c2164e674d71f866/lava_callback.json.gz 2026-04-14 00:55:02,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:02,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9006c2164e674d71f866 HTTP/1.1" 200 None 2026-04-14 00:55:02,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:02,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:02,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:02,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9006c2164e674d71f866 HTTP/1.1" 200 None 2026-04-14 00:55:02,598 - lava_callback - INFO - Completed processing callback for node 69dd9006c2164e674d71f866 2026-04-14 00:55:03,495 - lava_callback - INFO - Received callback for node 69dd8ffbc2164e674d71f854 INFO: 172.20.0.1:41842 - "POST /node/69dd8ffbc2164e674d71f854 HTTP/1.0" 202 Accepted 2026-04-14 00:55:03,505 - lava_callback - INFO - Starting async job submit for node 69dd8ffbc2164e674d71f854 2026-04-14 00:55:03,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:03,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ffbc2164e674d71f854 HTTP/1.1" 200 None 2026-04-14 00:55:03,561 - lava_callback - DEBUG - Processing node 69dd8ffbc2164e674d71f854: baseline-arm64 2026-04-14 00:55:03,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:04,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:04,154 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffbc2164e674d71f854/log.txt.gz 2026-04-14 00:55:04,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:04,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:04,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffbc2164e674d71f854/lava-logs.yaml 2026-04-14 00:55:04,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:04,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:04,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffbc2164e674d71f854/lava_callback.json.gz 2026-04-14 00:55:04,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:04,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ffbc2164e674d71f854 HTTP/1.1" 200 None 2026-04-14 00:55:04,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:04,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:04,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:04,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ffbc2164e674d71f854 HTTP/1.1" 200 None 2026-04-14 00:55:04,744 - lava_callback - INFO - Completed processing callback for node 69dd8ffbc2164e674d71f854 2026-04-14 00:55:05,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:05,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33812 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 00:55:15,920 - lava_callback - INFO - Received callback for node 69dd9004c2164e674d71f863 INFO: 172.20.0.1:33826 - "POST /node/69dd9004c2164e674d71f863 HTTP/1.0" 202 Accepted 2026-04-14 00:55:15,926 - lava_callback - INFO - Starting async job submit for node 69dd9004c2164e674d71f863 2026-04-14 00:55:15,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:15,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9004c2164e674d71f863 HTTP/1.1" 200 None 2026-04-14 00:55:15,963 - lava_callback - DEBUG - Processing node 69dd9004c2164e674d71f863: baseline-arm64 2026-04-14 00:55:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:16,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:16,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9004c2164e674d71f863/log.txt.gz 2026-04-14 00:55:16,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:55:16,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:16,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9004c2164e674d71f863/lava-logs.yaml 2026-04-14 00:55:16,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:16,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:16,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9004c2164e674d71f863/lava_callback.json.gz 2026-04-14 00:55:16,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:16,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9004c2164e674d71f863 HTTP/1.1" 200 None 2026-04-14 00:55:16,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:16,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:16,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:16,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9004c2164e674d71f863 HTTP/1.1" 200 None 2026-04-14 00:55:16,913 - lava_callback - INFO - Completed processing callback for node 69dd9004c2164e674d71f863 2026-04-14 00:55:17,077 - lava_callback - INFO - Received callback for node 69dd8ff6c2164e674d71f848 INFO: 172.20.0.1:33840 - "POST /node/69dd8ff6c2164e674d71f848 HTTP/1.0" 202 Accepted 2026-04-14 00:55:17,088 - lava_callback - INFO - Starting async job submit for node 69dd8ff6c2164e674d71f848 2026-04-14 00:55:17,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:17,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff6c2164e674d71f848 HTTP/1.1" 200 None 2026-04-14 00:55:17,138 - lava_callback - DEBUG - Processing node 69dd8ff6c2164e674d71f848: baseline-arm64 2026-04-14 00:55:17,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:17,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:17,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff6c2164e674d71f848/log.txt.gz 2026-04-14 00:55:17,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:17,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:17,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff6c2164e674d71f848/lava-logs.yaml 2026-04-14 00:55:17,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:17,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:17,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ff6c2164e674d71f848/lava_callback.json.gz 2026-04-14 00:55:17,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:18,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff6c2164e674d71f848 HTTP/1.1" 200 None 2026-04-14 00:55:18,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:18,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:18,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:18,052 - lava_callback - INFO - Received callback for node 69dd9011c2164e674d71f8b2 INFO: 172.20.0.1:33848 - "POST /node/69dd9011c2164e674d71f8b2 HTTP/1.0" 202 Accepted 2026-04-14 00:55:18,061 - lava_callback - INFO - Starting async job submit for node 69dd9011c2164e674d71f8b2 2026-04-14 00:55:18,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff6c2164e674d71f848 HTTP/1.1" 200 None 2026-04-14 00:55:18,100 - lava_callback - INFO - Completed processing callback for node 69dd8ff6c2164e674d71f848 2026-04-14 00:55:18,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:18,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9011c2164e674d71f8b2 HTTP/1.1" 200 None 2026-04-14 00:55:18,157 - lava_callback - DEBUG - Processing node 69dd9011c2164e674d71f8b2: baseline-nfs-arm64 2026-04-14 00:55:18,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:18,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:18,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9011c2164e674d71f8b2/log.txt.gz 2026-04-14 00:55:19,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:19,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:19,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9011c2164e674d71f8b2/lava-logs.yaml 2026-04-14 00:55:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:19,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:19,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9011c2164e674d71f8b2/lava_callback.json.gz 2026-04-14 00:55:19,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:19,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9011c2164e674d71f8b2 HTTP/1.1" 200 None 2026-04-14 00:55:19,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:19,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9011c2164e674d71f8b2 HTTP/1.1" 200 None 2026-04-14 00:55:19,546 - lava_callback - INFO - Completed processing callback for node 69dd9011c2164e674d71f8b2 2026-04-14 00:55:22,981 - lava_callback - INFO - Received callback for node 69dd903fc2164e674d71f977 INFO: 172.20.0.1:34272 - "POST /node/69dd903fc2164e674d71f977 HTTP/1.0" 202 Accepted 2026-04-14 00:55:22,987 - lava_callback - INFO - Starting async job submit for node 69dd903fc2164e674d71f977 2026-04-14 00:55:23,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:23,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903fc2164e674d71f977 HTTP/1.1" 200 None 2026-04-14 00:55:23,023 - lava_callback - DEBUG - Processing node 69dd903fc2164e674d71f977: baseline-arm64-foundriesio 2026-04-14 00:55:23,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:23,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:23,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd903fc2164e674d71f977/log.txt.gz 2026-04-14 00:55:23,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:23,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:23,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd903fc2164e674d71f977/lava-logs.yaml 2026-04-14 00:55:23,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:24,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:24,166 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd903fc2164e674d71f977/lava_callback.json.gz 2026-04-14 00:55:24,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:24,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903fc2164e674d71f977 HTTP/1.1" 200 None 2026-04-14 00:55:24,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:24,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:24,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:24,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903fc2164e674d71f977 HTTP/1.1" 200 None 2026-04-14 00:55:24,317 - lava_callback - INFO - Completed processing callback for node 69dd903fc2164e674d71f977 INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:55:27,358 - lava_callback - INFO - Received callback for node 69dd900fc2164e674d71f8ac INFO: 172.20.0.1:34300 - "POST /node/69dd900fc2164e674d71f8ac HTTP/1.0" 202 Accepted 2026-04-14 00:55:27,372 - lava_callback - INFO - Starting async job submit for node 69dd900fc2164e674d71f8ac 2026-04-14 00:55:27,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:27,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900fc2164e674d71f8ac HTTP/1.1" 200 None 2026-04-14 00:55:27,447 - lava_callback - DEBUG - Processing node 69dd900fc2164e674d71f8ac: baseline-nfs-arm64 2026-04-14 00:55:28,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:28,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:28,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900fc2164e674d71f8ac/log.txt.gz 2026-04-14 00:55:28,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:29,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:29,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900fc2164e674d71f8ac/lava-logs.yaml 2026-04-14 00:55:29,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:29,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:29,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900fc2164e674d71f8ac/lava_callback.json.gz 2026-04-14 00:55:29,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900fc2164e674d71f8ac HTTP/1.1" 200 None 2026-04-14 00:55:29,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:30,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:30,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:30,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd900fc2164e674d71f8ac HTTP/1.1" 200 None 2026-04-14 00:55:30,051 - lava_callback - INFO - Completed processing callback for node 69dd900fc2164e674d71f8ac 2026-04-14 00:55:34,671 - lava_callback - INFO - Received callback for node 69dd903cc2164e674d71f967 INFO: 172.20.0.1:60504 - "POST /node/69dd903cc2164e674d71f967 HTTP/1.0" 202 Accepted 2026-04-14 00:55:34,725 - lava_callback - INFO - Starting async job submit for node 69dd903cc2164e674d71f967 2026-04-14 00:55:34,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:34,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903cc2164e674d71f967 HTTP/1.1" 200 None 2026-04-14 00:55:34,811 - lava_callback - DEBUG - Processing node 69dd903cc2164e674d71f967: baseline-arm64-pengutronix 2026-04-14 00:55:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:35,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:35,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903cc2164e674d71f967/log.txt.gz 2026-04-14 00:55:35,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:35,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:35,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-14 00:55:36,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:36,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903cc2164e674d71f967/lava-logs.yaml 2026-04-14 00:55:36,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60520 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:55:36,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:36,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903cc2164e674d71f967/lava_callback.json.gz 2026-04-14 00:55:36,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:36,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903cc2164e674d71f967 HTTP/1.1" 200 None 2026-04-14 00:55:36,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:36,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:36,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:37,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903cc2164e674d71f967 HTTP/1.1" 200 None 2026-04-14 00:55:37,044 - lava_callback - INFO - Completed processing callback for node 69dd903cc2164e674d71f967 INFO: 172.20.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:55:51,914 - lava_callback - INFO - Received callback for node 69dd9028c2164e674d71f91a INFO: 172.20.0.1:49230 - "POST /node/69dd9028c2164e674d71f91a HTTP/1.0" 202 Accepted 2026-04-14 00:55:51,924 - lava_callback - INFO - Starting async job submit for node 69dd9028c2164e674d71f91a 2026-04-14 00:55:51,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:51,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9028c2164e674d71f91a HTTP/1.1" 200 None 2026-04-14 00:55:51,997 - lava_callback - DEBUG - Processing node 69dd9028c2164e674d71f91a: baseline-arm64-broonie 2026-04-14 00:55:52,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:52,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:52,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9028c2164e674d71f91a/log.txt.gz 2026-04-14 00:55:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:53,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:53,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9028c2164e674d71f91a/lava-logs.yaml 2026-04-14 00:55:53,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:53,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:53,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9028c2164e674d71f91a/lava_callback.json.gz 2026-04-14 00:55:53,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:53,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9028c2164e674d71f91a HTTP/1.1" 200 None 2026-04-14 00:55:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:54,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:55:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:54,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9028c2164e674d71f91a HTTP/1.1" 200 None 2026-04-14 00:55:54,059 - lava_callback - INFO - Completed processing callback for node 69dd9028c2164e674d71f91a INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:55:58,211 - lava_callback - INFO - Received callback for node 69dd903dc2164e674d71f970 INFO: 172.20.0.1:49248 - "POST /node/69dd903dc2164e674d71f970 HTTP/1.0" 202 Accepted 2026-04-14 00:55:58,222 - lava_callback - INFO - Starting async job submit for node 69dd903dc2164e674d71f970 2026-04-14 00:55:58,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:55:58,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f970 HTTP/1.1" 200 None 2026-04-14 00:55:58,286 - lava_callback - DEBUG - Processing node 69dd903dc2164e674d71f970: baseline-arm64-pengutronix 2026-04-14 00:55:58,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:58,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:58,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903dc2164e674d71f970/log.txt.gz 2026-04-14 00:55:59,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:55:59,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:55:59,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903dc2164e674d71f970/lava-logs.yaml 2026-04-14 00:55:59,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:00,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:00,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903dc2164e674d71f970/lava_callback.json.gz 2026-04-14 00:56:00,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:00,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f970 HTTP/1.1" 200 None 2026-04-14 00:56:00,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:00,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:00,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:00,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903dc2164e674d71f970 HTTP/1.1" 200 None 2026-04-14 00:56:00,169 - lava_callback - INFO - Completed processing callback for node 69dd903dc2164e674d71f970 2026-04-14 00:56:05,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60848 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:56:09,252 - lava_callback - INFO - Received callback for node 69dd9039c2164e674d71f95f INFO: 172.20.0.1:60862 - "POST /node/69dd9039c2164e674d71f95f HTTP/1.0" 202 Accepted 2026-04-14 00:56:09,261 - lava_callback - INFO - Starting async job submit for node 69dd9039c2164e674d71f95f 2026-04-14 00:56:09,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:09,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9039c2164e674d71f95f HTTP/1.1" 200 None 2026-04-14 00:56:09,343 - lava_callback - DEBUG - Processing node 69dd9039c2164e674d71f95f: baseline-arm64-kontron 2026-04-14 00:56:09,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:10,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:10,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd9039c2164e674d71f95f/log.txt.gz 2026-04-14 00:56:10,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:10,416 - lava_callback - INFO - Received callback for node 69dd903bc2164e674d71f964 INFO: 172.20.0.1:44734 - "POST /node/69dd903bc2164e674d71f964 HTTP/1.0" 202 Accepted 2026-04-14 00:56:10,426 - lava_callback - INFO - Starting async job submit for node 69dd903bc2164e674d71f964 2026-04-14 00:56:10,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:10,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903bc2164e674d71f964 HTTP/1.1" 200 None 2026-04-14 00:56:10,504 - lava_callback - DEBUG - Processing node 69dd903bc2164e674d71f964: baseline-arm64-kontron 2026-04-14 00:56:10,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:10,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd9039c2164e674d71f95f/lava-logs.yaml 2026-04-14 00:56:10,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:10,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:11,123 - lava_callback - INFO - Received callback for node 69dd902dc2164e674d71f932 2026-04-14 00:56:11,134 - lava_callback - INFO - Starting async job submit for node 69dd902dc2164e674d71f932 INFO: 172.20.0.1:44742 - "POST /node/69dd902dc2164e674d71f932 HTTP/1.0" 202 Accepted 2026-04-14 00:56:11,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:11,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902dc2164e674d71f932 HTTP/1.1" 200 None 2026-04-14 00:56:11,204 - lava_callback - DEBUG - Processing node 69dd902dc2164e674d71f932: baseline-arm64-broonie 2026-04-14 00:56:11,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:11,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd9039c2164e674d71f95f/lava_callback.json.gz 2026-04-14 00:56:11,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:11,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd903bc2164e674d71f964/log.txt.gz 2026-04-14 00:56:11,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:11,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9039c2164e674d71f95f HTTP/1.1" 200 None 2026-04-14 00:56:11,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:11,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:11,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:11,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9039c2164e674d71f95f HTTP/1.1" 200 None 2026-04-14 00:56:11,956 - lava_callback - INFO - Completed processing callback for node 69dd9039c2164e674d71f95f 2026-04-14 00:56:12,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:12,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:12,276 - lava_callback - INFO - Received callback for node 69dd902bc2164e674d71f923 INFO: 172.20.0.1:44750 - "POST /node/69dd902bc2164e674d71f923 HTTP/1.0" 202 Accepted 2026-04-14 00:56:12,293 - lava_callback - INFO - Starting async job submit for node 69dd902bc2164e674d71f923 2026-04-14 00:56:12,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:12,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902bc2164e674d71f923 HTTP/1.1" 200 None 2026-04-14 00:56:12,410 - lava_callback - DEBUG - Processing node 69dd902bc2164e674d71f923: baseline-arm64-broonie 2026-04-14 00:56:12,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:12,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902dc2164e674d71f932/log.txt.gz 2026-04-14 00:56:13,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:13,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd903bc2164e674d71f964/lava-logs.yaml 2026-04-14 00:56:13,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:13,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:13,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:13,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:13,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69dd903bc2164e674d71f964/lava_callback.json.gz 2026-04-14 00:56:13,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:13,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903bc2164e674d71f964 HTTP/1.1" 200 None 2026-04-14 00:56:13,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:13,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903bc2164e674d71f964 HTTP/1.1" 200 None 2026-04-14 00:56:13,814 - lava_callback - INFO - Completed processing callback for node 69dd903bc2164e674d71f964 2026-04-14 00:56:13,920 - lava_callback - INFO - Received callback for node 69dd9017c2164e674d71f8c2 INFO: 172.20.0.1:44754 - "POST /node/69dd9017c2164e674d71f8c2 HTTP/1.0" 202 Accepted 2026-04-14 00:56:13,931 - lava_callback - INFO - Starting async job submit for node 69dd9017c2164e674d71f8c2 2026-04-14 00:56:13,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:14,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9017c2164e674d71f8c2 HTTP/1.1" 200 None 2026-04-14 00:56:14,028 - lava_callback - DEBUG - Processing node 69dd9017c2164e674d71f8c2: baseline-nfs-arm64 2026-04-14 00:56:14,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:14,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902bc2164e674d71f923/log.txt.gz 2026-04-14 00:56:14,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:14,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902dc2164e674d71f932/lava-logs.yaml 2026-04-14 00:56:14,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:14,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:14,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902dc2164e674d71f932/lava_callback.json.gz 2026-04-14 00:56:15,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:15,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:15,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902dc2164e674d71f932 HTTP/1.1" 200 None 2026-04-14 00:56:15,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:15,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None INFO: 172.20.0.1:44758 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 00:56:15,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:15,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd902dc2164e674d71f932 HTTP/1.1" 200 None 2026-04-14 00:56:15,261 - lava_callback - INFO - Completed processing callback for node 69dd902dc2164e674d71f932 2026-04-14 00:56:15,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:15,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:15,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9017c2164e674d71f8c2/log.txt.gz 2026-04-14 00:56:15,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:15,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902bc2164e674d71f923/lava-logs.yaml 2026-04-14 00:56:15,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:16,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:16,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:16,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902bc2164e674d71f923/lava_callback.json.gz 2026-04-14 00:56:16,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:16,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902bc2164e674d71f923 HTTP/1.1" 200 None 2026-04-14 00:56:16,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:16,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:16,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:16,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd902bc2164e674d71f923 HTTP/1.1" 200 None 2026-04-14 00:56:16,493 - lava_callback - INFO - Completed processing callback for node 69dd902bc2164e674d71f923 INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:56:16,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:16,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9017c2164e674d71f8c2/lava-logs.yaml 2026-04-14 00:56:17,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:17,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:17,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9017c2164e674d71f8c2/lava_callback.json.gz 2026-04-14 00:56:17,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:17,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9017c2164e674d71f8c2 HTTP/1.1" 200 None 2026-04-14 00:56:17,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:17,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:17,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:17,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9017c2164e674d71f8c2 HTTP/1.1" 200 None 2026-04-14 00:56:17,621 - lava_callback - INFO - Completed processing callback for node 69dd9017c2164e674d71f8c2 2026-04-14 00:56:19,811 - lava_callback - INFO - Received callback for node 69dd9015c2164e674d71f8bf INFO: 172.20.0.1:33390 - "POST /node/69dd9015c2164e674d71f8bf HTTP/1.0" 202 Accepted 2026-04-14 00:56:19,822 - lava_callback - INFO - Starting async job submit for node 69dd9015c2164e674d71f8bf 2026-04-14 00:56:19,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:19,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9015c2164e674d71f8bf HTTP/1.1" 200 None 2026-04-14 00:56:19,896 - lava_callback - DEBUG - Processing node 69dd9015c2164e674d71f8bf: baseline-nfs-arm64 2026-04-14 00:56:20,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:20,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:20,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9015c2164e674d71f8bf/log.txt.gz 2026-04-14 00:56:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:21,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:21,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9015c2164e674d71f8bf/lava-logs.yaml 2026-04-14 00:56:21,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:22,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:22,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9015c2164e674d71f8bf/lava_callback.json.gz 2026-04-14 00:56:22,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:22,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9015c2164e674d71f8bf HTTP/1.1" 200 None 2026-04-14 00:56:22,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:22,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:22,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:22,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9015c2164e674d71f8bf HTTP/1.1" 200 None 2026-04-14 00:56:22,189 - lava_callback - INFO - Completed processing callback for node 69dd9015c2164e674d71f8bf 2026-04-14 00:56:25,031 - lava_callback - INFO - Received callback for node 69dd9019c2164e674d71f8c9 INFO: 172.20.0.1:33402 - "POST /node/69dd9019c2164e674d71f8c9 HTTP/1.0" 202 Accepted 2026-04-14 00:56:25,038 - lava_callback - INFO - Starting async job submit for node 69dd9019c2164e674d71f8c9 2026-04-14 00:56:25,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:25,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8c9 HTTP/1.1" 200 None 2026-04-14 00:56:25,077 - lava_callback - DEBUG - Processing node 69dd9019c2164e674d71f8c9: baseline-nfs-arm64 2026-04-14 00:56:25,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:25,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:25,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9019c2164e674d71f8c9/log.txt.gz 2026-04-14 00:56:25,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:26,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:26,023 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9019c2164e674d71f8c9/lava-logs.yaml 2026-04-14 00:56:26,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:26,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:26,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9019c2164e674d71f8c9/lava_callback.json.gz 2026-04-14 00:56:26,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:26,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8c9 HTTP/1.1" 200 None 2026-04-14 00:56:26,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:26,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:56:26,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:26,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9019c2164e674d71f8c9 HTTP/1.1" 200 None 2026-04-14 00:56:26,339 - lava_callback - INFO - Completed processing callback for node 69dd9019c2164e674d71f8c9 INFO: 172.20.0.1:33418 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:56:36,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:36,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:56:58,469 - lava_callback - INFO - Received callback for node 69dd900cc2164e674d71f873 INFO: 172.20.0.1:50272 - "POST /node/69dd900cc2164e674d71f873 HTTP/1.0" 202 Accepted 2026-04-14 00:56:58,476 - lava_callback - INFO - Starting async job submit for node 69dd900cc2164e674d71f873 2026-04-14 00:56:58,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:58,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900cc2164e674d71f873 HTTP/1.1" 200 None 2026-04-14 00:56:58,514 - lava_callback - DEBUG - Processing node 69dd900cc2164e674d71f873: baseline-nfs-arm64 2026-04-14 00:56:58,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:58,848 - lava_callback - INFO - Received callback for node 69dd8c98c2164e674d71f289 INFO: 172.20.0.1:50286 - "POST /node/69dd8c98c2164e674d71f289 HTTP/1.0" 202 Accepted 2026-04-14 00:56:58,859 - lava_callback - INFO - Starting async job submit for node 69dd8c98c2164e674d71f289 2026-04-14 00:56:58,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:56:58,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c98c2164e674d71f289 HTTP/1.1" 200 None 2026-04-14 00:56:58,930 - lava_callback - DEBUG - Processing node 69dd8c98c2164e674d71f289: baseline-arm 2026-04-14 00:56:58,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:59,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900cc2164e674d71f873/log.txt.gz 2026-04-14 00:56:59,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:59,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:59,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:59,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900cc2164e674d71f873/lava-logs.yaml 2026-04-14 00:56:59,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:56:59,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:56:59,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f289/log.txt.gz 2026-04-14 00:57:00,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:00,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900cc2164e674d71f873/lava_callback.json.gz 2026-04-14 00:57:00,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900cc2164e674d71f873 HTTP/1.1" 200 None 2026-04-14 00:57:00,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:57:00,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:57:00,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd900cc2164e674d71f873 HTTP/1.1" 200 None 2026-04-14 00:57:00,324 - lava_callback - INFO - Completed processing callback for node 69dd900cc2164e674d71f873 2026-04-14 00:57:00,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:00,577 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f289/lava-logs.yaml 2026-04-14 00:57:00,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:57:00,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:00,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd8c98c2164e674d71f289/lava_callback.json.gz DEBUG: Setup failed for 69dd8c98c2164e674d71f289. Transitting job node result: incomplete -> fail 2026-04-14 00:57:00,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c98c2164e674d71f289 HTTP/1.1" 200 None 2026-04-14 00:57:00,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 00:57:00,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:00,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c98c2164e674d71f289 HTTP/1.1" 200 None 2026-04-14 00:57:01,095 - lava_callback - INFO - Completed processing callback for node 69dd8c98c2164e674d71f289 2026-04-14 00:57:06,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:06,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:57:31,098 - lava_callback - INFO - Received callback for node 69dd9029c2164e674d71f91d INFO: 172.20.0.1:53680 - "POST /node/69dd9029c2164e674d71f91d HTTP/1.0" 202 Accepted 2026-04-14 00:57:31,104 - lava_callback - INFO - Starting async job submit for node 69dd9029c2164e674d71f91d 2026-04-14 00:57:31,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9029c2164e674d71f91d HTTP/1.1" 200 None 2026-04-14 00:57:31,196 - lava_callback - DEBUG - Processing node 69dd9029c2164e674d71f91d: baseline-arm64-broonie 2026-04-14 00:57:31,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:57:31,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:31,680 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9029c2164e674d71f91d/log.txt.gz 2026-04-14 00:57:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:57:32,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:32,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9029c2164e674d71f91d/lava-logs.yaml 2026-04-14 00:57:32,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:57:32,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:57:32,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9029c2164e674d71f91d/lava_callback.json.gz 2026-04-14 00:57:32,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:32,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9029c2164e674d71f91d HTTP/1.1" 200 None 2026-04-14 00:57:32,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:32,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:57:32,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:32,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9029c2164e674d71f91d HTTP/1.1" 200 None 2026-04-14 00:57:32,282 - lava_callback - INFO - Completed processing callback for node 69dd9029c2164e674d71f91d 2026-04-14 00:57:36,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:57:36,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET /node/691a4ba36158b9fa05ad225d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42094 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:58:11,487 - lava_callback - INFO - Received callback for node 69dd902ec2164e674d71f93c INFO: 172.20.0.1:42074 - "POST /node/69dd902ec2164e674d71f93c HTTP/1.0" 202 Accepted 2026-04-14 00:58:11,493 - lava_callback - INFO - Starting async job submit for node 69dd902ec2164e674d71f93c 2026-04-14 00:58:11,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:58:11,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902ec2164e674d71f93c HTTP/1.1" 200 None 2026-04-14 00:58:11,539 - lava_callback - DEBUG - Processing node 69dd902ec2164e674d71f93c: baseline-arm64-broonie 2026-04-14 00:58:11,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:58:11,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:58:11,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ec2164e674d71f93c/log.txt.gz 2026-04-14 00:58:12,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:58:12,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:58:12,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ec2164e674d71f93c/lava-logs.yaml 2026-04-14 00:58:12,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 00:58:12,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 00:58:12,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ec2164e674d71f93c/lava_callback.json.gz 2026-04-14 00:58:12,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:58:12,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902ec2164e674d71f93c HTTP/1.1" 200 None 2026-04-14 00:58:12,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:58:12,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 00:58:12,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:58:12,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd902ec2164e674d71f93c HTTP/1.1" 200 None 2026-04-14 00:58:12,596 - lava_callback - INFO - Completed processing callback for node 69dd902ec2164e674d71f93c INFO: 172.20.0.1:42086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:58:36,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:58:36,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:59:16,863 - lava_callback - INFO - Received callback for node 69daee5e0a04df09a44e9374 INFO: 172.20.0.1:54134 - "POST /node/69daee5e0a04df09a44e9374 HTTP/1.0" 202 Accepted 2026-04-14 00:59:16,872 - lava_callback - INFO - Starting async job submit for node 69daee5e0a04df09a44e9374 2026-04-14 00:59:16,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:16,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5e0a04df09a44e9374 HTTP/1.1" 200 None 2026-04-14 00:59:16,899 - lava_callback - DEBUG - Processing node 69daee5e0a04df09a44e9374: baseline-arm64-baylibre 2026-04-14 00:59:16,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee5e0a04df09a44e9374 2026-04-14 00:59:16,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:16,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5e0a04df09a44e9374 HTTP/1.1" 200 None 2026-04-14 00:59:16,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:16,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:16,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:16,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee5e0a04df09a44e9374 HTTP/1.1" 200 None 2026-04-14 00:59:16,995 - lava_callback - ERROR - Error processing callback for node 69daee5e0a04df09a44e9374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:17,540 - lava_callback - INFO - Received callback for node 69daee5f0a04df09a44e9377 INFO: 172.20.0.1:54136 - "POST /node/69daee5f0a04df09a44e9377 HTTP/1.0" 202 Accepted 2026-04-14 00:59:17,549 - lava_callback - INFO - Starting async job submit for node 69daee5f0a04df09a44e9377 2026-04-14 00:59:17,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:17,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5f0a04df09a44e9377 HTTP/1.1" 200 None 2026-04-14 00:59:17,580 - lava_callback - DEBUG - Processing node 69daee5f0a04df09a44e9377: baseline-arm64-baylibre 2026-04-14 00:59:17,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee5f0a04df09a44e9377 2026-04-14 00:59:17,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:17,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5f0a04df09a44e9377 HTTP/1.1" 200 None 2026-04-14 00:59:17,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:17,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:17,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee5f0a04df09a44e9377 HTTP/1.1" 200 None 2026-04-14 00:59:17,680 - lava_callback - ERROR - Error processing callback for node 69daee5f0a04df09a44e9377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54144 - "GET /node/693aeff9fee8383e92b68e41%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 00:59:18,246 - lava_callback - INFO - Received callback for node 69daee5c0a04df09a44e9371 INFO: 172.20.0.1:54160 - "POST /node/69daee5c0a04df09a44e9371 HTTP/1.0" 202 Accepted 2026-04-14 00:59:18,256 - lava_callback - INFO - Starting async job submit for node 69daee5c0a04df09a44e9371 2026-04-14 00:59:18,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:18,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5c0a04df09a44e9371 HTTP/1.1" 200 None 2026-04-14 00:59:18,289 - lava_callback - DEBUG - Processing node 69daee5c0a04df09a44e9371: baseline-arm64-baylibre 2026-04-14 00:59:18,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee5c0a04df09a44e9371 2026-04-14 00:59:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:18,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee5c0a04df09a44e9371 HTTP/1.1" 200 None 2026-04-14 00:59:18,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:18,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:18,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:18,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee5c0a04df09a44e9371 HTTP/1.1" 200 None 2026-04-14 00:59:18,381 - lava_callback - ERROR - Error processing callback for node 69daee5c0a04df09a44e9371: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54170 - "GET /node/693e79193c8f1be6d3cf0682%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 00:59:18,951 - lava_callback - INFO - Received callback for node 69daee610a04df09a44e937e INFO: 172.20.0.1:54180 - "POST /node/69daee610a04df09a44e937e HTTP/1.0" 202 Accepted 2026-04-14 00:59:18,961 - lava_callback - INFO - Starting async job submit for node 69daee610a04df09a44e937e 2026-04-14 00:59:18,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:19,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee610a04df09a44e937e HTTP/1.1" 200 None 2026-04-14 00:59:19,009 - lava_callback - DEBUG - Processing node 69daee610a04df09a44e937e: baseline-arm64-baylibre 2026-04-14 00:59:19,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee610a04df09a44e937e 2026-04-14 00:59:19,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:19,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee610a04df09a44e937e HTTP/1.1" 200 None 2026-04-14 00:59:19,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:19,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:19,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:19,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee610a04df09a44e937e HTTP/1.1" 200 None 2026-04-14 00:59:19,088 - lava_callback - ERROR - Error processing callback for node 69daee610a04df09a44e937e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40342 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:59:36,807 - lava_callback - INFO - Received callback for node 69daee640a04df09a44e93b9 INFO: 172.20.0.1:40344 - "POST /node/69daee640a04df09a44e93b9 HTTP/1.0" 202 Accepted 2026-04-14 00:59:36,815 - lava_callback - INFO - Starting async job submit for node 69daee640a04df09a44e93b9 2026-04-14 00:59:36,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:36,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee640a04df09a44e93b9 HTTP/1.1" 200 None 2026-04-14 00:59:36,832 - lava_callback - DEBUG - Processing node 69daee640a04df09a44e93b9: baseline-arm64-baylibre 2026-04-14 00:59:36,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee640a04df09a44e93b9 2026-04-14 00:59:36,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:36,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee640a04df09a44e93b9 HTTP/1.1" 200 None 2026-04-14 00:59:36,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:36,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee640a04df09a44e93b9 HTTP/1.1" 200 None 2026-04-14 00:59:36,899 - lava_callback - ERROR - Error processing callback for node 69daee640a04df09a44e93b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:37,455 - lava_callback - INFO - Received callback for node 69daee630a04df09a44e93b3 INFO: 172.20.0.1:40360 - "POST /node/69daee630a04df09a44e93b3 HTTP/1.0" 202 Accepted 2026-04-14 00:59:37,460 - lava_callback - INFO - Starting async job submit for node 69daee630a04df09a44e93b3 2026-04-14 00:59:37,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:37,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee630a04df09a44e93b3 HTTP/1.1" 200 None 2026-04-14 00:59:37,486 - lava_callback - DEBUG - Processing node 69daee630a04df09a44e93b3: baseline-arm64-baylibre 2026-04-14 00:59:37,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee630a04df09a44e93b3 2026-04-14 00:59:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:37,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee630a04df09a44e93b3 HTTP/1.1" 200 None 2026-04-14 00:59:37,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:37,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:37,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:37,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee630a04df09a44e93b3 HTTP/1.1" 200 None 2026-04-14 00:59:37,539 - lava_callback - ERROR - Error processing callback for node 69daee630a04df09a44e93b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60192 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:59:46,602 - lava_callback - INFO - Received callback for node 69daee740a04df09a44e93ec INFO: 172.20.0.1:60208 - "POST /node/69daee740a04df09a44e93ec HTTP/1.0" 202 Accepted 2026-04-14 00:59:46,607 - lava_callback - INFO - Starting async job submit for node 69daee740a04df09a44e93ec 2026-04-14 00:59:46,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee740a04df09a44e93ec HTTP/1.1" 200 None 2026-04-14 00:59:46,623 - lava_callback - DEBUG - Processing node 69daee740a04df09a44e93ec: baseline-arm64-clabbe 2026-04-14 00:59:46,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee740a04df09a44e93ec 2026-04-14 00:59:46,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:46,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee740a04df09a44e93ec HTTP/1.1" 200 None 2026-04-14 00:59:46,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:46,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:46,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:46,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee740a04df09a44e93ec HTTP/1.1" 200 None 2026-04-14 00:59:46,680 - lava_callback - ERROR - Error processing callback for node 69daee740a04df09a44e93ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:47,303 - lava_callback - INFO - Received callback for node 69daee770a04df09a44e93ef INFO: 172.20.0.1:60222 - "POST /node/69daee770a04df09a44e93ef HTTP/1.0" 202 Accepted 2026-04-14 00:59:47,309 - lava_callback - INFO - Starting async job submit for node 69daee770a04df09a44e93ef 2026-04-14 00:59:47,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:47,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee770a04df09a44e93ef HTTP/1.1" 200 None 2026-04-14 00:59:47,325 - lava_callback - DEBUG - Processing node 69daee770a04df09a44e93ef: baseline-arm64-clabbe 2026-04-14 00:59:47,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee770a04df09a44e93ef 2026-04-14 00:59:47,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:47,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee770a04df09a44e93ef HTTP/1.1" 200 None 2026-04-14 00:59:47,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:47,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:47,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:47,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee770a04df09a44e93ef HTTP/1.1" 200 None 2026-04-14 00:59:47,400 - lava_callback - ERROR - Error processing callback for node 69daee770a04df09a44e93ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:47,981 - lava_callback - INFO - Received callback for node 69daee770a04df09a44e93f2 INFO: 172.20.0.1:60238 - "POST /node/69daee770a04df09a44e93f2 HTTP/1.0" 202 Accepted 2026-04-14 00:59:47,988 - lava_callback - INFO - Starting async job submit for node 69daee770a04df09a44e93f2 2026-04-14 00:59:47,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee770a04df09a44e93f2 HTTP/1.1" 200 None 2026-04-14 00:59:48,003 - lava_callback - DEBUG - Processing node 69daee770a04df09a44e93f2: baseline-arm64-clabbe 2026-04-14 00:59:48,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee770a04df09a44e93f2 2026-04-14 00:59:48,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee770a04df09a44e93f2 HTTP/1.1" 200 None 2026-04-14 00:59:48,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee770a04df09a44e93f2 HTTP/1.1" 200 None 2026-04-14 00:59:48,050 - lava_callback - ERROR - Error processing callback for node 69daee770a04df09a44e93f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:48,676 - lava_callback - INFO - Received callback for node 69daee780a04df09a44e93f5 INFO: 172.20.0.1:60246 - "POST /node/69daee780a04df09a44e93f5 HTTP/1.0" 202 Accepted 2026-04-14 00:59:48,683 - lava_callback - INFO - Starting async job submit for node 69daee780a04df09a44e93f5 2026-04-14 00:59:48,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee780a04df09a44e93f5 HTTP/1.1" 200 None 2026-04-14 00:59:48,701 - lava_callback - DEBUG - Processing node 69daee780a04df09a44e93f5: baseline-arm64-clabbe 2026-04-14 00:59:48,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee780a04df09a44e93f5 2026-04-14 00:59:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee780a04df09a44e93f5 HTTP/1.1" 200 None 2026-04-14 00:59:48,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:48,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:48,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee780a04df09a44e93f5 HTTP/1.1" 200 None 2026-04-14 00:59:48,763 - lava_callback - ERROR - Error processing callback for node 69daee780a04df09a44e93f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:49,360 - lava_callback - INFO - Received callback for node 69daee790a04df09a44e93f8 INFO: 172.20.0.1:60248 - "POST /node/69daee790a04df09a44e93f8 HTTP/1.0" 202 Accepted 2026-04-14 00:59:49,366 - lava_callback - INFO - Starting async job submit for node 69daee790a04df09a44e93f8 2026-04-14 00:59:49,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee790a04df09a44e93f8 HTTP/1.1" 200 None 2026-04-14 00:59:49,402 - lava_callback - DEBUG - Processing node 69daee790a04df09a44e93f8: baseline-arm64-clabbe 2026-04-14 00:59:49,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee790a04df09a44e93f8 2026-04-14 00:59:49,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:49,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee790a04df09a44e93f8 HTTP/1.1" 200 None 2026-04-14 00:59:49,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:49,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:49,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:49,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee790a04df09a44e93f8 HTTP/1.1" 200 None 2026-04-14 00:59:49,463 - lava_callback - ERROR - Error processing callback for node 69daee790a04df09a44e93f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:50,063 - lava_callback - INFO - Received callback for node 69daee7b0a04df09a44e93fe INFO: 172.20.0.1:36744 - "POST /node/69daee7b0a04df09a44e93fe HTTP/1.0" 202 Accepted 2026-04-14 00:59:50,070 - lava_callback - INFO - Starting async job submit for node 69daee7b0a04df09a44e93fe 2026-04-14 00:59:50,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7b0a04df09a44e93fe HTTP/1.1" 200 None 2026-04-14 00:59:50,087 - lava_callback - DEBUG - Processing node 69daee7b0a04df09a44e93fe: baseline-arm64-clabbe 2026-04-14 00:59:50,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee7b0a04df09a44e93fe 2026-04-14 00:59:50,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7b0a04df09a44e93fe HTTP/1.1" 200 None 2026-04-14 00:59:50,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:50,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee7b0a04df09a44e93fe HTTP/1.1" 200 None 2026-04-14 00:59:50,151 - lava_callback - ERROR - Error processing callback for node 69daee7b0a04df09a44e93fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 00:59:50,723 - lava_callback - INFO - Received callback for node 69daee7a0a04df09a44e93fb INFO: 172.20.0.1:36758 - "POST /node/69daee7a0a04df09a44e93fb HTTP/1.0" 202 Accepted 2026-04-14 00:59:50,729 - lava_callback - INFO - Starting async job submit for node 69daee7a0a04df09a44e93fb 2026-04-14 00:59:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7a0a04df09a44e93fb HTTP/1.1" 200 None 2026-04-14 00:59:50,745 - lava_callback - DEBUG - Processing node 69daee7a0a04df09a44e93fb: baseline-arm64-clabbe 2026-04-14 00:59:50,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee7a0a04df09a44e93fb 2026-04-14 00:59:50,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7a0a04df09a44e93fb HTTP/1.1" 200 None 2026-04-14 00:59:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 00:59:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:50,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee7a0a04df09a44e93fb HTTP/1.1" 200 None 2026-04-14 00:59:50,807 - lava_callback - ERROR - Error processing callback for node 69daee7a0a04df09a44e93fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36774 - "GET / HTTP/1.0" 200 OK 2026-04-14 00:59:56,813 - lava_callback - INFO - Received callback for node 69daee7d0a04df09a44e9405 INFO: 172.20.0.1:36776 - "POST /node/69daee7d0a04df09a44e9405 HTTP/1.0" 202 Accepted 2026-04-14 00:59:56,818 - lava_callback - INFO - Starting async job submit for node 69daee7d0a04df09a44e9405 2026-04-14 00:59:56,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:56,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7d0a04df09a44e9405 HTTP/1.1" 200 None 2026-04-14 00:59:56,835 - lava_callback - DEBUG - Processing node 69daee7d0a04df09a44e9405: baseline-arm64-baylibre 2026-04-14 00:59:56,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daee7d0a04df09a44e9405 2026-04-14 00:59:56,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:56,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daee7d0a04df09a44e9405 HTTP/1.1" 200 None 2026-04-14 00:59:56,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:56,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 00:59:56,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 00:59:56,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daee7d0a04df09a44e9405 HTTP/1.1" 200 None 2026-04-14 00:59:56,894 - lava_callback - ERROR - Error processing callback for node 69daee7d0a04df09a44e9405: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34914 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:00:56,918 - lava_callback - INFO - Received callback for node 69daeec60a04df09a44e955a INFO: 172.20.0.1:34922 - "POST /node/69daeec60a04df09a44e955a HTTP/1.0" 202 Accepted 2026-04-14 01:00:56,923 - lava_callback - INFO - Starting async job submit for node 69daeec60a04df09a44e955a 2026-04-14 01:00:56,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:00:56,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daeec60a04df09a44e955a HTTP/1.1" 200 None 2026-04-14 01:00:56,940 - lava_callback - DEBUG - Processing node 69daeec60a04df09a44e955a: baseline-arm64-baylibre 2026-04-14 01:00:56,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daeec60a04df09a44e955a 2026-04-14 01:00:56,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:00:56,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daeec60a04df09a44e955a HTTP/1.1" 200 None 2026-04-14 01:00:56,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:00:56,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:00:56,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:00:56,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daeec60a04df09a44e955a HTTP/1.1" 200 None 2026-04-14 01:00:56,991 - lava_callback - ERROR - Error processing callback for node 69daeec60a04df09a44e955a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 01:01:04,436 - lava_callback - INFO - Received callback for node 69dd903ec2164e674d71f974 INFO: 172.20.0.1:57546 - "POST /node/69dd903ec2164e674d71f974 HTTP/1.0" 202 Accepted 2026-04-14 01:01:04,442 - lava_callback - INFO - Starting async job submit for node 69dd903ec2164e674d71f974 2026-04-14 01:01:04,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:04,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903ec2164e674d71f974 HTTP/1.1" 200 None 2026-04-14 01:01:04,477 - lava_callback - DEBUG - Processing node 69dd903ec2164e674d71f974: baseline-arm64-pengutronix 2026-04-14 01:01:04,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:04,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:04,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903ec2164e674d71f974/log.txt.gz 2026-04-14 01:01:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:05,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:05,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903ec2164e674d71f974/lava-logs.yaml 2026-04-14 01:01:05,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:05,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:05,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69dd903ec2164e674d71f974/lava_callback.json.gz 2026-04-14 01:01:05,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:05,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903ec2164e674d71f974 HTTP/1.1" 200 None 2026-04-14 01:01:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:05,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:01:05,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:05,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903ec2164e674d71f974 HTTP/1.1" 200 None 2026-04-14 01:01:05,484 - lava_callback - INFO - Completed processing callback for node 69dd903ec2164e674d71f974 2026-04-14 01:01:06,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:06,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52902 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:01:21,514 - lava_callback - INFO - Received callback for node 69dd900bc2164e674d71f870 INFO: 172.20.0.1:49964 - "POST /node/69dd900bc2164e674d71f870 HTTP/1.0" 202 Accepted 2026-04-14 01:01:21,521 - lava_callback - INFO - Starting async job submit for node 69dd900bc2164e674d71f870 2026-04-14 01:01:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900bc2164e674d71f870 HTTP/1.1" 200 None 2026-04-14 01:01:21,573 - lava_callback - DEBUG - Processing node 69dd900bc2164e674d71f870: baseline-arm64 2026-04-14 01:01:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:22,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:22,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900bc2164e674d71f870/log.txt.gz 2026-04-14 01:01:22,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:22,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:22,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900bc2164e674d71f870/lava-logs.yaml 2026-04-14 01:01:22,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:01:22,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:01:22,625 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd900bc2164e674d71f870/lava_callback.json.gz DEBUG: Setup failed for 69dd900bc2164e674d71f870. Transitting job node result: incomplete -> fail 2026-04-14 01:01:22,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:22,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900bc2164e674d71f870 HTTP/1.1" 200 None 2026-04-14 01:01:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:22,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:01:22,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:22,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd900bc2164e674d71f870 HTTP/1.1" 200 None 2026-04-14 01:01:22,853 - lava_callback - INFO - Completed processing callback for node 69dd900bc2164e674d71f870 INFO: 172.20.0.1:49974 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:01:36,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:01:36,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59252 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:02:16,952 - lava_callback - INFO - Received callback for node 69daef0f0a04df09a44e95d3 INFO: 172.20.0.1:59262 - "POST /node/69daef0f0a04df09a44e95d3 HTTP/1.0" 202 Accepted 2026-04-14 01:02:16,958 - lava_callback - INFO - Starting async job submit for node 69daef0f0a04df09a44e95d3 2026-04-14 01:02:16,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:16,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef0f0a04df09a44e95d3 HTTP/1.1" 200 None 2026-04-14 01:02:16,975 - lava_callback - DEBUG - Processing node 69daef0f0a04df09a44e95d3: baseline-arm64-baylibre 2026-04-14 01:02:16,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daef0f0a04df09a44e95d3 2026-04-14 01:02:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:16,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef0f0a04df09a44e95d3 HTTP/1.1" 200 None 2026-04-14 01:02:16,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:17,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:02:17,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:17,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daef0f0a04df09a44e95d3 HTTP/1.1" 200 None 2026-04-14 01:02:17,046 - lava_callback - ERROR - Error processing callback for node 69daef0f0a04df09a44e95d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47342 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:02:58,457 - lava_callback - INFO - Received callback for node 69dd9040c2164e674d71f97e INFO: 172.20.0.1:47348 - "POST /node/69dd9040c2164e674d71f97e HTTP/1.0" 202 Accepted 2026-04-14 01:02:58,464 - lava_callback - INFO - Starting async job submit for node 69dd9040c2164e674d71f97e 2026-04-14 01:02:58,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:58,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9040c2164e674d71f97e HTTP/1.1" 200 None 2026-04-14 01:02:58,513 - lava_callback - DEBUG - Processing node 69dd9040c2164e674d71f97e: baseline-arm64-foundriesio 2026-04-14 01:02:58,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:02:59,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:02:59,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd9040c2164e674d71f97e/log.txt.gz 2026-04-14 01:02:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:02:59,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:02:59,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd9040c2164e674d71f97e/lava-logs.yaml 2026-04-14 01:02:59,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:02:59,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:02:59,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69dd9040c2164e674d71f97e/lava_callback.json.gz 2026-04-14 01:02:59,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:59,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9040c2164e674d71f97e HTTP/1.1" 200 None 2026-04-14 01:02:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:59,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:02:59,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:02:59,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9040c2164e674d71f97e HTTP/1.1" 200 None 2026-04-14 01:02:59,792 - lava_callback - INFO - Completed processing callback for node 69dd9040c2164e674d71f97e 2026-04-14 01:03:06,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:03:06,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:03:16,976 - lava_callback - INFO - Received callback for node 69daef4e0a04df09a44e9620 INFO: 172.20.0.1:42178 - "POST /node/69daef4e0a04df09a44e9620 HTTP/1.0" 202 Accepted 2026-04-14 01:03:16,985 - lava_callback - INFO - Starting async job submit for node 69daef4e0a04df09a44e9620 2026-04-14 01:03:16,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:03:17,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef4e0a04df09a44e9620 HTTP/1.1" 200 None 2026-04-14 01:03:17,002 - lava_callback - DEBUG - Processing node 69daef4e0a04df09a44e9620: baseline-arm64-baylibre 2026-04-14 01:03:17,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daef4e0a04df09a44e9620 2026-04-14 01:03:17,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:03:17,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef4e0a04df09a44e9620 HTTP/1.1" 200 None 2026-04-14 01:03:17,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:03:17,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:03:17,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:03:17,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daef4e0a04df09a44e9620 HTTP/1.1" 200 None 2026-04-14 01:03:17,054 - lava_callback - ERROR - Error processing callback for node 69daef4e0a04df09a44e9620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44626 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:04:00,476 - lava_callback - INFO - Received callback for node 69dd926ec2164e674d71fd2d INFO: 172.20.0.1:39548 - "POST /node/69dd926ec2164e674d71fd2d HTTP/1.0" 202 Accepted 2026-04-14 01:04:00,481 - lava_callback - INFO - Starting async job submit for node 69dd926ec2164e674d71fd2d 2026-04-14 01:04:00,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:00,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd926ec2164e674d71fd2d HTTP/1.1" 200 None 2026-04-14 01:04:00,513 - lava_callback - DEBUG - Processing node 69dd926ec2164e674d71fd2d: baseline-arm 2026-04-14 01:04:00,518 - lava_callback - WARNING - Failed to upload log 2026-04-14 01:04:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:00,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:00,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd926ec2164e674d71fd2d/lava-logs.yaml 2026-04-14 01:04:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:00,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:00,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd926ec2164e674d71fd2d/lava_callback.json.gz 2026-04-14 01:04:00,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:00,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd926ec2164e674d71fd2d HTTP/1.1" 200 None 2026-04-14 01:04:00,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:00,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:04:00,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:00,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd926ec2164e674d71fd2d HTTP/1.1" 200 None 2026-04-14 01:04:00,898 - lava_callback - INFO - Completed processing callback for node 69dd926ec2164e674d71fd2d 2026-04-14 01:04:06,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:06,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:04:25,397 - lava_callback - INFO - Received callback for node 69dd8ffac2164e674d71f851 INFO: 172.20.0.1:34442 - "POST /node/69dd8ffac2164e674d71f851 HTTP/1.0" 202 Accepted 2026-04-14 01:04:25,403 - lava_callback - INFO - Starting async job submit for node 69dd8ffac2164e674d71f851 2026-04-14 01:04:25,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:25,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ffac2164e674d71f851 HTTP/1.1" 200 None 2026-04-14 01:04:25,435 - lava_callback - DEBUG - Processing node 69dd8ffac2164e674d71f851: baseline-arm64 2026-04-14 01:04:25,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:25,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:25,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffac2164e674d71f851/log.txt.gz 2026-04-14 01:04:26,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:26,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:26,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffac2164e674d71f851/lava-logs.yaml 2026-04-14 01:04:26,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:26,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:26,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd8ffac2164e674d71f851/lava_callback.json.gz 2026-04-14 01:04:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:26,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ffac2164e674d71f851 HTTP/1.1" 200 None 2026-04-14 01:04:26,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:26,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:04:26,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:04:26,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ffac2164e674d71f851 HTTP/1.1" 200 None 2026-04-14 01:04:26,602 - lava_callback - INFO - Completed processing callback for node 69dd8ffac2164e674d71f851 2026-04-14 01:04:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:36,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:04:37,095 - lava_callback - INFO - Received callback for node 69daef8f0a04df09a44e9679 INFO: 172.20.0.1:54892 - "POST /node/69daef8f0a04df09a44e9679 HTTP/1.0" 202 Accepted 2026-04-14 01:04:37,100 - lava_callback - INFO - Starting async job submit for node 69daef8f0a04df09a44e9679 2026-04-14 01:04:37,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:37,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef8f0a04df09a44e9679 HTTP/1.1" 200 None 2026-04-14 01:04:37,116 - lava_callback - DEBUG - Processing node 69daef8f0a04df09a44e9679: baseline-arm64-baylibre 2026-04-14 01:04:37,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daef8f0a04df09a44e9679 2026-04-14 01:04:37,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:37,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daef8f0a04df09a44e9679 HTTP/1.1" 200 None 2026-04-14 01:04:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:37,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:04:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:37,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daef8f0a04df09a44e9679 HTTP/1.1" 200 None 2026-04-14 01:04:37,167 - lava_callback - ERROR - Error processing callback for node 69daef8f0a04df09a44e9679: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 01:04:40,901 - lava_callback - INFO - Received callback for node 69dd900dc2164e674d71f8a8 INFO: 172.20.0.1:56552 - "POST /node/69dd900dc2164e674d71f8a8 HTTP/1.0" 202 Accepted 2026-04-14 01:04:40,907 - lava_callback - INFO - Starting async job submit for node 69dd900dc2164e674d71f8a8 2026-04-14 01:04:40,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:40,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900dc2164e674d71f8a8 HTTP/1.1" 200 None 2026-04-14 01:04:40,967 - lava_callback - DEBUG - Processing node 69dd900dc2164e674d71f8a8: baseline-nfs-arm64 2026-04-14 01:04:41,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:41,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:41,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900dc2164e674d71f8a8/log.txt.gz 2026-04-14 01:04:41,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:41,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:41,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900dc2164e674d71f8a8/lava-logs.yaml 2026-04-14 01:04:41,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:04:42,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:04:42,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd900dc2164e674d71f8a8/lava_callback.json.gz 2026-04-14 01:04:42,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:42,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd900dc2164e674d71f8a8 HTTP/1.1" 200 None 2026-04-14 01:04:42,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:42,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:04:42,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:04:42,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd900dc2164e674d71f8a8 HTTP/1.1" 200 None 2026-04-14 01:04:42,149 - lava_callback - INFO - Completed processing callback for node 69dd900dc2164e674d71f8a8 INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40550 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:05:06,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:05:06,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51508 - "GET /node/6992ea8431166481c8dd8d99%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58020 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:05:46,839 - lava_callback - INFO - Received callback for node 69daefd60a04df09a44e96f6 INFO: 172.20.0.1:58034 - "POST /node/69daefd60a04df09a44e96f6 HTTP/1.0" 202 Accepted 2026-04-14 01:05:46,845 - lava_callback - INFO - Starting async job submit for node 69daefd60a04df09a44e96f6 2026-04-14 01:05:46,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:05:46,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daefd60a04df09a44e96f6 HTTP/1.1" 200 None 2026-04-14 01:05:46,866 - lava_callback - DEBUG - Processing node 69daefd60a04df09a44e96f6: baseline-arm64-clabbe 2026-04-14 01:05:46,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daefd60a04df09a44e96f6 2026-04-14 01:05:46,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:05:46,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daefd60a04df09a44e96f6 HTTP/1.1" 200 None 2026-04-14 01:05:46,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:05:46,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:05:46,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:05:46,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daefd60a04df09a44e96f6 HTTP/1.1" 200 None 2026-04-14 01:05:46,916 - lava_callback - ERROR - Error processing callback for node 69daefd60a04df09a44e96f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:06:46,832 - lava_callback - INFO - Received callback for node 69daf0190a04df09a44e9746 INFO: 172.20.0.1:40942 - "POST /node/69daf0190a04df09a44e9746 HTTP/1.0" 202 Accepted 2026-04-14 01:06:46,838 - lava_callback - INFO - Starting async job submit for node 69daf0190a04df09a44e9746 2026-04-14 01:06:46,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:06:46,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0190a04df09a44e9746 HTTP/1.1" 200 None 2026-04-14 01:06:46,855 - lava_callback - DEBUG - Processing node 69daf0190a04df09a44e9746: baseline-arm64-clabbe 2026-04-14 01:06:46,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf0190a04df09a44e9746 2026-04-14 01:06:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:06:46,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0190a04df09a44e9746 HTTP/1.1" 200 None 2026-04-14 01:06:46,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:06:46,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:06:46,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:06:46,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf0190a04df09a44e9746 HTTP/1.1" 200 None 2026-04-14 01:06:46,939 - lava_callback - ERROR - Error processing callback for node 69daf0190a04df09a44e9746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60808 - "GET /node/6990add4c45febfe44522009%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60824 - "GET /node/698af7b03b3beb19e761752d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET /node/698f5cd93013abef95cf8c10%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36510 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:07:46,928 - lava_callback - INFO - Received callback for node 69daf0560a04df09a44e97a0 INFO: 172.20.0.1:36518 - "POST /node/69daf0560a04df09a44e97a0 HTTP/1.0" 202 Accepted 2026-04-14 01:07:46,933 - lava_callback - INFO - Starting async job submit for node 69daf0560a04df09a44e97a0 2026-04-14 01:07:46,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:46,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0560a04df09a44e97a0 HTTP/1.1" 200 None 2026-04-14 01:07:46,952 - lava_callback - DEBUG - Processing node 69daf0560a04df09a44e97a0: baseline-arm64-clabbe 2026-04-14 01:07:46,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf0560a04df09a44e97a0 2026-04-14 01:07:46,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:46,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0560a04df09a44e97a0 HTTP/1.1" 200 None 2026-04-14 01:07:46,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:46,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:07:46,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:47,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf0560a04df09a44e97a0 HTTP/1.1" 200 None 2026-04-14 01:07:47,011 - lava_callback - ERROR - Error processing callback for node 69daf0560a04df09a44e97a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 01:07:53,169 - lava_callback - INFO - Received callback for node 69dd8ca7c2164e674d71f2e0 INFO: 172.20.0.1:39658 - "POST /node/69dd8ca7c2164e674d71f2e0 HTTP/1.0" 202 Accepted 2026-04-14 01:07:53,175 - lava_callback - INFO - Starting async job submit for node 69dd8ca7c2164e674d71f2e0 2026-04-14 01:07:53,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:53,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca7c2164e674d71f2e0 HTTP/1.1" 200 None 2026-04-14 01:07:53,214 - lava_callback - DEBUG - Processing node 69dd8ca7c2164e674d71f2e0: baseline-arm-broonie 2026-04-14 01:07:53,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:07:53,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:07:53,770 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca7c2164e674d71f2e0/log.txt.gz 2026-04-14 01:07:53,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:07:54,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:07:54,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca7c2164e674d71f2e0/lava-logs.yaml 2026-04-14 01:07:54,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:07:54,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:07:54,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69dd8ca7c2164e674d71f2e0/lava_callback.json.gz 2026-04-14 01:07:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:54,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca7c2164e674d71f2e0 HTTP/1.1" 200 None 2026-04-14 01:07:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:54,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:07:54,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:07:54,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca7c2164e674d71f2e0 HTTP/1.1" 200 None 2026-04-14 01:07:54,316 - lava_callback - INFO - Completed processing callback for node 69dd8ca7c2164e674d71f2e0 INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:08:06,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:08:06,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56398 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:08:47,004 - lava_callback - INFO - Received callback for node 69daf0980a04df09a44e97f5 INFO: 172.20.0.1:56406 - "POST /node/69daf0980a04df09a44e97f5 HTTP/1.0" 202 Accepted 2026-04-14 01:08:47,009 - lava_callback - INFO - Starting async job submit for node 69daf0980a04df09a44e97f5 2026-04-14 01:08:47,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:08:47,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0980a04df09a44e97f5 HTTP/1.1" 200 None 2026-04-14 01:08:47,057 - lava_callback - DEBUG - Processing node 69daf0980a04df09a44e97f5: baseline-arm64-clabbe 2026-04-14 01:08:47,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf0980a04df09a44e97f5 2026-04-14 01:08:47,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:08:47,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0980a04df09a44e97f5 HTTP/1.1" 200 None 2026-04-14 01:08:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:08:47,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:08:47,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:08:47,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf0980a04df09a44e97f5 HTTP/1.1" 200 None 2026-04-14 01:08:47,114 - lava_callback - ERROR - Error processing callback for node 69daf0980a04df09a44e97f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40342 - "GET /node/695e94665b0eee9f47ea804e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40348 - "GET /node/69935ab6523507f3806a9abe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43768 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:10:06,959 - lava_callback - INFO - Received callback for node 69daf0da0a04df09a44e9849 INFO: 172.20.0.1:43776 - "POST /node/69daf0da0a04df09a44e9849 HTTP/1.0" 202 Accepted 2026-04-14 01:10:06,965 - lava_callback - INFO - Starting async job submit for node 69daf0da0a04df09a44e9849 2026-04-14 01:10:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:10:06,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0da0a04df09a44e9849 HTTP/1.1" 200 None 2026-04-14 01:10:06,987 - lava_callback - DEBUG - Processing node 69daf0da0a04df09a44e9849: baseline-arm64-clabbe 2026-04-14 01:10:06,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf0da0a04df09a44e9849 2026-04-14 01:10:06,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:10:07,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf0da0a04df09a44e9849 HTTP/1.1" 200 None 2026-04-14 01:10:07,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:10:07,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:10:07,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:10:07,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf0da0a04df09a44e9849 HTTP/1.1" 200 None 2026-04-14 01:10:07,042 - lava_callback - ERROR - Error processing callback for node 69daf0da0a04df09a44e9849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56430 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:11:07,125 - lava_callback - INFO - Received callback for node 69daf11e0a04df09a44e98a9 INFO: 172.20.0.1:56434 - "POST /node/69daf11e0a04df09a44e98a9 HTTP/1.0" 202 Accepted 2026-04-14 01:11:07,130 - lava_callback - INFO - Starting async job submit for node 69daf11e0a04df09a44e98a9 2026-04-14 01:11:07,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:07,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf11e0a04df09a44e98a9 HTTP/1.1" 200 None 2026-04-14 01:11:07,147 - lava_callback - DEBUG - Processing node 69daf11e0a04df09a44e98a9: baseline-arm64-clabbe 2026-04-14 01:11:07,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf11e0a04df09a44e98a9 2026-04-14 01:11:07,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:07,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf11e0a04df09a44e98a9 HTTP/1.1" 200 None 2026-04-14 01:11:07,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:07,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:11:07,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:07,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf11e0a04df09a44e98a9 HTTP/1.1" 200 None 2026-04-14 01:11:07,198 - lava_callback - ERROR - Error processing callback for node 69daf11e0a04df09a44e98a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57684 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:11:31,981 - lava_callback - INFO - Received callback for node 69dd8ccfc2164e674d71f382 INFO: 172.20.0.1:46762 - "POST /node/69dd8ccfc2164e674d71f382 HTTP/1.0" 202 Accepted 2026-04-14 01:11:31,987 - lava_callback - INFO - Starting async job submit for node 69dd8ccfc2164e674d71f382 2026-04-14 01:11:32,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:32,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ccfc2164e674d71f382 HTTP/1.1" 200 None 2026-04-14 01:11:32,029 - lava_callback - DEBUG - Processing node 69dd8ccfc2164e674d71f382: ltp-containers 2026-04-14 01:11:32,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:11:32,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:11:32,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69dd8ccfc2164e674d71f382/log.txt.gz 2026-04-14 01:11:32,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:11:32,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:11:32,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69dd8ccfc2164e674d71f382/lava-logs.yaml 2026-04-14 01:11:32,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:11:33,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:11:33,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69dd8ccfc2164e674d71f382/lava_callback.json.gz 2026-04-14 01:11:33,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:33,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ccfc2164e674d71f382 HTTP/1.1" 200 None 2026-04-14 01:11:33,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:33,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:11:33,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:33,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ccfc2164e674d71f382 HTTP/1.1" 200 None 2026-04-14 01:11:33,192 - lava_callback - INFO - Completed processing callback for node 69dd8ccfc2164e674d71f382 2026-04-14 01:11:36,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:11:36,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34166 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:12:07,126 - lava_callback - INFO - Received callback for node 69daf15f0a04df09a44e98f2 INFO: 172.20.0.1:34176 - "POST /node/69daf15f0a04df09a44e98f2 HTTP/1.0" 202 Accepted 2026-04-14 01:12:07,131 - lava_callback - INFO - Starting async job submit for node 69daf15f0a04df09a44e98f2 2026-04-14 01:12:07,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:07,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf15f0a04df09a44e98f2 HTTP/1.1" 200 None 2026-04-14 01:12:07,162 - lava_callback - DEBUG - Processing node 69daf15f0a04df09a44e98f2: baseline-arm64-clabbe 2026-04-14 01:12:07,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf15f0a04df09a44e98f2 2026-04-14 01:12:07,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:07,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf15f0a04df09a44e98f2 HTTP/1.1" 200 None 2026-04-14 01:12:07,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:07,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 01:12:07,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:07,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf15f0a04df09a44e98f2 HTTP/1.1" 200 None 2026-04-14 01:12:07,214 - lava_callback - ERROR - Error processing callback for node 69daf15f0a04df09a44e98f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:12:51,594 - lava_callback - INFO - Received callback for node 69dd941fc2164e674d71ff1c INFO: 172.20.0.1:59430 - "POST /node/69dd941fc2164e674d71ff1c HTTP/1.0" 202 Accepted 2026-04-14 01:12:51,601 - lava_callback - INFO - Starting async job submit for node 69dd941fc2164e674d71ff1c 2026-04-14 01:12:51,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:51,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd941fc2164e674d71ff1c HTTP/1.1" 200 None 2026-04-14 01:12:51,638 - lava_callback - DEBUG - Processing node 69dd941fc2164e674d71ff1c: baseline-arm 2026-04-14 01:12:51,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:12:52,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:12:52,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd941fc2164e674d71ff1c/log.txt.gz 2026-04-14 01:12:52,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:12:52,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:12:52,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd941fc2164e674d71ff1c/lava-logs.yaml 2026-04-14 01:12:52,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:12:52,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:12:52,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd941fc2164e674d71ff1c/lava_callback.json.gz 2026-04-14 01:12:52,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:52,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd941fc2164e674d71ff1c HTTP/1.1" 200 None 2026-04-14 01:12:52,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:52,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87a6c2164e674d71ee3e HTTP/1.1" 200 None 2026-04-14 01:12:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:12:52,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd941fc2164e674d71ff1c HTTP/1.1" 200 None 2026-04-14 01:12:52,612 - lava_callback - INFO - Completed processing callback for node 69dd941fc2164e674d71ff1c INFO: 172.20.0.1:59434 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:13:06,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:06,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:13:32,078 - lava_callback - INFO - Received callback for node 69dd8cd6c2164e674d71f390 INFO: 172.20.0.1:45896 - "POST /node/69dd8cd6c2164e674d71f390 HTTP/1.0" 202 Accepted 2026-04-14 01:13:32,085 - lava_callback - INFO - Starting async job submit for node 69dd8cd6c2164e674d71f390 2026-04-14 01:13:32,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:32,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd6c2164e674d71f390 HTTP/1.1" 200 None 2026-04-14 01:13:32,129 - lava_callback - DEBUG - Processing node 69dd8cd6c2164e674d71f390: ltp-fs_bind 2026-04-14 01:13:32,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:32,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:32,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dd8cd6c2164e674d71f390/log.txt.gz 2026-04-14 01:13:32,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:33,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:33,256 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dd8cd6c2164e674d71f390/lava-logs.yaml 2026-04-14 01:13:33,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:33,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:33,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69dd8cd6c2164e674d71f390/lava_callback.json.gz 2026-04-14 01:13:33,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:33,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd6c2164e674d71f390 HTTP/1.1" 200 None 2026-04-14 01:13:33,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:13:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:33,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cd6c2164e674d71f390 HTTP/1.1" 200 None 2026-04-14 01:13:33,489 - lava_callback - INFO - Completed processing callback for node 69dd8cd6c2164e674d71f390 2026-04-14 01:13:36,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:36,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:13:46,380 - lava_callback - INFO - Received callback for node 69dd9010c2164e674d71f8af INFO: 172.20.0.1:45906 - "POST /node/69dd9010c2164e674d71f8af HTTP/1.0" 202 Accepted 2026-04-14 01:13:46,389 - lava_callback - INFO - Starting async job submit for node 69dd9010c2164e674d71f8af 2026-04-14 01:13:46,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:46,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9010c2164e674d71f8af HTTP/1.1" 200 None 2026-04-14 01:13:46,448 - lava_callback - DEBUG - Processing node 69dd9010c2164e674d71f8af: baseline-nfs-arm64 INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:13:47,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:47,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:47,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9010c2164e674d71f8af/log.txt.gz 2026-04-14 01:13:48,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:48,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:48,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9010c2164e674d71f8af/lava-logs.yaml 2026-04-14 01:13:48,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:48,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:48,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9010c2164e674d71f8af/lava_callback.json.gz DEBUG: Setup failed for 69dd9010c2164e674d71f8af. Transitting job node result: incomplete -> fail 2026-04-14 01:13:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:48,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9010c2164e674d71f8af HTTP/1.1" 200 None 2026-04-14 01:13:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:48,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:13:48,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:48,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9010c2164e674d71f8af HTTP/1.1" 200 None 2026-04-14 01:13:48,893 - lava_callback - INFO - Completed processing callback for node 69dd9010c2164e674d71f8af 2026-04-14 01:13:52,691 - lava_callback - INFO - Received callback for node 69dd9013c2164e674d71f8b9 INFO: 172.20.0.1:38186 - "POST /node/69dd9013c2164e674d71f8b9 HTTP/1.0" 202 Accepted 2026-04-14 01:13:52,699 - lava_callback - INFO - Starting async job submit for node 69dd9013c2164e674d71f8b9 2026-04-14 01:13:52,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:52,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9013c2164e674d71f8b9 HTTP/1.1" 200 None 2026-04-14 01:13:52,757 - lava_callback - DEBUG - Processing node 69dd9013c2164e674d71f8b9: baseline-nfs-arm64 2026-04-14 01:13:53,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:54,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:54,154 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9013c2164e674d71f8b9/log.txt.gz 2026-04-14 01:13:54,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:55,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:55,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9013c2164e674d71f8b9/lava-logs.yaml 2026-04-14 01:13:55,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:13:55,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:13:55,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd9013c2164e674d71f8b9/lava_callback.json.gz DEBUG: Setup failed for 69dd9013c2164e674d71f8b9. Transitting job node result: incomplete -> fail 2026-04-14 01:13:55,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:55,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9013c2164e674d71f8b9 HTTP/1.1" 200 None 2026-04-14 01:13:55,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:55,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:13:55,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:13:55,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9013c2164e674d71f8b9 HTTP/1.1" 200 None 2026-04-14 01:13:55,555 - lava_callback - INFO - Completed processing callback for node 69dd9013c2164e674d71f8b9 INFO: 172.20.0.1:38202 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:14:06,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:14:06,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46414 - "GET /node/6988cb119fc35f969e1ef177%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 01:15:12,291 - lava_callback - INFO - Received callback for node 69dd8cd0c2164e674d71f385 INFO: 172.20.0.1:55482 - "POST /node/69dd8cd0c2164e674d71f385 HTTP/1.0" 202 Accepted 2026-04-14 01:15:12,298 - lava_callback - INFO - Starting async job submit for node 69dd8cd0c2164e674d71f385 2026-04-14 01:15:12,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:12,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd0c2164e674d71f385 HTTP/1.1" 200 None 2026-04-14 01:15:12,356 - lava_callback - DEBUG - Processing node 69dd8cd0c2164e674d71f385: ltp-controllers 2026-04-14 01:15:12,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:13,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:13,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69dd8cd0c2164e674d71f385/log.txt.gz 2026-04-14 01:15:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:13,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:13,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69dd8cd0c2164e674d71f385/lava-logs.yaml 2026-04-14 01:15:13,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:13,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:13,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69dd8cd0c2164e674d71f385/lava_callback.json.gz 2026-04-14 01:15:13,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:13,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd0c2164e674d71f385 HTTP/1.1" 200 None 2026-04-14 01:15:13,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:13,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:15:13,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:13,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cd0c2164e674d71f385 HTTP/1.1" 200 None 2026-04-14 01:15:13,817 - lava_callback - INFO - Completed processing callback for node 69dd8cd0c2164e674d71f385 INFO: 172.20.0.1:55488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:15:32,610 - lava_callback - INFO - Received callback for node 69dd8cd3c2164e674d71f38a INFO: 172.20.0.1:53290 - "POST /node/69dd8cd3c2164e674d71f38a HTTP/1.0" 202 Accepted 2026-04-14 01:15:32,617 - lava_callback - INFO - Starting async job submit for node 69dd8cd3c2164e674d71f38a 2026-04-14 01:15:32,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:32,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd3c2164e674d71f38a HTTP/1.1" 200 None 2026-04-14 01:15:32,667 - lava_callback - DEBUG - Processing node 69dd8cd3c2164e674d71f38a: ltp-cve 2026-04-14 01:15:33,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:33,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:33,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69dd8cd3c2164e674d71f38a/log.txt.gz 2026-04-14 01:15:33,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:33,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:33,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69dd8cd3c2164e674d71f38a/lava-logs.yaml 2026-04-14 01:15:33,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:33,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:33,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69dd8cd3c2164e674d71f38a/lava_callback.json.gz 2026-04-14 01:15:33,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:33,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd3c2164e674d71f38a HTTP/1.1" 200 None 2026-04-14 01:15:33,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:33,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:15:33,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:33,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cd3c2164e674d71f38a HTTP/1.1" 200 None 2026-04-14 01:15:33,929 - lava_callback - INFO - Completed processing callback for node 69dd8cd3c2164e674d71f38a 2026-04-14 01:15:34,222 - lava_callback - INFO - Received callback for node 69dd8cd8c2164e674d71f397 INFO: 172.20.0.1:53298 - "POST /node/69dd8cd8c2164e674d71f397 HTTP/1.0" 202 Accepted 2026-04-14 01:15:34,232 - lava_callback - INFO - Starting async job submit for node 69dd8cd8c2164e674d71f397 2026-04-14 01:15:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:34,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd8c2164e674d71f397 HTTP/1.1" 200 None 2026-04-14 01:15:34,292 - lava_callback - DEBUG - Processing node 69dd8cd8c2164e674d71f397: ltp-input 2026-04-14 01:15:34,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:34,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:34,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69dd8cd8c2164e674d71f397/log.txt.gz 2026-04-14 01:15:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:35,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:35,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69dd8cd8c2164e674d71f397/lava-logs.yaml 2026-04-14 01:15:35,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:15:35,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:15:35,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69dd8cd8c2164e674d71f397/lava_callback.json.gz 2026-04-14 01:15:35,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:35,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cd8c2164e674d71f397 HTTP/1.1" 200 None 2026-04-14 01:15:35,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:35,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:15:35,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:35,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cd8c2164e674d71f397 HTTP/1.1" 200 None 2026-04-14 01:15:35,440 - lava_callback - INFO - Completed processing callback for node 69dd8cd8c2164e674d71f397 2026-04-14 01:15:36,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:36,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53302 - "GET /node/693f159824745582e399ad4c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 01:15:37,796 - lava_callback - INFO - Received callback for node 69daf22a0a04df09a44e99d4 INFO: 172.20.0.1:53316 - "POST /node/69daf22a0a04df09a44e99d4 HTTP/1.0" 202 Accepted 2026-04-14 01:15:37,801 - lava_callback - INFO - Starting async job submit for node 69daf22a0a04df09a44e99d4 2026-04-14 01:15:37,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:37,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf22a0a04df09a44e99d4 HTTP/1.1" 200 None 2026-04-14 01:15:37,817 - lava_callback - DEBUG - Processing node 69daf22a0a04df09a44e99d4: baseline-arm-baylibre 2026-04-14 01:15:37,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf22a0a04df09a44e99d4 2026-04-14 01:15:37,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:37,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf22a0a04df09a44e99d4 HTTP/1.1" 200 None 2026-04-14 01:15:37,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:37,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:15:37,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:15:37,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf22a0a04df09a44e99d4 HTTP/1.1" 200 None 2026-04-14 01:15:37,873 - lava_callback - ERROR - Error processing callback for node 69daf22a0a04df09a44e99d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:17:17,800 - lava_callback - INFO - Received callback for node 69daf28d0a04df09a44e9a31 INFO: 172.20.0.1:49004 - "POST /node/69daf28d0a04df09a44e9a31 HTTP/1.0" 202 Accepted 2026-04-14 01:17:17,806 - lava_callback - INFO - Starting async job submit for node 69daf28d0a04df09a44e9a31 2026-04-14 01:17:17,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:17,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf28d0a04df09a44e9a31 HTTP/1.1" 200 None 2026-04-14 01:17:17,846 - lava_callback - DEBUG - Processing node 69daf28d0a04df09a44e9a31: baseline-arm-baylibre 2026-04-14 01:17:17,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf28d0a04df09a44e9a31 2026-04-14 01:17:17,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf28d0a04df09a44e9a31 HTTP/1.1" 200 None 2026-04-14 01:17:17,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:17,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:17:17,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:17,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf28d0a04df09a44e9a31 HTTP/1.1" 200 None 2026-04-14 01:17:17,895 - lava_callback - ERROR - Error processing callback for node 69daf28d0a04df09a44e9a31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55856 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:17:32,026 - lava_callback - INFO - Received callback for node 69dd9030c2164e674d71f943 INFO: 172.20.0.1:54260 - "POST /node/69dd9030c2164e674d71f943 HTTP/1.0" 202 Accepted 2026-04-14 01:17:32,032 - lava_callback - INFO - Starting async job submit for node 69dd9030c2164e674d71f943 2026-04-14 01:17:32,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:32,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9030c2164e674d71f943 HTTP/1.1" 200 None 2026-04-14 01:17:32,073 - lava_callback - DEBUG - Processing node 69dd9030c2164e674d71f943: baseline-arm64-broonie 2026-04-14 01:17:32,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:32,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:32,462 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9030c2164e674d71f943/log.txt.gz 2026-04-14 01:17:32,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:32,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:32,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9030c2164e674d71f943/lava-logs.yaml 2026-04-14 01:17:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:33,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:33,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9030c2164e674d71f943/lava_callback.json.gz 2026-04-14 01:17:33,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:33,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9030c2164e674d71f943 HTTP/1.1" 200 None 2026-04-14 01:17:33,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:33,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:17:33,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:33,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9030c2164e674d71f943 HTTP/1.1" 200 None 2026-04-14 01:17:33,210 - lava_callback - INFO - Completed processing callback for node 69dd9030c2164e674d71f943 2026-04-14 01:17:35,776 - lava_callback - INFO - Received callback for node 69dd95a4c2164e674d72010d INFO: 172.20.0.1:54266 - "POST /node/69dd95a4c2164e674d72010d HTTP/1.0" 202 Accepted 2026-04-14 01:17:35,784 - lava_callback - INFO - Starting async job submit for node 69dd95a4c2164e674d72010d 2026-04-14 01:17:35,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:35,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd95a4c2164e674d72010d HTTP/1.1" 200 None 2026-04-14 01:17:35,820 - lava_callback - DEBUG - Processing node 69dd95a4c2164e674d72010d: baseline-nfs-arm64 2026-04-14 01:17:35,822 - lava_callback - WARNING - Failed to upload log 2026-04-14 01:17:35,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:35,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:35,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd95a4c2164e674d72010d/lava-logs.yaml 2026-04-14 01:17:35,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:36,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:36,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dd95a4c2164e674d72010d/lava_callback.json.gz 2026-04-14 01:17:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:36,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd95a4c2164e674d72010d HTTP/1.1" 200 None 2026-04-14 01:17:36,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:36,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:17:36,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:36,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd95a4c2164e674d72010d HTTP/1.1" 200 None 2026-04-14 01:17:36,139 - lava_callback - INFO - Completed processing callback for node 69dd95a4c2164e674d72010d 2026-04-14 01:17:36,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54282 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:17:36,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:17:52,228 - lava_callback - INFO - Received callback for node 69dd8cdbc2164e674d71f39e INFO: 172.20.0.1:44832 - "POST /node/69dd8cdbc2164e674d71f39e HTTP/1.0" 202 Accepted 2026-04-14 01:17:52,234 - lava_callback - INFO - Starting async job submit for node 69dd8cdbc2164e674d71f39e 2026-04-14 01:17:52,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:52,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdbc2164e674d71f39e HTTP/1.1" 200 None 2026-04-14 01:17:52,279 - lava_callback - DEBUG - Processing node 69dd8cdbc2164e674d71f39e: ltp-pty 2026-04-14 01:17:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:52,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:52,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69dd8cdbc2164e674d71f39e/log.txt.gz 2026-04-14 01:17:52,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:53,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:53,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69dd8cdbc2164e674d71f39e/lava-logs.yaml 2026-04-14 01:17:53,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:17:53,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:17:53,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69dd8cdbc2164e674d71f39e/lava_callback.json.gz 2026-04-14 01:17:53,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:53,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdbc2164e674d71f39e HTTP/1.1" 200 None 2026-04-14 01:17:53,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:53,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:17:53,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:17:53,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cdbc2164e674d71f39e HTTP/1.1" 200 None 2026-04-14 01:17:53,428 - lava_callback - INFO - Completed processing callback for node 69dd8cdbc2164e674d71f39e INFO: 172.20.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:18:06,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:18:06,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:18:17,804 - lava_callback - INFO - Received callback for node 69daf2cb0a04df09a44e9a78 INFO: 172.20.0.1:33160 - "POST /node/69daf2cb0a04df09a44e9a78 HTTP/1.0" 202 Accepted 2026-04-14 01:18:17,809 - lava_callback - INFO - Starting async job submit for node 69daf2cb0a04df09a44e9a78 2026-04-14 01:18:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:18:17,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf2cb0a04df09a44e9a78 HTTP/1.1" 200 None 2026-04-14 01:18:17,826 - lava_callback - DEBUG - Processing node 69daf2cb0a04df09a44e9a78: baseline-arm-baylibre 2026-04-14 01:18:17,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf2cb0a04df09a44e9a78 2026-04-14 01:18:17,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:18:17,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf2cb0a04df09a44e9a78 HTTP/1.1" 200 None 2026-04-14 01:18:17,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:18:17,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:18:17,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:18:17,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf2cb0a04df09a44e9a78 HTTP/1.1" 200 None 2026-04-14 01:18:17,876 - lava_callback - ERROR - Error processing callback for node 69daf2cb0a04df09a44e9a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59696 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:19:12,154 - lava_callback - INFO - Received callback for node 69dd8cdcc2164e674d71f3a1 INFO: 172.20.0.1:45116 - "POST /node/69dd8cdcc2164e674d71f3a1 HTTP/1.0" 202 Accepted 2026-04-14 01:19:12,160 - lava_callback - INFO - Starting async job submit for node 69dd8cdcc2164e674d71f3a1 2026-04-14 01:19:12,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:12,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdcc2164e674d71f3a1 HTTP/1.1" 200 None 2026-04-14 01:19:12,200 - lava_callback - DEBUG - Processing node 69dd8cdcc2164e674d71f3a1: ltp-sched 2026-04-14 01:19:12,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:12,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:12,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69dd8cdcc2164e674d71f3a1/log.txt.gz 2026-04-14 01:19:12,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:13,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:13,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69dd8cdcc2164e674d71f3a1/lava-logs.yaml 2026-04-14 01:19:13,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:13,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:13,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69dd8cdcc2164e674d71f3a1/lava_callback.json.gz 2026-04-14 01:19:13,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:13,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdcc2164e674d71f3a1 HTTP/1.1" 200 None 2026-04-14 01:19:13,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:13,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:19:13,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:13,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cdcc2164e674d71f3a1 HTTP/1.1" 200 None 2026-04-14 01:19:13,416 - lava_callback - INFO - Completed processing callback for node 69dd8cdcc2164e674d71f3a1 INFO: 172.20.0.1:45130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33652 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:19:32,281 - lava_callback - INFO - Received callback for node 69dd8cdec2164e674d71f3a4 INFO: 172.20.0.1:50814 - "POST /node/69dd8cdec2164e674d71f3a4 HTTP/1.0" 202 Accepted 2026-04-14 01:19:32,290 - lava_callback - INFO - Starting async job submit for node 69dd8cdec2164e674d71f3a4 2026-04-14 01:19:32,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdec2164e674d71f3a4 HTTP/1.1" 200 None 2026-04-14 01:19:32,331 - lava_callback - DEBUG - Processing node 69dd8cdec2164e674d71f3a4: ltp-smoke 2026-04-14 01:19:32,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:32,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:32,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69dd8cdec2164e674d71f3a4/log.txt.gz 2026-04-14 01:19:33,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:33,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:33,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69dd8cdec2164e674d71f3a4/lava-logs.yaml 2026-04-14 01:19:33,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:33,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:33,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69dd8cdec2164e674d71f3a4/lava_callback.json.gz 2026-04-14 01:19:33,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:33,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cdec2164e674d71f3a4 HTTP/1.1" 200 None 2026-04-14 01:19:33,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:33,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:19:33,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:33,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cdec2164e674d71f3a4 HTTP/1.1" 200 None 2026-04-14 01:19:33,456 - lava_callback - INFO - Completed processing callback for node 69dd8cdec2164e674d71f3a4 2026-04-14 01:19:33,877 - lava_callback - INFO - Received callback for node 69dd8ce1c2164e674d71f3dc INFO: 172.20.0.1:50824 - "POST /node/69dd8ce1c2164e674d71f3dc HTTP/1.0" 202 Accepted 2026-04-14 01:19:33,884 - lava_callback - INFO - Starting async job submit for node 69dd8ce1c2164e674d71f3dc 2026-04-14 01:19:33,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:33,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce1c2164e674d71f3dc HTTP/1.1" 200 None 2026-04-14 01:19:33,925 - lava_callback - DEBUG - Processing node 69dd8ce1c2164e674d71f3dc: ltp-syscalls-ipc 2026-04-14 01:19:34,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:34,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:34,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dd8ce1c2164e674d71f3dc/log.txt.gz 2026-04-14 01:19:34,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:34,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:34,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dd8ce1c2164e674d71f3dc/lava-logs.yaml 2026-04-14 01:19:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:19:34,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:19:34,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69dd8ce1c2164e674d71f3dc/lava_callback.json.gz 2026-04-14 01:19:35,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:35,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce1c2164e674d71f3dc HTTP/1.1" 200 None 2026-04-14 01:19:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:35,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:19:35,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:35,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ce1c2164e674d71f3dc HTTP/1.1" 200 None 2026-04-14 01:19:35,107 - lava_callback - INFO - Completed processing callback for node 69dd8ce1c2164e674d71f3dc INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:19:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:36,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35602 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:19:57,946 - lava_callback - INFO - Received callback for node 69daf32e0a04df09a44e9ac8 INFO: 172.20.0.1:35608 - "POST /node/69daf32e0a04df09a44e9ac8 HTTP/1.0" 202 Accepted 2026-04-14 01:19:57,951 - lava_callback - INFO - Starting async job submit for node 69daf32e0a04df09a44e9ac8 2026-04-14 01:19:57,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:57,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf32e0a04df09a44e9ac8 HTTP/1.1" 200 None 2026-04-14 01:19:57,968 - lava_callback - DEBUG - Processing node 69daf32e0a04df09a44e9ac8: baseline-arm-baylibre 2026-04-14 01:19:57,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf32e0a04df09a44e9ac8 2026-04-14 01:19:57,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:57,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf32e0a04df09a44e9ac8 HTTP/1.1" 200 None 2026-04-14 01:19:57,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:58,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:19:58,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:19:58,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf32e0a04df09a44e9ac8 HTTP/1.1" 200 None 2026-04-14 01:19:58,021 - lava_callback - ERROR - Error processing callback for node 69daf32e0a04df09a44e9ac8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48154 - "GET /node/695f05c3d1383f7c23533ae0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:20:58,012 - lava_callback - INFO - Received callback for node 69daf36e0a04df09a44e9afd INFO: 172.20.0.1:48978 - "POST /node/69daf36e0a04df09a44e9afd HTTP/1.0" 202 Accepted 2026-04-14 01:20:58,018 - lava_callback - INFO - Starting async job submit for node 69daf36e0a04df09a44e9afd 2026-04-14 01:20:58,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:20:58,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf36e0a04df09a44e9afd HTTP/1.1" 200 None 2026-04-14 01:20:58,034 - lava_callback - DEBUG - Processing node 69daf36e0a04df09a44e9afd: baseline-arm-baylibre 2026-04-14 01:20:58,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf36e0a04df09a44e9afd 2026-04-14 01:20:58,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:20:58,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf36e0a04df09a44e9afd HTTP/1.1" 200 None 2026-04-14 01:20:58,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:20:58,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:20:58,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:20:58,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf36e0a04df09a44e9afd HTTP/1.1" 200 None 2026-04-14 01:20:58,099 - lava_callback - ERROR - Error processing callback for node 69daf36e0a04df09a44e9afd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:21:27,468 - lava_callback - INFO - Received callback for node 69daf38f0a04df09a44e9b46 INFO: 172.20.0.1:35160 - "POST /node/69daf38f0a04df09a44e9b46 HTTP/1.0" 202 Accepted 2026-04-14 01:21:27,473 - lava_callback - INFO - Starting async job submit for node 69daf38f0a04df09a44e9b46 2026-04-14 01:21:27,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:21:27,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf38f0a04df09a44e9b46 HTTP/1.1" 200 None 2026-04-14 01:21:27,489 - lava_callback - DEBUG - Processing node 69daf38f0a04df09a44e9b46: baseline-arm-clabbe 2026-04-14 01:21:27,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf38f0a04df09a44e9b46 2026-04-14 01:21:27,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:21:27,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf38f0a04df09a44e9b46 HTTP/1.1" 200 None 2026-04-14 01:21:27,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:21:27,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:21:27,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:21:27,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf38f0a04df09a44e9b46 HTTP/1.1" 200 None 2026-04-14 01:21:27,537 - lava_callback - ERROR - Error processing callback for node 69daf38f0a04df09a44e9b46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:22:12,354 - lava_callback - INFO - Received callback for node 69dd8ce3c2164e674d71f3df INFO: 172.20.0.1:41598 - "POST /node/69dd8ce3c2164e674d71f3df HTTP/1.0" 202 Accepted 2026-04-14 01:22:12,360 - lava_callback - INFO - Starting async job submit for node 69dd8ce3c2164e674d71f3df 2026-04-14 01:22:12,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:22:12,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce3c2164e674d71f3df HTTP/1.1" 200 None 2026-04-14 01:22:12,423 - lava_callback - DEBUG - Processing node 69dd8ce3c2164e674d71f3df: ltp-timers 2026-04-14 01:22:12,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:22:13,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:22:13,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69dd8ce3c2164e674d71f3df/log.txt.gz 2026-04-14 01:22:13,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:22:13,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:22:13,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69dd8ce3c2164e674d71f3df/lava-logs.yaml 2026-04-14 01:22:13,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:22:13,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:22:13,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69dd8ce3c2164e674d71f3df/lava_callback.json.gz 2026-04-14 01:22:13,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:22:13,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce3c2164e674d71f3df HTTP/1.1" 200 None 2026-04-14 01:22:13,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:22:13,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:22:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:22:13,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ce3c2164e674d71f3df HTTP/1.1" 200 None 2026-04-14 01:22:13,786 - lava_callback - INFO - Completed processing callback for node 69dd8ce3c2164e674d71f3df INFO: 172.20.0.1:41602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45458 - "GET /node/69507d8779dde14bd05ef40f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59314 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:22:36,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:22:36,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:23:12,986 - lava_callback - INFO - Received callback for node 69dd8ce4c2164e674d71f3e7 INFO: 172.20.0.1:56690 - "POST /node/69dd8ce4c2164e674d71f3e7 HTTP/1.0" 202 Accepted 2026-04-14 01:23:12,993 - lava_callback - INFO - Starting async job submit for node 69dd8ce4c2164e674d71f3e7 2026-04-14 01:23:13,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:23:13,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce4c2164e674d71f3e7 HTTP/1.1" 200 None 2026-04-14 01:23:13,033 - lava_callback - DEBUG - Processing node 69dd8ce4c2164e674d71f3e7: ltp-watchqueue 2026-04-14 01:23:13,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:23:13,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:23:13,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dd8ce4c2164e674d71f3e7/log.txt.gz 2026-04-14 01:23:13,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:23:14,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:23:14,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dd8ce4c2164e674d71f3e7/lava-logs.yaml 2026-04-14 01:23:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:23:14,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:23:14,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69dd8ce4c2164e674d71f3e7/lava_callback.json.gz 2026-04-14 01:23:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:23:14,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ce4c2164e674d71f3e7 HTTP/1.1" 200 None 2026-04-14 01:23:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:23:14,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:23:14,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:23:14,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ce4c2164e674d71f3e7 HTTP/1.1" 200 None 2026-04-14 01:23:14,572 - lava_callback - INFO - Completed processing callback for node 69dd8ce4c2164e674d71f3e7 INFO: 172.20.0.1:56698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32802 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:23:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:23:36,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41782 - "GET /node/69d061ccd2be3e1cf2a5b18b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41796 - "GET /node/69d05ed6d2be3e1cf2a5acf7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42262 - "GET /node/695b08618156fad0b122131e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60848 - "GET /node/691ae09aaace2aac68e2c308%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60856 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:24:27,585 - lava_callback - INFO - Received callback for node 69daf4350a04df09a44e9bff INFO: 172.20.0.1:60858 - "POST /node/69daf4350a04df09a44e9bff HTTP/1.0" 202 Accepted 2026-04-14 01:24:27,591 - lava_callback - INFO - Starting async job submit for node 69daf4350a04df09a44e9bff 2026-04-14 01:24:27,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:24:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf4350a04df09a44e9bff HTTP/1.1" 200 None 2026-04-14 01:24:27,608 - lava_callback - DEBUG - Processing node 69daf4350a04df09a44e9bff: baseline-arm-clabbe 2026-04-14 01:24:27,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf4350a04df09a44e9bff 2026-04-14 01:24:27,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:24:27,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf4350a04df09a44e9bff HTTP/1.1" 200 None 2026-04-14 01:24:27,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:24:27,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:24:27,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:24:27,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf4350a04df09a44e9bff HTTP/1.1" 200 None 2026-04-14 01:24:27,662 - lava_callback - ERROR - Error processing callback for node 69daf4350a04df09a44e9bff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET /node/69103f05f4a91d81a0ec5119%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:25:12,080 - lava_callback - INFO - Received callback for node 69dd9678c2164e674d720224 INFO: 172.20.0.1:35728 - "POST /node/69dd9678c2164e674d720224 HTTP/1.0" 202 Accepted 2026-04-14 01:25:12,088 - lava_callback - INFO - Starting async job submit for node 69dd9678c2164e674d720224 2026-04-14 01:25:12,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:25:12,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9678c2164e674d720224 HTTP/1.1" 200 None 2026-04-14 01:25:12,132 - lava_callback - DEBUG - Processing node 69dd9678c2164e674d720224: baseline-arm64 2026-04-14 01:25:12,260 - lava_callback - WARNING - Failed to upload log 2026-04-14 01:25:12,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:25:12,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:25:12,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9678c2164e674d720224/lava-logs.yaml 2026-04-14 01:25:12,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:25:12,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:25:12,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9678c2164e674d720224/lava_callback.json.gz 2026-04-14 01:25:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:25:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9678c2164e674d720224 HTTP/1.1" 200 None 2026-04-14 01:25:12,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:25:12,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:25:12,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:25:12,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9678c2164e674d720224 HTTP/1.1" 200 None 2026-04-14 01:25:12,809 - lava_callback - INFO - Completed processing callback for node 69dd9678c2164e674d720224 INFO: 172.20.0.1:35734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:25:36,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:25:36,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40022 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:26:12,443 - lava_callback - INFO - Received callback for node 69dd9356c2164e674d71fe26 INFO: 172.20.0.1:35952 - "POST /node/69dd9356c2164e674d71fe26 HTTP/1.0" 202 Accepted 2026-04-14 01:26:12,449 - lava_callback - INFO - Starting async job submit for node 69dd9356c2164e674d71fe26 2026-04-14 01:26:12,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:26:12,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9356c2164e674d71fe26 HTTP/1.1" 200 None 2026-04-14 01:26:12,491 - lava_callback - DEBUG - Processing node 69dd9356c2164e674d71fe26: ltp-cap_bounds 2026-04-14 01:26:12,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:26:12,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:26:12,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dd9356c2164e674d71fe26/log.txt.gz 2026-04-14 01:26:13,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:26:13,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:26:13,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dd9356c2164e674d71fe26/lava-logs.yaml 2026-04-14 01:26:13,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:26:13,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:26:13,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69dd9356c2164e674d71fe26/lava_callback.json.gz 2026-04-14 01:26:13,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:26:13,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9356c2164e674d71fe26 HTTP/1.1" 200 None 2026-04-14 01:26:13,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:26:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:26:13,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:26:13,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9356c2164e674d71fe26 HTTP/1.1" 200 None 2026-04-14 01:26:13,720 - lava_callback - INFO - Completed processing callback for node 69dd9356c2164e674d71fe26 INFO: 172.20.0.1:35958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:26:36,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:26:36,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36998 - "GET /node/69927ede98a8bdb31c394f14%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37000 - "GET /node/6992688a98a8bdb31c39221b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:27:24,593 - lava_callback - INFO - Received callback for node 69dd96c6c2164e674d72029c INFO: 172.20.0.1:57480 - "POST /node/69dd96c6c2164e674d72029c HTTP/1.0" 202 Accepted 2026-04-14 01:27:24,600 - lava_callback - INFO - Starting async job submit for node 69dd96c6c2164e674d72029c 2026-04-14 01:27:24,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:27:24,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd96c6c2164e674d72029c HTTP/1.1" 200 None 2026-04-14 01:27:24,645 - lava_callback - DEBUG - Processing node 69dd96c6c2164e674d72029c: baseline-arm64 2026-04-14 01:27:24,852 - lava_callback - WARNING - Failed to upload log 2026-04-14 01:27:24,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:27:25,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:27:25,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd96c6c2164e674d72029c/lava-logs.yaml 2026-04-14 01:27:25,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:27:25,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:27:25,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd96c6c2164e674d72029c/lava_callback.json.gz 2026-04-14 01:27:25,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:27:25,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd96c6c2164e674d72029c HTTP/1.1" 200 None 2026-04-14 01:27:25,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:27:25,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:27:25,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:27:25,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd96c6c2164e674d72029c HTTP/1.1" 200 None 2026-04-14 01:27:25,632 - lava_callback - INFO - Completed processing callback for node 69dd96c6c2164e674d72029c INFO: 172.20.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56544 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:27:36,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:27:36,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50672 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:33:07,918 - lava_callback - INFO - Received callback for node 69daf6490a04df09a44e9e73 INFO: 172.20.0.1:50682 - "POST /node/69daf6490a04df09a44e9e73 HTTP/1.0" 202 Accepted 2026-04-14 01:33:07,924 - lava_callback - INFO - Starting async job submit for node 69daf6490a04df09a44e9e73 2026-04-14 01:33:07,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:33:07,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf6490a04df09a44e9e73 HTTP/1.1" 200 None 2026-04-14 01:33:07,939 - lava_callback - DEBUG - Processing node 69daf6490a04df09a44e9e73: baseline-arm-clabbe 2026-04-14 01:33:07,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf6490a04df09a44e9e73 2026-04-14 01:33:07,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:33:07,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf6490a04df09a44e9e73 HTTP/1.1" 200 None 2026-04-14 01:33:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:33:08,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:33:08,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:33:08,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf6490a04df09a44e9e73 HTTP/1.1" 200 None 2026-04-14 01:33:08,036 - lava_callback - ERROR - Error processing callback for node 69daf6490a04df09a44e9e73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47074 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:34:47,996 - lava_callback - INFO - Received callback for node 69daf6ab0a04df09a44e9ed2 INFO: 172.20.0.1:47076 - "POST /node/69daf6ab0a04df09a44e9ed2 HTTP/1.0" 202 Accepted 2026-04-14 01:34:48,001 - lava_callback - INFO - Starting async job submit for node 69daf6ab0a04df09a44e9ed2 2026-04-14 01:34:48,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:34:48,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf6ab0a04df09a44e9ed2 HTTP/1.1" 200 None 2026-04-14 01:34:48,018 - lava_callback - DEBUG - Processing node 69daf6ab0a04df09a44e9ed2: baseline-arm-clabbe 2026-04-14 01:34:48,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf6ab0a04df09a44e9ed2 2026-04-14 01:34:48,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:34:48,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf6ab0a04df09a44e9ed2 HTTP/1.1" 200 None 2026-04-14 01:34:48,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:34:48,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:34:48,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:34:48,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf6ab0a04df09a44e9ed2 HTTP/1.1" 200 None 2026-04-14 01:34:48,066 - lava_callback - ERROR - Error processing callback for node 69daf6ab0a04df09a44e9ed2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46272 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:36:28,078 - lava_callback - INFO - Received callback for node 69daf7100a04df09a44e9f60 INFO: 172.20.0.1:46284 - "POST /node/69daf7100a04df09a44e9f60 HTTP/1.0" 202 Accepted 2026-04-14 01:36:28,083 - lava_callback - INFO - Starting async job submit for node 69daf7100a04df09a44e9f60 2026-04-14 01:36:28,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:36:28,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7100a04df09a44e9f60 HTTP/1.1" 200 None 2026-04-14 01:36:28,100 - lava_callback - DEBUG - Processing node 69daf7100a04df09a44e9f60: baseline-arm-clabbe 2026-04-14 01:36:28,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf7100a04df09a44e9f60 2026-04-14 01:36:28,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:36:28,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7100a04df09a44e9f60 HTTP/1.1" 200 None 2026-04-14 01:36:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:36:28,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:36:28,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:36:28,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf7100a04df09a44e9f60 HTTP/1.1" 200 None 2026-04-14 01:36:28,153 - lava_callback - ERROR - Error processing callback for node 69daf7100a04df09a44e9f60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:37:08,078 - lava_callback - INFO - Received callback for node 69daf7330a04df09a44e9f8e INFO: 172.20.0.1:51844 - "POST /node/69daf7330a04df09a44e9f8e HTTP/1.0" 202 Accepted 2026-04-14 01:37:08,087 - lava_callback - INFO - Starting async job submit for node 69daf7330a04df09a44e9f8e 2026-04-14 01:37:08,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:37:08,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7330a04df09a44e9f8e HTTP/1.1" 200 None 2026-04-14 01:37:08,122 - lava_callback - DEBUG - Processing node 69daf7330a04df09a44e9f8e: baseline-arm-clabbe 2026-04-14 01:37:08,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf7330a04df09a44e9f8e 2026-04-14 01:37:08,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:37:08,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7330a04df09a44e9f8e HTTP/1.1" 200 None 2026-04-14 01:37:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:37:08,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:37:08,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:37:08,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf7330a04df09a44e9f8e HTTP/1.1" 200 None 2026-04-14 01:37:08,190 - lava_callback - ERROR - Error processing callback for node 69daf7330a04df09a44e9f8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:38:32,668 - lava_callback - INFO - Received callback for node 69dd902ac2164e674d71f920 INFO: 172.20.0.1:60356 - "POST /node/69dd902ac2164e674d71f920 HTTP/1.0" 202 Accepted 2026-04-14 01:38:32,674 - lava_callback - INFO - Starting async job submit for node 69dd902ac2164e674d71f920 2026-04-14 01:38:32,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:32,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902ac2164e674d71f920 HTTP/1.1" 200 None 2026-04-14 01:38:32,711 - lava_callback - DEBUG - Processing node 69dd902ac2164e674d71f920: baseline-arm64-broonie 2026-04-14 01:38:32,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:38:33,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:38:33,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ac2164e674d71f920/log.txt.gz 2026-04-14 01:38:33,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:38:33,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:38:33,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ac2164e674d71f920/lava-logs.yaml 2026-04-14 01:38:33,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:38:33,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:38:33,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd902ac2164e674d71f920/lava_callback.json.gz 2026-04-14 01:38:33,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:33,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd902ac2164e674d71f920 HTTP/1.1" 200 None 2026-04-14 01:38:33,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:33,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:38:33,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:33,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd902ac2164e674d71f920 HTTP/1.1" 200 None 2026-04-14 01:38:33,664 - lava_callback - INFO - Completed processing callback for node 69dd902ac2164e674d71f920 INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:38:36,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:36,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:38:48,184 - lava_callback - INFO - Received callback for node 69daf79e0a04df09a44e9fe0 INFO: 172.20.0.1:44842 - "POST /node/69daf79e0a04df09a44e9fe0 HTTP/1.0" 202 Accepted 2026-04-14 01:38:48,190 - lava_callback - INFO - Starting async job submit for node 69daf79e0a04df09a44e9fe0 2026-04-14 01:38:48,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:48,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf79e0a04df09a44e9fe0 HTTP/1.1" 200 None 2026-04-14 01:38:48,205 - lava_callback - DEBUG - Processing node 69daf79e0a04df09a44e9fe0: baseline-arm-clabbe 2026-04-14 01:38:48,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf79e0a04df09a44e9fe0 2026-04-14 01:38:48,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:48,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf79e0a04df09a44e9fe0 HTTP/1.1" 200 None 2026-04-14 01:38:48,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:48,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:38:48,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:38:48,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf79e0a04df09a44e9fe0 HTTP/1.1" 200 None 2026-04-14 01:38:48,261 - lava_callback - ERROR - Error processing callback for node 69daf79e0a04df09a44e9fe0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36782 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:39:28,148 - lava_callback - INFO - Received callback for node 69daf7be0a04df09a44ea00f INFO: 172.20.0.1:36788 - "POST /node/69daf7be0a04df09a44ea00f HTTP/1.0" 202 Accepted 2026-04-14 01:39:28,154 - lava_callback - INFO - Starting async job submit for node 69daf7be0a04df09a44ea00f 2026-04-14 01:39:28,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:28,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7be0a04df09a44ea00f HTTP/1.1" 200 None 2026-04-14 01:39:28,173 - lava_callback - DEBUG - Processing node 69daf7be0a04df09a44ea00f: baseline-arm-clabbe 2026-04-14 01:39:28,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf7be0a04df09a44ea00f 2026-04-14 01:39:28,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:28,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7be0a04df09a44ea00f HTTP/1.1" 200 None 2026-04-14 01:39:28,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:28,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:39:28,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:28,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf7be0a04df09a44ea00f HTTP/1.1" 200 None 2026-04-14 01:39:28,224 - lava_callback - ERROR - Error processing callback for node 69daf7be0a04df09a44ea00f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:39:48,205 - lava_callback - INFO - Received callback for node 69daf7e10a04df09a44ea02c INFO: 172.20.0.1:50070 - "POST /node/69daf7e10a04df09a44ea02c HTTP/1.0" 202 Accepted 2026-04-14 01:39:48,211 - lava_callback - INFO - Starting async job submit for node 69daf7e10a04df09a44ea02c 2026-04-14 01:39:48,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:48,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7e10a04df09a44ea02c HTTP/1.1" 200 None 2026-04-14 01:39:48,226 - lava_callback - DEBUG - Processing node 69daf7e10a04df09a44ea02c: baseline-arm-clabbe 2026-04-14 01:39:48,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf7e10a04df09a44ea02c 2026-04-14 01:39:48,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:48,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf7e10a04df09a44ea02c HTTP/1.1" 200 None 2026-04-14 01:39:48,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:48,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 01:39:48,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:48,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf7e10a04df09a44ea02c HTTP/1.1" 200 None 2026-04-14 01:39:48,282 - lava_callback - ERROR - Error processing callback for node 69daf7e10a04df09a44ea02c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 01:39:53,511 - lava_callback - INFO - Received callback for node 69dd9710c2164e674d7202ce INFO: 172.20.0.1:54154 - "POST /node/69dd9710c2164e674d7202ce HTTP/1.0" 202 Accepted 2026-04-14 01:39:53,518 - lava_callback - INFO - Starting async job submit for node 69dd9710c2164e674d7202ce 2026-04-14 01:39:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:53,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9710c2164e674d7202ce HTTP/1.1" 200 None 2026-04-14 01:39:53,588 - lava_callback - DEBUG - Processing node 69dd9710c2164e674d7202ce: baseline-arm 2026-04-14 01:39:54,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:39:54,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:39:54,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dd9710c2164e674d7202ce/log.txt.gz 2026-04-14 01:39:54,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:39:54,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:39:54,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd9710c2164e674d7202ce/lava-logs.yaml 2026-04-14 01:39:54,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:39:55,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:39:55,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd9710c2164e674d7202ce/lava_callback.json.gz DEBUG: Setup failed for 69dd9710c2164e674d7202ce. Transitting job node result: incomplete -> fail 2026-04-14 01:39:55,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:55,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9710c2164e674d7202ce HTTP/1.1" 200 None 2026-04-14 01:39:55,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:55,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:39:55,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:39:55,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9710c2164e674d7202ce HTTP/1.1" 200 None 2026-04-14 01:39:55,620 - lava_callback - INFO - Completed processing callback for node 69dd9710c2164e674d7202ce INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52448 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:40:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:40:06,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:43:59,286 - lava_callback - INFO - Received callback for node 69daf8d00a04df09a44ea12f INFO: 172.20.0.1:45752 - "POST /node/69daf8d00a04df09a44ea12f HTTP/1.0" 202 Accepted 2026-04-14 01:43:59,292 - lava_callback - INFO - Starting async job submit for node 69daf8d00a04df09a44ea12f 2026-04-14 01:43:59,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:43:59,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf8d00a04df09a44ea12f HTTP/1.1" 200 None 2026-04-14 01:43:59,307 - lava_callback - DEBUG - Processing node 69daf8d00a04df09a44ea12f: baseline-arm-baylibre 2026-04-14 01:43:59,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf8d00a04df09a44ea12f 2026-04-14 01:43:59,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:43:59,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf8d00a04df09a44ea12f HTTP/1.1" 200 None 2026-04-14 01:43:59,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:43:59,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:43:59,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:43:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf8d00a04df09a44ea12f HTTP/1.1" 200 None 2026-04-14 01:43:59,355 - lava_callback - ERROR - Error processing callback for node 69daf8d00a04df09a44ea12f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:45:39,417 - lava_callback - INFO - Received callback for node 69daf9340a04df09a44ea1b3 INFO: 172.20.0.1:56146 - "POST /node/69daf9340a04df09a44ea1b3 HTTP/1.0" 202 Accepted 2026-04-14 01:45:39,423 - lava_callback - INFO - Starting async job submit for node 69daf9340a04df09a44ea1b3 2026-04-14 01:45:39,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:45:39,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9340a04df09a44ea1b3 HTTP/1.1" 200 None 2026-04-14 01:45:39,452 - lava_callback - DEBUG - Processing node 69daf9340a04df09a44ea1b3: baseline-arm-baylibre 2026-04-14 01:45:39,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf9340a04df09a44ea1b3 2026-04-14 01:45:39,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:45:39,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9340a04df09a44ea1b3 HTTP/1.1" 200 None 2026-04-14 01:45:39,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:45:39,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:45:39,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:45:39,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf9340a04df09a44ea1b3 HTTP/1.1" 200 None 2026-04-14 01:45:39,509 - lava_callback - ERROR - Error processing callback for node 69daf9340a04df09a44ea1b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:47:19,436 - lava_callback - INFO - Received callback for node 69daf9980a04df09a44ea1df INFO: 172.20.0.1:36928 - "POST /node/69daf9980a04df09a44ea1df HTTP/1.0" 202 Accepted 2026-04-14 01:47:19,442 - lava_callback - INFO - Starting async job submit for node 69daf9980a04df09a44ea1df 2026-04-14 01:47:19,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:19,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9980a04df09a44ea1df HTTP/1.1" 200 None 2026-04-14 01:47:19,458 - lava_callback - DEBUG - Processing node 69daf9980a04df09a44ea1df: baseline-arm-baylibre 2026-04-14 01:47:19,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf9980a04df09a44ea1df 2026-04-14 01:47:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9980a04df09a44ea1df HTTP/1.1" 200 None 2026-04-14 01:47:19,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:19,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:47:19,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:19,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf9980a04df09a44ea1df HTTP/1.1" 200 None 2026-04-14 01:47:19,507 - lava_callback - ERROR - Error processing callback for node 69daf9980a04df09a44ea1df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:47:59,469 - lava_callback - INFO - Received callback for node 69daf9be0a04df09a44ea1f1 INFO: 172.20.0.1:36666 - "POST /node/69daf9be0a04df09a44ea1f1 HTTP/1.0" 202 Accepted 2026-04-14 01:47:59,474 - lava_callback - INFO - Starting async job submit for node 69daf9be0a04df09a44ea1f1 2026-04-14 01:47:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:59,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9be0a04df09a44ea1f1 HTTP/1.1" 200 None 2026-04-14 01:47:59,490 - lava_callback - DEBUG - Processing node 69daf9be0a04df09a44ea1f1: baseline-arm-baylibre 2026-04-14 01:47:59,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf9be0a04df09a44ea1f1 2026-04-14 01:47:59,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:59,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9be0a04df09a44ea1f1 HTTP/1.1" 200 None 2026-04-14 01:47:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:47:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:47:59,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf9be0a04df09a44ea1f1 HTTP/1.1" 200 None 2026-04-14 01:47:59,542 - lava_callback - ERROR - Error processing callback for node 69daf9be0a04df09a44ea1f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47342 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:48:19,478 - lava_callback - INFO - Received callback for node 69daf9de0a04df09a44ea200 INFO: 172.20.0.1:47344 - "POST /node/69daf9de0a04df09a44ea200 HTTP/1.0" 202 Accepted 2026-04-14 01:48:19,483 - lava_callback - INFO - Starting async job submit for node 69daf9de0a04df09a44ea200 2026-04-14 01:48:19,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:19,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9de0a04df09a44ea200 HTTP/1.1" 200 None 2026-04-14 01:48:19,511 - lava_callback - DEBUG - Processing node 69daf9de0a04df09a44ea200: baseline-arm-baylibre 2026-04-14 01:48:19,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daf9de0a04df09a44ea200 2026-04-14 01:48:19,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:19,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daf9de0a04df09a44ea200 HTTP/1.1" 200 None 2026-04-14 01:48:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:19,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:48:19,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:19,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daf9de0a04df09a44ea200 HTTP/1.1" 200 None 2026-04-14 01:48:19,560 - lava_callback - ERROR - Error processing callback for node 69daf9de0a04df09a44ea200: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43678 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:48:39,714 - lava_callback - INFO - Received callback for node 69dd9ce1c2164e674d7208d5 INFO: 172.20.0.1:48670 - "POST /node/69dd9ce1c2164e674d7208d5 HTTP/1.0" 202 Accepted 2026-04-14 01:48:39,720 - lava_callback - INFO - Starting async job submit for node 69dd9ce1c2164e674d7208d5 2026-04-14 01:48:39,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ce1c2164e674d7208d5 HTTP/1.1" 200 None 2026-04-14 01:48:39,743 - lava_callback - DEBUG - Processing node 69dd9ce1c2164e674d7208d5: baseline-arm 2026-04-14 01:48:39,748 - lava_callback - WARNING - Failed to upload log 2026-04-14 01:48:39,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:48:40,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:48:40,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dd9ce1c2164e674d7208d5/lava-logs.yaml 2026-04-14 01:48:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:48:40,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:48:40,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dd9ce1c2164e674d7208d5/lava_callback.json.gz 2026-04-14 01:48:40,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:40,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ce1c2164e674d7208d5 HTTP/1.1" 200 None 2026-04-14 01:48:40,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:40,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 01:48:40,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:40,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9ce1c2164e674d7208d5 HTTP/1.1" 200 None 2026-04-14 01:48:40,282 - lava_callback - INFO - Completed processing callback for node 69dd9ce1c2164e674d7208d5 INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:48:59,526 - lava_callback - INFO - Received callback for node 69dafa010a04df09a44ea236 INFO: 172.20.0.1:33472 - "POST /node/69dafa010a04df09a44ea236 HTTP/1.0" 202 Accepted 2026-04-14 01:48:59,532 - lava_callback - INFO - Starting async job submit for node 69dafa010a04df09a44ea236 2026-04-14 01:48:59,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:59,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa010a04df09a44ea236 HTTP/1.1" 200 None 2026-04-14 01:48:59,547 - lava_callback - DEBUG - Processing node 69dafa010a04df09a44ea236: baseline-arm-baylibre 2026-04-14 01:48:59,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafa010a04df09a44ea236 2026-04-14 01:48:59,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:59,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa010a04df09a44ea236 HTTP/1.1" 200 None 2026-04-14 01:48:59,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:59,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:48:59,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:48:59,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafa010a04df09a44ea236 HTTP/1.1" 200 None 2026-04-14 01:48:59,615 - lava_callback - ERROR - Error processing callback for node 69dafa010a04df09a44ea236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:49:06,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:06,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 01:49:10,703 - lava_callback - INFO - Received callback for node 69dd9bc3c2164e674d72078f INFO: 172.20.0.1:38400 - "POST /node/69dd9bc3c2164e674d72078f HTTP/1.0" 202 Accepted 2026-04-14 01:49:10,711 - lava_callback - INFO - Starting async job submit for node 69dd9bc3c2164e674d72078f 2026-04-14 01:49:10,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:10,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9bc3c2164e674d72078f HTTP/1.1" 200 None 2026-04-14 01:49:10,766 - lava_callback - DEBUG - Processing node 69dd9bc3c2164e674d72078f: baseline-arm64 2026-04-14 01:49:11,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:49:11,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:49:11,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9bc3c2164e674d72078f/log.txt.gz 2026-04-14 01:49:11,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:49:11,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:49:11,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9bc3c2164e674d72078f/lava-logs.yaml 2026-04-14 01:49:11,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 01:49:11,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 01:49:11,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9bc3c2164e674d72078f/lava_callback.json.gz DEBUG: Setup failed for 69dd9bc3c2164e674d72078f. Transitting job node result: incomplete -> fail 2026-04-14 01:49:11,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:11,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9bc3c2164e674d72078f HTTP/1.1" 200 None 2026-04-14 01:49:11,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:11,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 01:49:11,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9bc3c2164e674d72078f HTTP/1.1" 200 None 2026-04-14 01:49:12,032 - lava_callback - INFO - Completed processing callback for node 69dd9bc3c2164e674d72078f INFO: 172.20.0.1:38412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:49:28,641 - lava_callback - INFO - Received callback for node 69dafa250a04df09a44ea252 INFO: 172.20.0.1:33580 - "POST /node/69dafa250a04df09a44ea252 HTTP/1.0" 202 Accepted 2026-04-14 01:49:28,647 - lava_callback - INFO - Starting async job submit for node 69dafa250a04df09a44ea252 2026-04-14 01:49:28,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:28,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa250a04df09a44ea252 HTTP/1.1" 200 None 2026-04-14 01:49:28,664 - lava_callback - DEBUG - Processing node 69dafa250a04df09a44ea252: baseline-arm-clabbe 2026-04-14 01:49:28,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafa250a04df09a44ea252 2026-04-14 01:49:28,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:28,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa250a04df09a44ea252 HTTP/1.1" 200 None 2026-04-14 01:49:28,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:28,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:49:28,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafa250a04df09a44ea252 HTTP/1.1" 200 None 2026-04-14 01:49:28,718 - lava_callback - ERROR - Error processing callback for node 69dafa250a04df09a44ea252: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:49:36,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:49:36,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:51:28,646 - lava_callback - INFO - Received callback for node 69dafa8c0a04df09a44ea2a8 INFO: 172.20.0.1:41106 - "POST /node/69dafa8c0a04df09a44ea2a8 HTTP/1.0" 202 Accepted 2026-04-14 01:51:28,652 - lava_callback - INFO - Starting async job submit for node 69dafa8c0a04df09a44ea2a8 2026-04-14 01:51:28,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:28,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa8c0a04df09a44ea2a8 HTTP/1.1" 200 None 2026-04-14 01:51:28,667 - lava_callback - DEBUG - Processing node 69dafa8c0a04df09a44ea2a8: baseline-arm-clabbe 2026-04-14 01:51:28,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafa8c0a04df09a44ea2a8 2026-04-14 01:51:28,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:28,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafa8c0a04df09a44ea2a8 HTTP/1.1" 200 None 2026-04-14 01:51:28,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:28,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:51:28,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:28,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafa8c0a04df09a44ea2a8 HTTP/1.1" 200 None 2026-04-14 01:51:28,722 - lava_callback - ERROR - Error processing callback for node 69dafa8c0a04df09a44ea2a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:51:48,618 - lava_callback - INFO - Received callback for node 69dafaaf0a04df09a44ea2cb INFO: 172.20.0.1:54870 - "POST /node/69dafaaf0a04df09a44ea2cb HTTP/1.0" 202 Accepted 2026-04-14 01:51:48,624 - lava_callback - INFO - Starting async job submit for node 69dafaaf0a04df09a44ea2cb 2026-04-14 01:51:48,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:48,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafaaf0a04df09a44ea2cb HTTP/1.1" 200 None 2026-04-14 01:51:48,642 - lava_callback - DEBUG - Processing node 69dafaaf0a04df09a44ea2cb: baseline-arm-clabbe 2026-04-14 01:51:48,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafaaf0a04df09a44ea2cb 2026-04-14 01:51:48,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:48,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafaaf0a04df09a44ea2cb HTTP/1.1" 200 None 2026-04-14 01:51:48,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:48,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:51:48,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:51:48,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafaaf0a04df09a44ea2cb HTTP/1.1" 200 None 2026-04-14 01:51:48,697 - lava_callback - ERROR - Error processing callback for node 69dafaaf0a04df09a44ea2cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:52:28,690 - lava_callback - INFO - Received callback for node 69dafad20a04df09a44ea2e6 INFO: 172.20.0.1:40222 - "POST /node/69dafad20a04df09a44ea2e6 HTTP/1.0" 202 Accepted 2026-04-14 01:52:28,696 - lava_callback - INFO - Starting async job submit for node 69dafad20a04df09a44ea2e6 2026-04-14 01:52:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:52:28,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafad20a04df09a44ea2e6 HTTP/1.1" 200 None 2026-04-14 01:52:28,711 - lava_callback - DEBUG - Processing node 69dafad20a04df09a44ea2e6: baseline-arm-clabbe 2026-04-14 01:52:28,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafad20a04df09a44ea2e6 2026-04-14 01:52:28,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:52:28,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafad20a04df09a44ea2e6 HTTP/1.1" 200 None 2026-04-14 01:52:28,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:52:28,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:52:28,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:52:28,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafad20a04df09a44ea2e6 HTTP/1.1" 200 None 2026-04-14 01:52:28,767 - lava_callback - ERROR - Error processing callback for node 69dafad20a04df09a44ea2e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56382 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:53:08,676 - lava_callback - INFO - Received callback for node 69dafaf60a04df09a44ea301 INFO: 172.20.0.1:56392 - "POST /node/69dafaf60a04df09a44ea301 HTTP/1.0" 202 Accepted 2026-04-14 01:53:08,682 - lava_callback - INFO - Starting async job submit for node 69dafaf60a04df09a44ea301 2026-04-14 01:53:08,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:53:08,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafaf60a04df09a44ea301 HTTP/1.1" 200 None 2026-04-14 01:53:08,709 - lava_callback - DEBUG - Processing node 69dafaf60a04df09a44ea301: baseline-arm-clabbe 2026-04-14 01:53:08,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafaf60a04df09a44ea301 2026-04-14 01:53:08,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:53:08,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafaf60a04df09a44ea301 HTTP/1.1" 200 None 2026-04-14 01:53:08,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:53:08,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:53:08,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:53:08,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafaf60a04df09a44ea301 HTTP/1.1" 200 None 2026-04-14 01:53:08,759 - lava_callback - ERROR - Error processing callback for node 69dafaf60a04df09a44ea301: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58414 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:55:28,790 - lava_callback - INFO - Received callback for node 69dafb810a04df09a44ea377 INFO: 172.20.0.1:58418 - "POST /node/69dafb810a04df09a44ea377 HTTP/1.0" 202 Accepted 2026-04-14 01:55:28,796 - lava_callback - INFO - Starting async job submit for node 69dafb810a04df09a44ea377 2026-04-14 01:55:28,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:55:28,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafb810a04df09a44ea377 HTTP/1.1" 200 None 2026-04-14 01:55:28,812 - lava_callback - DEBUG - Processing node 69dafb810a04df09a44ea377: baseline-arm-clabbe 2026-04-14 01:55:28,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafb810a04df09a44ea377 2026-04-14 01:55:28,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:55:28,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafb810a04df09a44ea377 HTTP/1.1" 200 None 2026-04-14 01:55:28,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:55:28,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:55:28,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:55:28,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafb810a04df09a44ea377 HTTP/1.1" 200 None 2026-04-14 01:55:28,863 - lava_callback - ERROR - Error processing callback for node 69dafb810a04df09a44ea377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:57:08,876 - lava_callback - INFO - Received callback for node 69dafbec0a04df09a44ea3d4 INFO: 172.20.0.1:37860 - "POST /node/69dafbec0a04df09a44ea3d4 HTTP/1.0" 202 Accepted 2026-04-14 01:57:08,882 - lava_callback - INFO - Starting async job submit for node 69dafbec0a04df09a44ea3d4 2026-04-14 01:57:08,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:08,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafbec0a04df09a44ea3d4 HTTP/1.1" 200 None 2026-04-14 01:57:08,897 - lava_callback - DEBUG - Processing node 69dafbec0a04df09a44ea3d4: baseline-arm-clabbe 2026-04-14 01:57:08,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafbec0a04df09a44ea3d4 2026-04-14 01:57:08,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:08,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafbec0a04df09a44ea3d4 HTTP/1.1" 200 None 2026-04-14 01:57:08,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:08,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:57:08,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:08,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafbec0a04df09a44ea3d4 HTTP/1.1" 200 None 2026-04-14 01:57:08,944 - lava_callback - ERROR - Error processing callback for node 69dafbec0a04df09a44ea3d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:57:48,856 - lava_callback - INFO - Received callback for node 69dafc0d0a04df09a44ea3fa INFO: 172.20.0.1:38960 - "POST /node/69dafc0d0a04df09a44ea3fa HTTP/1.0" 202 Accepted 2026-04-14 01:57:48,861 - lava_callback - INFO - Starting async job submit for node 69dafc0d0a04df09a44ea3fa 2026-04-14 01:57:48,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:48,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafc0d0a04df09a44ea3fa HTTP/1.1" 200 None 2026-04-14 01:57:48,877 - lava_callback - DEBUG - Processing node 69dafc0d0a04df09a44ea3fa: baseline-arm-clabbe 2026-04-14 01:57:48,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafc0d0a04df09a44ea3fa 2026-04-14 01:57:48,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:48,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafc0d0a04df09a44ea3fa HTTP/1.1" 200 None 2026-04-14 01:57:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:48,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:57:48,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:57:48,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafc0d0a04df09a44ea3fa HTTP/1.1" 200 None 2026-04-14 01:57:48,949 - lava_callback - ERROR - Error processing callback for node 69dafc0d0a04df09a44ea3fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44918 - "GET / HTTP/1.0" 200 OK 2026-04-14 01:59:28,982 - lava_callback - INFO - Received callback for node 69dafc6c0a04df09a44ea46c INFO: 172.20.0.1:44932 - "POST /node/69dafc6c0a04df09a44ea46c HTTP/1.0" 202 Accepted 2026-04-14 01:59:28,988 - lava_callback - INFO - Starting async job submit for node 69dafc6c0a04df09a44ea46c 2026-04-14 01:59:28,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:59:29,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafc6c0a04df09a44ea46c HTTP/1.1" 200 None 2026-04-14 01:59:29,005 - lava_callback - DEBUG - Processing node 69dafc6c0a04df09a44ea46c: baseline-arm-clabbe 2026-04-14 01:59:29,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafc6c0a04df09a44ea46c 2026-04-14 01:59:29,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:59:29,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafc6c0a04df09a44ea46c HTTP/1.1" 200 None 2026-04-14 01:59:29,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:59:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-14 01:59:29,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 01:59:29,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafc6c0a04df09a44ea46c HTTP/1.1" 200 None 2026-04-14 01:59:29,052 - lava_callback - ERROR - Error processing callback for node 69dafc6c0a04df09a44ea46c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:03:34,027 - lava_callback - INFO - Received callback for node 69dd9f78c2164e674d720bb5 INFO: 172.20.0.1:56172 - "POST /node/69dd9f78c2164e674d720bb5 HTTP/1.0" 202 Accepted 2026-04-14 02:03:34,033 - lava_callback - INFO - Starting async job submit for node 69dd9f78c2164e674d720bb5 2026-04-14 02:03:34,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:03:34,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f78c2164e674d720bb5 HTTP/1.1" 200 None 2026-04-14 02:03:34,127 - lava_callback - DEBUG - Processing node 69dd9f78c2164e674d720bb5: ltp-fsx 2026-04-14 02:03:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:03:34,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:03:34,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69dd9f78c2164e674d720bb5/log.txt.gz 2026-04-14 02:03:34,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:03:35,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:03:35,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69dd9f78c2164e674d720bb5/lava-logs.yaml 2026-04-14 02:03:35,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:03:35,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:03:35,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69dd9f78c2164e674d720bb5/lava_callback.json.gz 2026-04-14 02:03:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:03:35,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f78c2164e674d720bb5 HTTP/1.1" 200 None 2026-04-14 02:03:35,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:03:35,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 02:03:35,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:03:35,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9f78c2164e674d720bb5 HTTP/1.1" 200 None 2026-04-14 02:03:35,287 - lava_callback - INFO - Completed processing callback for node 69dd9f78c2164e674d720bb5 INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:03:36,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:03:36,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:04:13,779 - lava_callback - INFO - Received callback for node 69dd9fa9c2164e674d720bc6 INFO: 172.20.0.1:49032 - "POST /node/69dd9fa9c2164e674d720bc6 HTTP/1.0" 202 Accepted 2026-04-14 02:04:13,785 - lava_callback - INFO - Starting async job submit for node 69dd9fa9c2164e674d720bc6 2026-04-14 02:04:13,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:04:13,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fa9c2164e674d720bc6 HTTP/1.1" 200 None 2026-04-14 02:04:13,825 - lava_callback - DEBUG - Processing node 69dd9fa9c2164e674d720bc6: ltp-ipc 2026-04-14 02:04:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:04:14,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:04:14,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69dd9fa9c2164e674d720bc6/log.txt.gz 2026-04-14 02:04:14,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:04:14,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:04:14,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69dd9fa9c2164e674d720bc6/lava-logs.yaml 2026-04-14 02:04:14,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:04:15,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:04:15,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69dd9fa9c2164e674d720bc6/lava_callback.json.gz 2026-04-14 02:04:15,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:04:15,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fa9c2164e674d720bc6 HTTP/1.1" 200 None 2026-04-14 02:04:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:04:15,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 02:04:15,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:04:15,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9fa9c2164e674d720bc6 HTTP/1.1" 200 None 2026-04-14 02:04:15,153 - lava_callback - INFO - Completed processing callback for node 69dd9fa9c2164e674d720bc6 INFO: 172.20.0.1:49034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52860 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:04:36,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:04:36,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56060 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:05:20,360 - lava_callback - INFO - Received callback for node 69dafdd90a04df09a44ea5b8 INFO: 172.20.0.1:33420 - "POST /node/69dafdd90a04df09a44ea5b8 HTTP/1.0" 202 Accepted 2026-04-14 02:05:20,365 - lava_callback - INFO - Starting async job submit for node 69dafdd90a04df09a44ea5b8 2026-04-14 02:05:20,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:05:20,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafdd90a04df09a44ea5b8 HTTP/1.1" 200 None 2026-04-14 02:05:20,380 - lava_callback - DEBUG - Processing node 69dafdd90a04df09a44ea5b8: baseline-arm64-baylibre 2026-04-14 02:05:20,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafdd90a04df09a44ea5b8 2026-04-14 02:05:20,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:05:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafdd90a04df09a44ea5b8 HTTP/1.1" 200 None 2026-04-14 02:05:20,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:05:20,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:05:20,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:05:20,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafdd90a04df09a44ea5b8 HTTP/1.1" 200 None 2026-04-14 02:05:20,428 - lava_callback - ERROR - Error processing callback for node 69dafdd90a04df09a44ea5b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38518 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:07:57,558 - lava_callback - INFO - Received callback for node 69dda131c2164e674d720d95 INFO: 172.20.0.1:38534 - "POST /node/69dda131c2164e674d720d95 HTTP/1.0" 202 Accepted 2026-04-14 02:07:57,565 - lava_callback - INFO - Starting async job submit for node 69dda131c2164e674d720d95 2026-04-14 02:07:57,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:07:57,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda131c2164e674d720d95 HTTP/1.1" 200 None 2026-04-14 02:07:57,602 - lava_callback - DEBUG - Processing node 69dda131c2164e674d720d95: baseline-nfs-arm64 2026-04-14 02:07:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:07:58,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:07:58,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda131c2164e674d720d95/log.txt.gz 2026-04-14 02:07:58,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:07:58,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:07:58,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda131c2164e674d720d95/lava-logs.yaml 2026-04-14 02:07:58,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:07:59,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:07:59,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda131c2164e674d720d95/lava_callback.json.gz 2026-04-14 02:07:59,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:07:59,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda131c2164e674d720d95 HTTP/1.1" 200 None 2026-04-14 02:07:59,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:07:59,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:07:59,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:07:59,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda131c2164e674d720d95 HTTP/1.1" 200 None 2026-04-14 02:07:59,153 - lava_callback - INFO - Completed processing callback for node 69dda131c2164e674d720d95 INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:08:06,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:08:06,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:08:20,561 - lava_callback - INFO - Received callback for node 69dafe880a04df09a44ea66b INFO: 172.20.0.1:59962 - "POST /node/69dafe880a04df09a44ea66b HTTP/1.0" 202 Accepted 2026-04-14 02:08:20,567 - lava_callback - INFO - Starting async job submit for node 69dafe880a04df09a44ea66b 2026-04-14 02:08:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:08:20,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafe880a04df09a44ea66b HTTP/1.1" 200 None 2026-04-14 02:08:20,581 - lava_callback - DEBUG - Processing node 69dafe880a04df09a44ea66b: baseline-arm64-baylibre 2026-04-14 02:08:20,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafe880a04df09a44ea66b 2026-04-14 02:08:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:08:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafe880a04df09a44ea66b HTTP/1.1" 200 None 2026-04-14 02:08:20,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:08:20,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:08:20,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:08:20,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafe880a04df09a44ea66b HTTP/1.1" 200 None 2026-04-14 02:08:20,634 - lava_callback - ERROR - Error processing callback for node 69dafe880a04df09a44ea66b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:09:40,591 - lava_callback - INFO - Received callback for node 69dafed00a04df09a44ea6a3 INFO: 172.20.0.1:60582 - "POST /node/69dafed00a04df09a44ea6a3 HTTP/1.0" 202 Accepted 2026-04-14 02:09:40,598 - lava_callback - INFO - Starting async job submit for node 69dafed00a04df09a44ea6a3 2026-04-14 02:09:40,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:09:40,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafed00a04df09a44ea6a3 HTTP/1.1" 200 None 2026-04-14 02:09:40,617 - lava_callback - DEBUG - Processing node 69dafed00a04df09a44ea6a3: baseline-arm64-baylibre 2026-04-14 02:09:40,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dafed00a04df09a44ea6a3 2026-04-14 02:09:40,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:09:40,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dafed00a04df09a44ea6a3 HTTP/1.1" 200 None 2026-04-14 02:09:40,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:09:40,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:09:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:09:40,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dafed00a04df09a44ea6a3 HTTP/1.1" 200 None 2026-04-14 02:09:40,668 - lava_callback - ERROR - Error processing callback for node 69dafed00a04df09a44ea6a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:10:40,676 - lava_callback - INFO - Received callback for node 69daff120a04df09a44ea6fc INFO: 172.20.0.1:33698 - "POST /node/69daff120a04df09a44ea6fc HTTP/1.0" 202 Accepted 2026-04-14 02:10:40,685 - lava_callback - INFO - Starting async job submit for node 69daff120a04df09a44ea6fc 2026-04-14 02:10:40,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:10:40,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daff120a04df09a44ea6fc HTTP/1.1" 200 None 2026-04-14 02:10:40,720 - lava_callback - DEBUG - Processing node 69daff120a04df09a44ea6fc: baseline-arm64-baylibre 2026-04-14 02:10:40,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daff120a04df09a44ea6fc 2026-04-14 02:10:40,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:10:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daff120a04df09a44ea6fc HTTP/1.1" 200 None 2026-04-14 02:10:40,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:10:40,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:10:40,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:10:40,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daff120a04df09a44ea6fc HTTP/1.1" 200 None 2026-04-14 02:10:40,827 - lava_callback - ERROR - Error processing callback for node 69daff120a04df09a44ea6fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58834 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:11:40,668 - lava_callback - INFO - Received callback for node 69daff590a04df09a44ea733 INFO: 172.20.0.1:38218 - "POST /node/69daff590a04df09a44ea733 HTTP/1.0" 202 Accepted 2026-04-14 02:11:40,677 - lava_callback - INFO - Starting async job submit for node 69daff590a04df09a44ea733 2026-04-14 02:11:40,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:11:40,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daff590a04df09a44ea733 HTTP/1.1" 200 None 2026-04-14 02:11:40,696 - lava_callback - DEBUG - Processing node 69daff590a04df09a44ea733: baseline-arm64-baylibre 2026-04-14 02:11:40,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daff590a04df09a44ea733 2026-04-14 02:11:40,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:11:40,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daff590a04df09a44ea733 HTTP/1.1" 200 None 2026-04-14 02:11:40,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:11:40,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:11:40,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:11:40,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daff590a04df09a44ea733 HTTP/1.1" 200 None 2026-04-14 02:11:40,743 - lava_callback - ERROR - Error processing callback for node 69daff590a04df09a44ea733: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:12:02,370 - lava_callback - INFO - Received callback for node 69dda25fc2164e674d720ebf INFO: 172.20.0.1:34526 - "POST /node/69dda25fc2164e674d720ebf HTTP/1.0" 202 Accepted 2026-04-14 02:12:02,376 - lava_callback - INFO - Starting async job submit for node 69dda25fc2164e674d720ebf 2026-04-14 02:12:02,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:12:02,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda25fc2164e674d720ebf HTTP/1.1" 200 None 2026-04-14 02:12:02,395 - lava_callback - DEBUG - Processing node 69dda25fc2164e674d720ebf: baseline-nfs-arm64 2026-04-14 02:12:02,396 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:12:02,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:12:02,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:12:02,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda25fc2164e674d720ebf/lava-logs.yaml 2026-04-14 02:12:02,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:12:02,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:12:02,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda25fc2164e674d720ebf/lava_callback.json.gz 2026-04-14 02:12:02,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:12:02,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda25fc2164e674d720ebf HTTP/1.1" 200 None 2026-04-14 02:12:02,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:12:02,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:12:02,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:12:02,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda25fc2164e674d720ebf HTTP/1.1" 200 None 2026-04-14 02:12:02,913 - lava_callback - INFO - Completed processing callback for node 69dda25fc2164e674d720ebf INFO: 172.20.0.1:34540 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:12:06,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:12:06,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34190 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:13:00,762 - lava_callback - INFO - Received callback for node 69daffa00a04df09a44ea76e INFO: 172.20.0.1:47026 - "POST /node/69daffa00a04df09a44ea76e HTTP/1.0" 202 Accepted 2026-04-14 02:13:00,767 - lava_callback - INFO - Starting async job submit for node 69daffa00a04df09a44ea76e 2026-04-14 02:13:00,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:13:00,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daffa00a04df09a44ea76e HTTP/1.1" 200 None 2026-04-14 02:13:00,783 - lava_callback - DEBUG - Processing node 69daffa00a04df09a44ea76e: baseline-arm64-baylibre 2026-04-14 02:13:00,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daffa00a04df09a44ea76e 2026-04-14 02:13:00,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:13:00,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daffa00a04df09a44ea76e HTTP/1.1" 200 None 2026-04-14 02:13:00,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:13:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:13:00,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:13:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daffa00a04df09a44ea76e HTTP/1.1" 200 None 2026-04-14 02:13:00,836 - lava_callback - ERROR - Error processing callback for node 69daffa00a04df09a44ea76e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:14:00,775 - lava_callback - INFO - Received callback for node 69daffe30a04df09a44ea7d2 INFO: 172.20.0.1:41994 - "POST /node/69daffe30a04df09a44ea7d2 HTTP/1.0" 202 Accepted 2026-04-14 02:14:00,780 - lava_callback - INFO - Starting async job submit for node 69daffe30a04df09a44ea7d2 2026-04-14 02:14:00,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:14:00,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daffe30a04df09a44ea7d2 HTTP/1.1" 200 None 2026-04-14 02:14:00,796 - lava_callback - DEBUG - Processing node 69daffe30a04df09a44ea7d2: baseline-arm64-baylibre 2026-04-14 02:14:00,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69daffe30a04df09a44ea7d2 2026-04-14 02:14:00,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:14:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69daffe30a04df09a44ea7d2 HTTP/1.1" 200 None 2026-04-14 02:14:00,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:14:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:14:00,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:14:00,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69daffe30a04df09a44ea7d2 HTTP/1.1" 200 None 2026-04-14 02:14:00,855 - lava_callback - ERROR - Error processing callback for node 69daffe30a04df09a44ea7d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34692 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:15:20,913 - lava_callback - INFO - Received callback for node 69db00290a04df09a44ea813 INFO: 172.20.0.1:34232 - "POST /node/69db00290a04df09a44ea813 HTTP/1.0" 202 Accepted 2026-04-14 02:15:20,921 - lava_callback - INFO - Starting async job submit for node 69db00290a04df09a44ea813 2026-04-14 02:15:20,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:15:20,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db00290a04df09a44ea813 HTTP/1.1" 200 None 2026-04-14 02:15:20,936 - lava_callback - DEBUG - Processing node 69db00290a04df09a44ea813: baseline-arm64-baylibre 2026-04-14 02:15:20,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db00290a04df09a44ea813 2026-04-14 02:15:20,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:15:20,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db00290a04df09a44ea813 HTTP/1.1" 200 None 2026-04-14 02:15:20,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:15:20,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:15:20,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:15:21,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db00290a04df09a44ea813 HTTP/1.1" 200 None 2026-04-14 02:15:21,008 - lava_callback - ERROR - Error processing callback for node 69db00290a04df09a44ea813: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:16:20,917 - lava_callback - INFO - Received callback for node 69db00720a04df09a44ea848 INFO: 172.20.0.1:47180 - "POST /node/69db00720a04df09a44ea848 HTTP/1.0" 202 Accepted 2026-04-14 02:16:20,923 - lava_callback - INFO - Starting async job submit for node 69db00720a04df09a44ea848 2026-04-14 02:16:20,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:16:20,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db00720a04df09a44ea848 HTTP/1.1" 200 None 2026-04-14 02:16:20,938 - lava_callback - DEBUG - Processing node 69db00720a04df09a44ea848: baseline-arm64-baylibre 2026-04-14 02:16:20,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db00720a04df09a44ea848 2026-04-14 02:16:20,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:16:20,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db00720a04df09a44ea848 HTTP/1.1" 200 None 2026-04-14 02:16:20,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:16:20,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:16:20,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:16:20,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db00720a04df09a44ea848 HTTP/1.1" 200 None 2026-04-14 02:16:20,996 - lava_callback - ERROR - Error processing callback for node 69db00720a04df09a44ea848: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:17:34,877 - lava_callback - INFO - Received callback for node 69dda388c2164e674d72103f INFO: 172.20.0.1:44956 - "POST /node/69dda388c2164e674d72103f HTTP/1.0" 202 Accepted 2026-04-14 02:17:34,884 - lava_callback - INFO - Starting async job submit for node 69dda388c2164e674d72103f 2026-04-14 02:17:34,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:17:34,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda388c2164e674d72103f HTTP/1.1" 200 None 2026-04-14 02:17:34,962 - lava_callback - DEBUG - Processing node 69dda388c2164e674d72103f: baseline-arm64 2026-04-14 02:17:35,090 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:17:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:17:35,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:17:35,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda388c2164e674d72103f/lava-logs.yaml 2026-04-14 02:17:35,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:17:35,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:17:35,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda388c2164e674d72103f/lava_callback.json.gz 2026-04-14 02:17:35,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:17:35,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda388c2164e674d72103f HTTP/1.1" 200 None 2026-04-14 02:17:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:17:35,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:17:35,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:17:35,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda388c2164e674d72103f HTTP/1.1" 200 None 2026-04-14 02:17:35,846 - lava_callback - INFO - Completed processing callback for node 69dda388c2164e674d72103f INFO: 172.20.0.1:44960 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:17:36,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:17:36,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:18:48,966 - lava_callback - INFO - Received callback for node 69dda3d0c2164e674d721091 INFO: 172.20.0.1:59428 - "POST /node/69dda3d0c2164e674d721091 HTTP/1.0" 202 Accepted 2026-04-14 02:18:48,973 - lava_callback - INFO - Starting async job submit for node 69dda3d0c2164e674d721091 2026-04-14 02:18:49,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda3d0c2164e674d721091 HTTP/1.1" 200 None 2026-04-14 02:18:49,019 - lava_callback - DEBUG - Processing node 69dda3d0c2164e674d721091: baseline-arm64 2026-04-14 02:18:49,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:18:49,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:18:49,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda3d0c2164e674d721091/log.txt.gz 2026-04-14 02:18:49,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:18:49,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:18:49,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda3d0c2164e674d721091/lava-logs.yaml 2026-04-14 02:18:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:18:49,856 - lava_callback - INFO - Received callback for node 69db01010a04df09a44ea8dc INFO: 172.20.0.1:41916 - "POST /node/69db01010a04df09a44ea8dc HTTP/1.0" 202 Accepted 2026-04-14 02:18:49,862 - lava_callback - INFO - Starting async job submit for node 69db01010a04df09a44ea8dc 2026-04-14 02:18:49,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:18:49,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda3d0c2164e674d721091/lava_callback.json.gz 2026-04-14 02:18:49,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01010a04df09a44ea8dc HTTP/1.1" 200 None 2026-04-14 02:18:49,909 - lava_callback - DEBUG - Processing node 69db01010a04df09a44ea8dc: baseline-arm64-clabbe 2026-04-14 02:18:49,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db01010a04df09a44ea8dc 2026-04-14 02:18:49,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda3d0c2164e674d721091 HTTP/1.1" 200 None 2026-04-14 02:18:49,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01010a04df09a44ea8dc HTTP/1.1" 200 None 2026-04-14 02:18:49,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:18:49,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:18:49,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:18:49,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda3d0c2164e674d721091 HTTP/1.1" 200 None 2026-04-14 02:18:50,056 - lava_callback - INFO - Completed processing callback for node 69dda3d0c2164e674d721091 2026-04-14 02:18:50,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db01010a04df09a44ea8dc HTTP/1.1" 200 None 2026-04-14 02:18:50,060 - lava_callback - ERROR - Error processing callback for node 69db01010a04df09a44ea8dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:19:06,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:19:06,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:19:49,901 - lava_callback - INFO - Received callback for node 69db01420a04df09a44ea92f INFO: 172.20.0.1:57878 - "POST /node/69db01420a04df09a44ea92f HTTP/1.0" 202 Accepted 2026-04-14 02:19:49,908 - lava_callback - INFO - Starting async job submit for node 69db01420a04df09a44ea92f 2026-04-14 02:19:49,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:19:49,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01420a04df09a44ea92f HTTP/1.1" 200 None 2026-04-14 02:19:49,927 - lava_callback - DEBUG - Processing node 69db01420a04df09a44ea92f: baseline-arm64-clabbe 2026-04-14 02:19:49,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db01420a04df09a44ea92f 2026-04-14 02:19:49,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:19:49,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01420a04df09a44ea92f HTTP/1.1" 200 None 2026-04-14 02:19:49,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:19:49,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:19:49,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:19:49,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db01420a04df09a44ea92f HTTP/1.1" 200 None 2026-04-14 02:19:49,980 - lava_callback - ERROR - Error processing callback for node 69db01420a04df09a44ea92f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37132 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:21:09,960 - lava_callback - INFO - Received callback for node 69db018d0a04df09a44ea974 INFO: 172.20.0.1:41422 - "POST /node/69db018d0a04df09a44ea974 HTTP/1.0" 202 Accepted 2026-04-14 02:21:09,965 - lava_callback - INFO - Starting async job submit for node 69db018d0a04df09a44ea974 2026-04-14 02:21:09,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:21:09,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db018d0a04df09a44ea974 HTTP/1.1" 200 None 2026-04-14 02:21:09,981 - lava_callback - DEBUG - Processing node 69db018d0a04df09a44ea974: baseline-arm64-clabbe 2026-04-14 02:21:09,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db018d0a04df09a44ea974 2026-04-14 02:21:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:21:10,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db018d0a04df09a44ea974 HTTP/1.1" 200 None 2026-04-14 02:21:10,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:21:10,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:21:10,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:21:10,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db018d0a04df09a44ea974 HTTP/1.1" 200 None 2026-04-14 02:21:10,040 - lava_callback - ERROR - Error processing callback for node 69db018d0a04df09a44ea974: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47828 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:22:29,984 - lava_callback - INFO - Received callback for node 69db01d70a04df09a44ea9a6 INFO: 172.20.0.1:48432 - "POST /node/69db01d70a04df09a44ea9a6 HTTP/1.0" 202 Accepted 2026-04-14 02:22:29,989 - lava_callback - INFO - Starting async job submit for node 69db01d70a04df09a44ea9a6 2026-04-14 02:22:29,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:22:30,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01d70a04df09a44ea9a6 HTTP/1.1" 200 None 2026-04-14 02:22:30,006 - lava_callback - DEBUG - Processing node 69db01d70a04df09a44ea9a6: baseline-arm64-clabbe 2026-04-14 02:22:30,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db01d70a04df09a44ea9a6 2026-04-14 02:22:30,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:22:30,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db01d70a04df09a44ea9a6 HTTP/1.1" 200 None 2026-04-14 02:22:30,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:22:30,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:22:30,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:22:30,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db01d70a04df09a44ea9a6 HTTP/1.1" 200 None 2026-04-14 02:22:30,063 - lava_callback - ERROR - Error processing callback for node 69db01d70a04df09a44ea9a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52436 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:24:44,335 - lava_callback - INFO - Received callback for node 69dda558c2164e674d721261 INFO: 172.20.0.1:37078 - "POST /node/69dda558c2164e674d721261 HTTP/1.0" 202 Accepted 2026-04-14 02:24:44,341 - lava_callback - INFO - Starting async job submit for node 69dda558c2164e674d721261 2026-04-14 02:24:44,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:24:44,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda558c2164e674d721261 HTTP/1.1" 200 None 2026-04-14 02:24:44,359 - lava_callback - DEBUG - Processing node 69dda558c2164e674d721261: baseline-arm 2026-04-14 02:24:44,364 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:24:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:24:44,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:24:44,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dda558c2164e674d721261/lava-logs.yaml 2026-04-14 02:24:44,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:24:44,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:24:44,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dda558c2164e674d721261/lava_callback.json.gz 2026-04-14 02:24:44,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:24:44,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda558c2164e674d721261 HTTP/1.1" 200 None 2026-04-14 02:24:44,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:24:44,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 02:24:44,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:24:44,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda558c2164e674d721261 HTTP/1.1" 200 None 2026-04-14 02:24:44,732 - lava_callback - INFO - Completed processing callback for node 69dda558c2164e674d721261 INFO: 172.20.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42452 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:25:06,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:25:06,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:25:50,097 - lava_callback - INFO - Received callback for node 69db02a60a04df09a44eaa71 INFO: 172.20.0.1:57924 - "POST /node/69db02a60a04df09a44eaa71 HTTP/1.0" 202 Accepted 2026-04-14 02:25:50,103 - lava_callback - INFO - Starting async job submit for node 69db02a60a04df09a44eaa71 2026-04-14 02:25:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:25:50,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db02a60a04df09a44eaa71 HTTP/1.1" 200 None 2026-04-14 02:25:50,121 - lava_callback - DEBUG - Processing node 69db02a60a04df09a44eaa71: baseline-arm64-clabbe 2026-04-14 02:25:50,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db02a60a04df09a44eaa71 2026-04-14 02:25:50,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:25:50,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db02a60a04df09a44eaa71 HTTP/1.1" 200 None 2026-04-14 02:25:50,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:25:50,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:25:50,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:25:50,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db02a60a04df09a44eaa71 HTTP/1.1" 200 None 2026-04-14 02:25:50,176 - lava_callback - ERROR - Error processing callback for node 69db02a60a04df09a44eaa71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37902 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:27:10,175 - lava_callback - INFO - Received callback for node 69db02ed0a04df09a44eaac3 INFO: 172.20.0.1:42664 - "POST /node/69db02ed0a04df09a44eaac3 HTTP/1.0" 202 Accepted 2026-04-14 02:27:10,180 - lava_callback - INFO - Starting async job submit for node 69db02ed0a04df09a44eaac3 2026-04-14 02:27:10,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:27:10,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db02ed0a04df09a44eaac3 HTTP/1.1" 200 None 2026-04-14 02:27:10,196 - lava_callback - DEBUG - Processing node 69db02ed0a04df09a44eaac3: baseline-arm64-clabbe 2026-04-14 02:27:10,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db02ed0a04df09a44eaac3 2026-04-14 02:27:10,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:27:10,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db02ed0a04df09a44eaac3 HTTP/1.1" 200 None 2026-04-14 02:27:10,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:27:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:27:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:27:10,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db02ed0a04df09a44eaac3 HTTP/1.1" 200 None 2026-04-14 02:27:10,244 - lava_callback - ERROR - Error processing callback for node 69db02ed0a04df09a44eaac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37950 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:29:30,278 - lava_callback - INFO - Received callback for node 69db037b0a04df09a44eab28 INFO: 172.20.0.1:40110 - "POST /node/69db037b0a04df09a44eab28 HTTP/1.0" 202 Accepted 2026-04-14 02:29:30,284 - lava_callback - INFO - Starting async job submit for node 69db037b0a04df09a44eab28 2026-04-14 02:29:30,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:29:30,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db037b0a04df09a44eab28 HTTP/1.1" 200 None 2026-04-14 02:29:30,299 - lava_callback - DEBUG - Processing node 69db037b0a04df09a44eab28: baseline-arm64-clabbe 2026-04-14 02:29:30,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db037b0a04df09a44eab28 2026-04-14 02:29:30,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:29:30,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db037b0a04df09a44eab28 HTTP/1.1" 200 None 2026-04-14 02:29:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:29:30,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 02:29:30,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:29:30,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db037b0a04df09a44eab28 HTTP/1.1" 200 None 2026-04-14 02:29:30,351 - lava_callback - ERROR - Error processing callback for node 69db037b0a04df09a44eab28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59540 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:30:17,674 - lava_callback - INFO - Received callback for node 69dda581c2164e674d72127a INFO: 172.20.0.1:59550 - "POST /node/69dda581c2164e674d72127a HTTP/1.0" 202 Accepted 2026-04-14 02:30:17,681 - lava_callback - INFO - Starting async job submit for node 69dda581c2164e674d72127a 2026-04-14 02:30:17,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:17,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda581c2164e674d72127a HTTP/1.1" 200 None 2026-04-14 02:30:17,731 - lava_callback - DEBUG - Processing node 69dda581c2164e674d72127a: baseline-arm64 2026-04-14 02:30:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:30:18,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:30:18,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda581c2164e674d72127a/log.txt.gz 2026-04-14 02:30:18,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:30:18,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:30:18,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda581c2164e674d72127a/lava-logs.yaml 2026-04-14 02:30:18,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:30:18,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:30:18,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda581c2164e674d72127a/lava_callback.json.gz DEBUG: Setup failed for 69dda581c2164e674d72127a. Transitting job node result: incomplete -> fail 2026-04-14 02:30:18,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:18,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda581c2164e674d72127a HTTP/1.1" 200 None 2026-04-14 02:30:18,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:19,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:30:19,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:19,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda581c2164e674d72127a HTTP/1.1" 200 None 2026-04-14 02:30:19,109 - lava_callback - INFO - Completed processing callback for node 69dda581c2164e674d72127a INFO: 172.20.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:30:36,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:36,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 02:30:41,800 - lava_callback - INFO - Received callback for node 69db03be0a04df09a44eab6f INFO: 172.20.0.1:38858 - "POST /node/69db03be0a04df09a44eab6f HTTP/1.0" 202 Accepted 2026-04-14 02:30:41,805 - lava_callback - INFO - Starting async job submit for node 69db03be0a04df09a44eab6f 2026-04-14 02:30:41,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:41,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db03be0a04df09a44eab6f HTTP/1.1" 200 None 2026-04-14 02:30:41,821 - lava_callback - DEBUG - Processing node 69db03be0a04df09a44eab6f: baseline-arm64-baylibre 2026-04-14 02:30:41,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db03be0a04df09a44eab6f 2026-04-14 02:30:41,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db03be0a04df09a44eab6f HTTP/1.1" 200 None 2026-04-14 02:30:41,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:41,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:30:41,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:30:41,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db03be0a04df09a44eab6f HTTP/1.1" 200 None 2026-04-14 02:30:41,870 - lava_callback - ERROR - Error processing callback for node 69db03be0a04df09a44eab6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43662 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:33:01,741 - lava_callback - INFO - Received callback for node 69db044e0a04df09a44eabca INFO: 172.20.0.1:49326 - "POST /node/69db044e0a04df09a44eabca HTTP/1.0" 202 Accepted 2026-04-14 02:33:01,747 - lava_callback - INFO - Starting async job submit for node 69db044e0a04df09a44eabca 2026-04-14 02:33:01,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:33:01,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db044e0a04df09a44eabca HTTP/1.1" 200 None 2026-04-14 02:33:01,763 - lava_callback - DEBUG - Processing node 69db044e0a04df09a44eabca: baseline-arm64-baylibre 2026-04-14 02:33:01,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db044e0a04df09a44eabca 2026-04-14 02:33:01,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:33:01,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db044e0a04df09a44eabca HTTP/1.1" 200 None 2026-04-14 02:33:01,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:33:01,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:33:01,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:33:01,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db044e0a04df09a44eabca HTTP/1.1" 200 None 2026-04-14 02:33:01,827 - lava_callback - ERROR - Error processing callback for node 69db044e0a04df09a44eabca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:34:01,752 - lava_callback - INFO - Received callback for node 69db04960a04df09a44eac04 INFO: 172.20.0.1:35904 - "POST /node/69db04960a04df09a44eac04 HTTP/1.0" 202 Accepted 2026-04-14 02:34:01,758 - lava_callback - INFO - Starting async job submit for node 69db04960a04df09a44eac04 2026-04-14 02:34:01,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:34:01,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db04960a04df09a44eac04 HTTP/1.1" 200 None 2026-04-14 02:34:01,773 - lava_callback - DEBUG - Processing node 69db04960a04df09a44eac04: baseline-arm64-baylibre 2026-04-14 02:34:01,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db04960a04df09a44eac04 2026-04-14 02:34:01,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:34:01,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db04960a04df09a44eac04 HTTP/1.1" 200 None 2026-04-14 02:34:01,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:34:01,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:34:01,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:34:01,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db04960a04df09a44eac04 HTTP/1.1" 200 None 2026-04-14 02:34:01,826 - lava_callback - ERROR - Error processing callback for node 69db04960a04df09a44eac04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:36:30,600 - lava_callback - INFO - Received callback for node 69db05250a04df09a44eac92 INFO: 172.20.0.1:54452 - "POST /node/69db05250a04df09a44eac92 HTTP/1.0" 202 Accepted 2026-04-14 02:36:30,606 - lava_callback - INFO - Starting async job submit for node 69db05250a04df09a44eac92 2026-04-14 02:36:30,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05250a04df09a44eac92 HTTP/1.1" 200 None 2026-04-14 02:36:30,621 - lava_callback - DEBUG - Processing node 69db05250a04df09a44eac92: baseline-arm64-clabbe 2026-04-14 02:36:30,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db05250a04df09a44eac92 2026-04-14 02:36:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:30,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05250a04df09a44eac92 HTTP/1.1" 200 None 2026-04-14 02:36:30,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:30,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:36:30,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:30,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db05250a04df09a44eac92 HTTP/1.1" 200 None 2026-04-14 02:36:30,672 - lava_callback - ERROR - Error processing callback for node 69db05250a04df09a44eac92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:36:38,969 - lava_callback - INFO - Received callback for node 69dda826c2164e674d7214f2 INFO: 172.20.0.1:54466 - "POST /node/69dda826c2164e674d7214f2 HTTP/1.0" 202 Accepted 2026-04-14 02:36:38,978 - lava_callback - INFO - Starting async job submit for node 69dda826c2164e674d7214f2 2026-04-14 02:36:38,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:39,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda826c2164e674d7214f2 HTTP/1.1" 200 None 2026-04-14 02:36:39,001 - lava_callback - DEBUG - Processing node 69dda826c2164e674d7214f2: baseline-nfs-arm64 2026-04-14 02:36:39,003 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:36:39,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:36:39,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:36:39,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda826c2164e674d7214f2/lava-logs.yaml 2026-04-14 02:36:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:36:39,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:36:39,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda826c2164e674d7214f2/lava_callback.json.gz 2026-04-14 02:36:39,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:39,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda826c2164e674d7214f2 HTTP/1.1" 200 None 2026-04-14 02:36:39,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:39,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:36:39,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:36:39,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda826c2164e674d7214f2 HTTP/1.1" 200 None 2026-04-14 02:36:39,354 - lava_callback - INFO - Completed processing callback for node 69dda826c2164e674d7214f2 INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45290 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:37:06,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:37:06,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56544 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:38:50,747 - lava_callback - INFO - Received callback for node 69db05ad0a04df09a44ead1d INFO: 172.20.0.1:48632 - "POST /node/69db05ad0a04df09a44ead1d HTTP/1.0" 202 Accepted 2026-04-14 02:38:50,756 - lava_callback - INFO - Starting async job submit for node 69db05ad0a04df09a44ead1d 2026-04-14 02:38:50,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:38:50,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05ad0a04df09a44ead1d HTTP/1.1" 200 None 2026-04-14 02:38:50,773 - lava_callback - DEBUG - Processing node 69db05ad0a04df09a44ead1d: baseline-arm64-clabbe 2026-04-14 02:38:50,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db05ad0a04df09a44ead1d 2026-04-14 02:38:50,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:38:50,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05ad0a04df09a44ead1d HTTP/1.1" 200 None 2026-04-14 02:38:50,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:38:50,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:38:50,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:38:50,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db05ad0a04df09a44ead1d HTTP/1.1" 200 None 2026-04-14 02:38:50,836 - lava_callback - ERROR - Error processing callback for node 69db05ad0a04df09a44ead1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47674 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:40:10,722 - lava_callback - INFO - Received callback for node 69db05f70a04df09a44ead4a INFO: 172.20.0.1:47118 - "POST /node/69db05f70a04df09a44ead4a HTTP/1.0" 202 Accepted 2026-04-14 02:40:10,728 - lava_callback - INFO - Starting async job submit for node 69db05f70a04df09a44ead4a 2026-04-14 02:40:10,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:10,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05f70a04df09a44ead4a HTTP/1.1" 200 None 2026-04-14 02:40:10,750 - lava_callback - DEBUG - Processing node 69db05f70a04df09a44ead4a: baseline-arm64-clabbe 2026-04-14 02:40:10,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db05f70a04df09a44ead4a 2026-04-14 02:40:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:10,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db05f70a04df09a44ead4a HTTP/1.1" 200 None 2026-04-14 02:40:10,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:10,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:40:10,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:10,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db05f70a04df09a44ead4a HTTP/1.1" 200 None 2026-04-14 02:40:10,843 - lava_callback - ERROR - Error processing callback for node 69db05f70a04df09a44ead4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39832 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:40:57,611 - lava_callback - INFO - Received callback for node 69dda503c2164e674d7211c6 INFO: 172.20.0.1:39848 - "POST /node/69dda503c2164e674d7211c6 HTTP/1.0" 202 Accepted 2026-04-14 02:40:57,618 - lava_callback - INFO - Starting async job submit for node 69dda503c2164e674d7211c6 2026-04-14 02:40:57,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:57,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda503c2164e674d7211c6 HTTP/1.1" 200 None 2026-04-14 02:40:57,688 - lava_callback - DEBUG - Processing node 69dda503c2164e674d7211c6: baseline-arm 2026-04-14 02:40:58,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:40:58,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:40:58,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69dda503c2164e674d7211c6/log.txt.gz 2026-04-14 02:40:58,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:40:59,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:40:59,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69dda503c2164e674d7211c6/lava-logs.yaml 2026-04-14 02:40:59,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:40:59,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:40:59,202 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69dda503c2164e674d7211c6/lava_callback.json.gz DEBUG: Setup failed for 69dda503c2164e674d7211c6. Transitting job node result: incomplete -> fail 2026-04-14 02:40:59,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:59,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda503c2164e674d7211c6 HTTP/1.1" 200 None 2026-04-14 02:40:59,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:59,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 02:40:59,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:40:59,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda503c2164e674d7211c6 HTTP/1.1" 200 None 2026-04-14 02:40:59,490 - lava_callback - INFO - Completed processing callback for node 69dda503c2164e674d7211c6 INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:41:06,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:41:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50356 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:42:10,801 - lava_callback - INFO - Received callback for node 69db067e0a04df09a44eaddf INFO: 172.20.0.1:33216 - "POST /node/69db067e0a04df09a44eaddf HTTP/1.0" 202 Accepted 2026-04-14 02:42:10,808 - lava_callback - INFO - Starting async job submit for node 69db067e0a04df09a44eaddf 2026-04-14 02:42:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:42:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db067e0a04df09a44eaddf HTTP/1.1" 200 None 2026-04-14 02:42:10,824 - lava_callback - DEBUG - Processing node 69db067e0a04df09a44eaddf: baseline-arm64-clabbe 2026-04-14 02:42:10,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db067e0a04df09a44eaddf 2026-04-14 02:42:10,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:42:10,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db067e0a04df09a44eaddf HTTP/1.1" 200 None 2026-04-14 02:42:10,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:42:10,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:42:10,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:42:10,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db067e0a04df09a44eaddf HTTP/1.1" 200 None 2026-04-14 02:42:10,876 - lava_callback - ERROR - Error processing callback for node 69db067e0a04df09a44eaddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35410 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:43:30,903 - lava_callback - INFO - Received callback for node 69db06c70a04df09a44eae09 INFO: 172.20.0.1:45404 - "POST /node/69db06c70a04df09a44eae09 HTTP/1.0" 202 Accepted 2026-04-14 02:43:30,909 - lava_callback - INFO - Starting async job submit for node 69db06c70a04df09a44eae09 2026-04-14 02:43:30,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:30,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db06c70a04df09a44eae09 HTTP/1.1" 200 None 2026-04-14 02:43:30,926 - lava_callback - DEBUG - Processing node 69db06c70a04df09a44eae09: baseline-arm64-clabbe 2026-04-14 02:43:30,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db06c70a04df09a44eae09 2026-04-14 02:43:30,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:30,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db06c70a04df09a44eae09 HTTP/1.1" 200 None 2026-04-14 02:43:30,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:30,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:43:30,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:30,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db06c70a04df09a44eae09 HTTP/1.1" 200 None 2026-04-14 02:43:30,988 - lava_callback - ERROR - Error processing callback for node 69db06c70a04df09a44eae09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 02:43:34,526 - lava_callback - INFO - Received callback for node 69dda9a9c2164e674d721648 INFO: 172.20.0.1:45414 - "POST /node/69dda9a9c2164e674d721648 HTTP/1.0" 202 Accepted 2026-04-14 02:43:34,532 - lava_callback - INFO - Starting async job submit for node 69dda9a9c2164e674d721648 2026-04-14 02:43:34,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:34,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda9a9c2164e674d721648 HTTP/1.1" 200 None 2026-04-14 02:43:34,578 - lava_callback - DEBUG - Processing node 69dda9a9c2164e674d721648: baseline-arm64 2026-04-14 02:43:34,744 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:43:34,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:43:34,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:43:34,996 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda9a9c2164e674d721648/lava-logs.yaml 2026-04-14 02:43:35,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:43:35,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:43:35,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda9a9c2164e674d721648/lava_callback.json.gz 2026-04-14 02:43:35,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda9a9c2164e674d721648 HTTP/1.1" 200 None 2026-04-14 02:43:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:35,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:43:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:35,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda9a9c2164e674d721648 HTTP/1.1" 200 None 2026-04-14 02:43:35,330 - lava_callback - INFO - Completed processing callback for node 69dda9a9c2164e674d721648 INFO: 172.20.0.1:45420 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:43:36,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:43:36,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:44:50,934 - lava_callback - INFO - Received callback for node 69db070d0a04df09a44eae55 INFO: 172.20.0.1:50734 - "POST /node/69db070d0a04df09a44eae55 HTTP/1.0" 202 Accepted 2026-04-14 02:44:50,940 - lava_callback - INFO - Starting async job submit for node 69db070d0a04df09a44eae55 2026-04-14 02:44:50,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:44:50,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db070d0a04df09a44eae55 HTTP/1.1" 200 None 2026-04-14 02:44:50,956 - lava_callback - DEBUG - Processing node 69db070d0a04df09a44eae55: baseline-arm64-clabbe 2026-04-14 02:44:50,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db070d0a04df09a44eae55 2026-04-14 02:44:50,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:44:50,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db070d0a04df09a44eae55 HTTP/1.1" 200 None 2026-04-14 02:44:50,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:44:50,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:44:50,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:44:51,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db070d0a04df09a44eae55 HTTP/1.1" 200 None 2026-04-14 02:44:51,019 - lava_callback - ERROR - Error processing callback for node 69db070d0a04df09a44eae55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33650 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:45:21,254 - lava_callback - INFO - Received callback for node 69dda9f4c2164e674d72168c INFO: 172.20.0.1:56858 - "POST /node/69dda9f4c2164e674d72168c HTTP/1.0" 202 Accepted 2026-04-14 02:45:21,261 - lava_callback - INFO - Starting async job submit for node 69dda9f4c2164e674d72168c 2026-04-14 02:45:21,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:21,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda9f4c2164e674d72168c HTTP/1.1" 200 None 2026-04-14 02:45:21,307 - lava_callback - DEBUG - Processing node 69dda9f4c2164e674d72168c: baseline-arm64 2026-04-14 02:45:21,583 - lava_callback - WARNING - Failed to upload log 2026-04-14 02:45:21,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:45:21,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:45:21,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda9f4c2164e674d72168c/lava-logs.yaml 2026-04-14 02:45:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:45:22,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:45:22,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dda9f4c2164e674d72168c/lava_callback.json.gz 2026-04-14 02:45:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:22,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda9f4c2164e674d72168c HTTP/1.1" 200 None 2026-04-14 02:45:22,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:22,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:45:22,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda9f4c2164e674d72168c HTTP/1.1" 200 None 2026-04-14 02:45:22,235 - lava_callback - INFO - Completed processing callback for node 69dda9f4c2164e674d72168c INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43826 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:45:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:37,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:45:50,931 - lava_callback - INFO - Received callback for node 69db074b0a04df09a44eaeb7 INFO: 172.20.0.1:50190 - "POST /node/69db074b0a04df09a44eaeb7 HTTP/1.0" 202 Accepted 2026-04-14 02:45:50,937 - lava_callback - INFO - Starting async job submit for node 69db074b0a04df09a44eaeb7 2026-04-14 02:45:50,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:50,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db074b0a04df09a44eaeb7 HTTP/1.1" 200 None 2026-04-14 02:45:50,953 - lava_callback - DEBUG - Processing node 69db074b0a04df09a44eaeb7: baseline-arm64-clabbe 2026-04-14 02:45:50,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db074b0a04df09a44eaeb7 2026-04-14 02:45:50,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:50,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db074b0a04df09a44eaeb7 HTTP/1.1" 200 None 2026-04-14 02:45:50,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:51,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-14 02:45:51,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:45:51,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db074b0a04df09a44eaeb7 HTTP/1.1" 200 None 2026-04-14 02:45:51,028 - lava_callback - ERROR - Error processing callback for node 69db074b0a04df09a44eaeb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:46:16,611 - lava_callback - INFO - Received callback for node 69dda652c2164e674d721331 INFO: 172.20.0.1:34564 - "POST /node/69dda652c2164e674d721331 HTTP/1.0" 202 Accepted 2026-04-14 02:46:16,618 - lava_callback - INFO - Starting async job submit for node 69dda652c2164e674d721331 2026-04-14 02:46:16,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:46:16,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda652c2164e674d721331 HTTP/1.1" 200 None 2026-04-14 02:46:16,699 - lava_callback - DEBUG - Processing node 69dda652c2164e674d721331: ltp-smoke 2026-04-14 02:46:17,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:46:17,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:46:17,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69dda652c2164e674d721331/log.txt.gz 2026-04-14 02:46:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:46:17,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:46:17,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69dda652c2164e674d721331/lava-logs.yaml 2026-04-14 02:46:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:46:17,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:46:17,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69dda652c2164e674d721331/lava_callback.json.gz 2026-04-14 02:46:18,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:46:18,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda652c2164e674d721331 HTTP/1.1" 200 None 2026-04-14 02:46:18,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:46:18,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87a6c2164e674d71ee3e HTTP/1.1" 200 None 2026-04-14 02:46:18,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:46:18,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda652c2164e674d721331 HTTP/1.1" 200 None 2026-04-14 02:46:18,282 - lava_callback - INFO - Completed processing callback for node 69dda652c2164e674d721331 INFO: 172.20.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52706 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:46:37,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:46:37,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51656 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:48:23,460 - lava_callback - INFO - Received callback for node 69ddaad6c2164e674d7217ac INFO: 172.20.0.1:57396 - "POST /node/69ddaad6c2164e674d7217ac HTTP/1.0" 202 Accepted 2026-04-14 02:48:23,466 - lava_callback - INFO - Starting async job submit for node 69ddaad6c2164e674d7217ac 2026-04-14 02:48:23,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:23,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad6c2164e674d7217ac HTTP/1.1" 200 None 2026-04-14 02:48:23,507 - lava_callback - DEBUG - Processing node 69ddaad6c2164e674d7217ac: baseline-x86 2026-04-14 02:48:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:23,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:23,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad6c2164e674d7217ac/log.txt.gz 2026-04-14 02:48:23,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:24,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:24,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad6c2164e674d7217ac/lava-logs.yaml 2026-04-14 02:48:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:24,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:24,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad6c2164e674d7217ac/lava_callback.json.gz 2026-04-14 02:48:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:24,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad6c2164e674d7217ac HTTP/1.1" 200 None 2026-04-14 02:48:24,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:24,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-14 02:48:24,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:24,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaad6c2164e674d7217ac HTTP/1.1" 200 None 2026-04-14 02:48:24,410 - lava_callback - INFO - Completed processing callback for node 69ddaad6c2164e674d7217ac INFO: 172.20.0.1:57404 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:48:34,992 - lava_callback - INFO - Received callback for node 69ddaad8c2164e674d7217b5 INFO: 172.20.0.1:41686 - "POST /node/69ddaad8c2164e674d7217b5 HTTP/1.0" 202 Accepted 2026-04-14 02:48:34,998 - lava_callback - INFO - Starting async job submit for node 69ddaad8c2164e674d7217b5 2026-04-14 02:48:35,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:35,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad8c2164e674d7217b5 HTTP/1.1" 200 None 2026-04-14 02:48:35,039 - lava_callback - DEBUG - Processing node 69ddaad8c2164e674d7217b5: baseline-x86 2026-04-14 02:48:35,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:35,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:35,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b5/log.txt.gz 2026-04-14 02:48:35,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:35,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:35,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b5/lava-logs.yaml 2026-04-14 02:48:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:48:35,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:48:35,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b5/lava_callback.json.gz 2026-04-14 02:48:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:35,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad8c2164e674d7217b5 HTTP/1.1" 200 None 2026-04-14 02:48:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:35,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-14 02:48:35,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:35,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaad8c2164e674d7217b5 HTTP/1.1" 200 None 2026-04-14 02:48:35,832 - lava_callback - INFO - Completed processing callback for node 69ddaad8c2164e674d7217b5 INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:48:37,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:48:37,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET /node/69862acf177ca0f097bd21b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET /node/69279c994e6fb3232e2721ea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET /node/69888093e408e9ea60fb018c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45534 - "GET /node/695afde7872d7868c4cc05b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47358 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:53:55,942 - lava_callback - INFO - Received callback for node 69dda8d1c2164e674d721580 INFO: 172.20.0.1:42782 - "POST /node/69dda8d1c2164e674d721580 HTTP/1.0" 202 Accepted 2026-04-14 02:53:55,948 - lava_callback - INFO - Starting async job submit for node 69dda8d1c2164e674d721580 2026-04-14 02:53:55,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:53:55,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda8d1c2164e674d721580 HTTP/1.1" 200 None 2026-04-14 02:53:55,995 - lava_callback - DEBUG - Processing node 69dda8d1c2164e674d721580: baseline-arm64-broonie 2026-04-14 02:53:56,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:53:56,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:53:56,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dda8d1c2164e674d721580/log.txt.gz INFO: 172.20.0.1:42786 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:53:56,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:53:56,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:53:56,816 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dda8d1c2164e674d721580/lava-logs.yaml 2026-04-14 02:53:56,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:53:56,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:53:56,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dda8d1c2164e674d721580/lava_callback.json.gz 2026-04-14 02:53:57,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:53:57,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda8d1c2164e674d721580 HTTP/1.1" 200 None 2026-04-14 02:53:57,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:53:57,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 02:53:57,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:53:57,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda8d1c2164e674d721580 HTTP/1.1" 200 None 2026-04-14 02:53:57,056 - lava_callback - INFO - Completed processing callback for node 69dda8d1c2164e674d721580 INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:54:07,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:54:07,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55184 - "GET /node/6910c669699dbc4cda8e2112%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 02:55:06,154 - lava_callback - INFO - Received callback for node 69ddaad7c2164e674d7217af INFO: 172.20.0.1:55200 - "POST /node/69ddaad7c2164e674d7217af HTTP/1.0" 202 Accepted 2026-04-14 02:55:06,160 - lava_callback - INFO - Starting async job submit for node 69ddaad7c2164e674d7217af 2026-04-14 02:55:06,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:55:06,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad7c2164e674d7217af HTTP/1.1" 200 None 2026-04-14 02:55:06,204 - lava_callback - DEBUG - Processing node 69ddaad7c2164e674d7217af: baseline-x86 2026-04-14 02:55:06,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55214 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:55:06,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:55:06,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad7c2164e674d7217af/log.txt.gz 2026-04-14 02:55:06,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:55:07,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:55:07,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad7c2164e674d7217af/lava-logs.yaml 2026-04-14 02:55:07,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 02:55:07,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 02:55:07,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad7c2164e674d7217af/lava_callback.json.gz 2026-04-14 02:55:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:55:07,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad7c2164e674d7217af HTTP/1.1" 200 None 2026-04-14 02:55:07,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:55:07,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-14 02:55:07,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:55:07,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaad7c2164e674d7217af HTTP/1.1" 200 None 2026-04-14 02:55:07,367 - lava_callback - INFO - Completed processing callback for node 69ddaad7c2164e674d7217af INFO: 172.20.0.1:44748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK 2026-04-14 02:55:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 02:55:37,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46828 - "GET /node/69cf95df000c489abc2c1757%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46834 - "GET /node/694879519214b4938716933b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET /node/6991171485f550420785e86d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:02:19,899 - lava_callback - INFO - Received callback for node 69ddac6ac2164e674d721952 INFO: 172.20.0.1:35506 - "POST /node/69ddac6ac2164e674d721952 HTTP/1.0" 202 Accepted 2026-04-14 03:02:19,912 - lava_callback - INFO - Starting async job submit for node 69ddac6ac2164e674d721952 2026-04-14 03:02:19,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:02:19,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac6ac2164e674d721952 HTTP/1.1" 200 None 2026-04-14 03:02:19,963 - lava_callback - DEBUG - Processing node 69ddac6ac2164e674d721952: baseline-arm64 2026-04-14 03:02:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:02:20,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:02:20,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ddac6ac2164e674d721952/log.txt.gz 2026-04-14 03:02:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:02:21,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:02:21,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ddac6ac2164e674d721952/lava-logs.yaml 2026-04-14 03:02:21,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:02:21,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:02:21,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ddac6ac2164e674d721952/lava_callback.json.gz DEBUG: Setup failed for 69ddac6ac2164e674d721952. Transitting job node result: incomplete -> fail 2026-04-14 03:02:21,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:02:21,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac6ac2164e674d721952 HTTP/1.1" 200 None 2026-04-14 03:02:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:02:21,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 03:02:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:02:21,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddac6ac2164e674d721952 HTTP/1.1" 200 None 2026-04-14 03:02:21,459 - lava_callback - INFO - Completed processing callback for node 69ddac6ac2164e674d721952 INFO: 172.20.0.1:35510 - "GET /node/69d0ce1e691bac272b3230cd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54438 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:02:37,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:02:37,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48774 - "GET /node/69562efa16d33f8361befc63%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET /node/698f833e3013abef95d01558%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37238 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:05:11,083 - lava_callback - INFO - Received callback for node 69ddaad8c2164e674d7217b2 INFO: 172.20.0.1:35684 - "POST /node/69ddaad8c2164e674d7217b2 HTTP/1.0" 202 Accepted 2026-04-14 03:05:11,090 - lava_callback - INFO - Starting async job submit for node 69ddaad8c2164e674d7217b2 2026-04-14 03:05:11,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:05:11,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad8c2164e674d7217b2 HTTP/1.1" 200 None 2026-04-14 03:05:11,147 - lava_callback - DEBUG - Processing node 69ddaad8c2164e674d7217b2: baseline-x86 2026-04-14 03:05:11,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:05:12,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:05:12,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b2/log.txt.gz 2026-04-14 03:05:12,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:05:12,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:05:12,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b2/lava-logs.yaml 2026-04-14 03:05:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:05:13,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:05:13,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaad8c2164e674d7217b2/lava_callback.json.gz DEBUG: Setup failed for 69ddaad8c2164e674d7217b2. Transitting job node result: incomplete -> fail 2026-04-14 03:05:13,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:05:13,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaad8c2164e674d7217b2 HTTP/1.1" 200 None 2026-04-14 03:05:13,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:05:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-14 03:05:13,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:05:13,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaad8c2164e674d7217b2 HTTP/1.1" 200 None 2026-04-14 03:05:13,505 - lava_callback - INFO - Completed processing callback for node 69ddaad8c2164e674d7217b2 INFO: 172.20.0.1:35690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:05:37,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:05:37,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:07:30,339 - lava_callback - INFO - Received callback for node 69ddaf2cc2164e674d7219f8 INFO: 172.20.0.1:39366 - "POST /node/69ddaf2cc2164e674d7219f8 HTTP/1.0" 202 Accepted 2026-04-14 03:07:30,345 - lava_callback - INFO - Starting async job submit for node 69ddaf2cc2164e674d7219f8 2026-04-14 03:07:30,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:07:30,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaf2cc2164e674d7219f8 HTTP/1.1" 200 None 2026-04-14 03:07:30,378 - lava_callback - DEBUG - Processing node 69ddaf2cc2164e674d7219f8: baseline-x86 2026-04-14 03:07:30,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:07:30,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:07:30,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaf2cc2164e674d7219f8/log.txt.gz 2026-04-14 03:07:30,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:07:31,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:07:31,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaf2cc2164e674d7219f8/lava-logs.yaml 2026-04-14 03:07:31,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:07:31,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:07:31,291 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ddaf2cc2164e674d7219f8/lava_callback.json.gz 2026-04-14 03:07:31,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:07:31,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaf2cc2164e674d7219f8 HTTP/1.1" 200 None 2026-04-14 03:07:31,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:07:31,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-14 03:07:31,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:07:31,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaf2cc2164e674d7219f8 HTTP/1.1" 200 None 2026-04-14 03:07:31,368 - lava_callback - INFO - Completed processing callback for node 69ddaf2cc2164e674d7219f8 INFO: 172.20.0.1:39380 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:07:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:07:37,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET /node/6988bc8e9fc35f969e1ecf17%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53358 - "GET /node/698bcd4f1e517752bab8ac7c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53366 - "GET /node/69c804cf123b47fd2376feff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET /node/67ff8033c0534c95c39deb24%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43272 - "GET /node/69d454ab8fbbb59103320038%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:12:03,275 - lava_callback - INFO - Received callback for node 69ddacafc2164e674d7219b2 INFO: 172.20.0.1:57942 - "POST /node/69ddacafc2164e674d7219b2 HTTP/1.0" 202 Accepted 2026-04-14 03:12:03,282 - lava_callback - INFO - Starting async job submit for node 69ddacafc2164e674d7219b2 2026-04-14 03:12:03,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:12:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddacafc2164e674d7219b2 HTTP/1.1" 200 None 2026-04-14 03:12:03,355 - lava_callback - DEBUG - Processing node 69ddacafc2164e674d7219b2: baseline-arm 2026-04-14 03:12:03,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:12:04,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:12:04,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ddacafc2164e674d7219b2/log.txt.gz 2026-04-14 03:12:04,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:12:04,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:12:04,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ddacafc2164e674d7219b2/lava-logs.yaml 2026-04-14 03:12:04,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:12:04,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:12:04,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ddacafc2164e674d7219b2/lava_callback.json.gz DEBUG: Setup failed for 69ddacafc2164e674d7219b2. Transitting job node result: incomplete -> fail 2026-04-14 03:12:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:12:04,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddacafc2164e674d7219b2 HTTP/1.1" 200 None 2026-04-14 03:12:04,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:12:04,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-14 03:12:04,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:12:05,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddacafc2164e674d7219b2 HTTP/1.1" 200 None 2026-04-14 03:12:05,143 - lava_callback - INFO - Completed processing callback for node 69ddacafc2164e674d7219b2 INFO: 172.20.0.1:57956 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:12:07,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:12:07,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47330 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:13:56,698 - lava_callback - INFO - Received callback for node 69ddacd1c2164e674d7219c6 INFO: 172.20.0.1:47336 - "POST /node/69ddacd1c2164e674d7219c6 HTTP/1.0" 202 Accepted 2026-04-14 03:13:56,705 - lava_callback - INFO - Starting async job submit for node 69ddacd1c2164e674d7219c6 2026-04-14 03:13:56,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:13:56,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddacd1c2164e674d7219c6 HTTP/1.1" 200 None 2026-04-14 03:13:56,778 - lava_callback - DEBUG - Processing node 69ddacd1c2164e674d7219c6: ltp-smoke 2026-04-14 03:13:57,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:13:57,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:13:57,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ddacd1c2164e674d7219c6/log.txt.gz 2026-04-14 03:13:57,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:13:57,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:13:57,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ddacd1c2164e674d7219c6/lava-logs.yaml 2026-04-14 03:13:57,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:13:57,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:13:57,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ddacd1c2164e674d7219c6/lava_callback.json.gz 2026-04-14 03:13:58,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:13:58,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddacd1c2164e674d7219c6 HTTP/1.1" 200 None 2026-04-14 03:13:58,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:13:58,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87a6c2164e674d71ee3e HTTP/1.1" 200 None 2026-04-14 03:13:58,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:13:58,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddacd1c2164e674d7219c6 HTTP/1.1" 200 None 2026-04-14 03:13:58,334 - lava_callback - INFO - Completed processing callback for node 69ddacd1c2164e674d7219c6 INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:14:07,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:14:07,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET /node/694021e7575bc060ce1535f0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54304 - "GET /node/69862570177ca0f097bd1f28%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43630 - "GET /node/69896a9885773790cd34ef67%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET /node/69a23a5590d011217c9f7f8d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56732 - "GET /node/69939aefcebe99dd8e07525c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56658 - "GET /node/695b38a78156fad0b1223cda%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50632 - "GET /node/69a166e1a41e9451dcf4172a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET /node/6991f81401ff1e8e0859d54c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:58:46,477 - lava_callback - INFO - Received callback for node 69dda0e7c2164e674d720d1b INFO: 172.20.0.1:40448 - "POST /node/69dda0e7c2164e674d720d1b HTTP/1.0" 202 Accepted 2026-04-14 03:58:46,485 - lava_callback - INFO - Starting async job submit for node 69dda0e7c2164e674d720d1b 2026-04-14 03:58:46,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:58:46,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda0e7c2164e674d720d1b HTTP/1.1" 200 None 2026-04-14 03:58:46,545 - lava_callback - DEBUG - Processing node 69dda0e7c2164e674d720d1b: baseline-nfs-arm64 INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:58:47,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:58:47,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:58:47,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda0e7c2164e674d720d1b/log.txt.gz 2026-04-14 03:58:48,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:58:48,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:58:48,763 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda0e7c2164e674d720d1b/lava-logs.yaml 2026-04-14 03:58:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 03:58:48,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 03:58:48,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dda0e7c2164e674d720d1b/lava_callback.json.gz DEBUG: Setup failed for 69dda0e7c2164e674d720d1b. Transitting job node result: incomplete -> fail 2026-04-14 03:58:49,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:58:49,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda0e7c2164e674d720d1b HTTP/1.1" 200 None 2026-04-14 03:58:49,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:58:49,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 03:58:49,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:58:49,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda0e7c2164e674d720d1b HTTP/1.1" 200 None 2026-04-14 03:58:49,221 - lava_callback - INFO - Completed processing callback for node 69dda0e7c2164e674d720d1b INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET / HTTP/1.0" 200 OK 2026-04-14 03:59:07,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 03:59:07,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET /node/6999df48b6c7477a51eaa694%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47332 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:18:53,525 - lava_callback - INFO - Received callback for node 69ddbb82c2164e674d721a24 INFO: 172.20.0.1:36066 - "POST /node/69ddbb82c2164e674d721a24 HTTP/1.0" 202 Accepted 2026-04-14 04:18:53,533 - lava_callback - INFO - Starting async job submit for node 69ddbb82c2164e674d721a24 2026-04-14 04:18:53,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:18:53,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddbb82c2164e674d721a24 HTTP/1.1" 200 None 2026-04-14 04:18:53,592 - lava_callback - DEBUG - Processing node 69ddbb82c2164e674d721a24: baseline-nfs-arm64 2026-04-14 04:18:54,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:18:54,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:18:54,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddbb82c2164e674d721a24/log.txt.gz 2026-04-14 04:18:55,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:18:55,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:18:55,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddbb82c2164e674d721a24/lava-logs.yaml 2026-04-14 04:18:55,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:18:55,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:18:55,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddbb82c2164e674d721a24/lava_callback.json.gz DEBUG: Setup failed for 69ddbb82c2164e674d721a24. Transitting job node result: incomplete -> fail 2026-04-14 04:18:55,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:18:55,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddbb82c2164e674d721a24 HTTP/1.1" 200 None 2026-04-14 04:18:55,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:18:55,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 04:18:55,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:18:55,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddbb82c2164e674d721a24 HTTP/1.1" 200 None 2026-04-14 04:18:56,099 - lava_callback - INFO - Completed processing callback for node 69ddbb82c2164e674d721a24 INFO: 172.20.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36944 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:19:07,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:19:07,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:39:06,964 - lava_callback - INFO - Received callback for node 69ddc03ac2164e674d72201a INFO: 172.20.0.1:40590 - "POST /node/69ddc03ac2164e674d72201a HTTP/1.0" 202 Accepted 2026-04-14 04:39:06,972 - lava_callback - INFO - Starting async job submit for node 69ddc03ac2164e674d72201a 2026-04-14 04:39:07,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:39:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc03ac2164e674d72201a HTTP/1.1" 200 None 2026-04-14 04:39:07,033 - lava_callback - DEBUG - Processing node 69ddc03ac2164e674d72201a: baseline-nfs-arm64 2026-04-14 04:39:08,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:39:08,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:39:08,242 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddc03ac2164e674d72201a/log.txt.gz 2026-04-14 04:39:08,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:39:09,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:39:09,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddc03ac2164e674d72201a/lava-logs.yaml 2026-04-14 04:39:09,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 04:39:09,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 04:39:09,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ddc03ac2164e674d72201a/lava_callback.json.gz DEBUG: Setup failed for 69ddc03ac2164e674d72201a. Transitting job node result: incomplete -> fail 2026-04-14 04:39:09,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:39:09,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc03ac2164e674d72201a HTTP/1.1" 200 None 2026-04-14 04:39:09,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:39:09,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 04:39:09,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:39:09,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc03ac2164e674d72201a HTTP/1.1" 200 None 2026-04-14 04:39:09,459 - lava_callback - INFO - Completed processing callback for node 69ddc03ac2164e674d72201a INFO: 172.20.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:39:37,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:39:37,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45008 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:43:09,013 - lava_callback - INFO - Received callback for node 69db22cf0a04df09a44eb0e2 INFO: 172.20.0.1:45016 - "POST /node/69db22cf0a04df09a44eb0e2 HTTP/1.0" 202 Accepted 2026-04-14 04:43:09,018 - lava_callback - INFO - Starting async job submit for node 69db22cf0a04df09a44eb0e2 2026-04-14 04:43:09,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:09,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db22cf0a04df09a44eb0e2 HTTP/1.1" 200 None 2026-04-14 04:43:09,034 - lava_callback - DEBUG - Processing node 69db22cf0a04df09a44eb0e2: baseline-arm-baylibre 2026-04-14 04:43:09,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db22cf0a04df09a44eb0e2 2026-04-14 04:43:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:09,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db22cf0a04df09a44eb0e2 HTTP/1.1" 200 None 2026-04-14 04:43:09,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:09,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:43:09,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:09,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db22cf0a04df09a44eb0e2 HTTP/1.1" 200 None 2026-04-14 04:43:09,083 - lava_callback - ERROR - Error processing callback for node 69db22cf0a04df09a44eb0e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44376 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:43:28,863 - lava_callback - INFO - Received callback for node 69db22ec0a04df09a44eb115 INFO: 172.20.0.1:44392 - "POST /node/69db22ec0a04df09a44eb115 HTTP/1.0" 202 Accepted 2026-04-14 04:43:28,869 - lava_callback - INFO - Starting async job submit for node 69db22ec0a04df09a44eb115 2026-04-14 04:43:28,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:28,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db22ec0a04df09a44eb115 HTTP/1.1" 200 None 2026-04-14 04:43:28,886 - lava_callback - DEBUG - Processing node 69db22ec0a04df09a44eb115: baseline-arm-baylibre 2026-04-14 04:43:28,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db22ec0a04df09a44eb115 2026-04-14 04:43:28,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:28,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db22ec0a04df09a44eb115 HTTP/1.1" 200 None 2026-04-14 04:43:28,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:28,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:43:28,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:43:28,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db22ec0a04df09a44eb115 HTTP/1.1" 200 None 2026-04-14 04:43:28,947 - lava_callback - ERROR - Error processing callback for node 69db22ec0a04df09a44eb115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51386 - "GET /node/69487f0c9214b4938716982c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46506 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:44:08,902 - lava_callback - INFO - Received callback for node 69db230f0a04df09a44eb125 INFO: 172.20.0.1:46514 - "POST /node/69db230f0a04df09a44eb125 HTTP/1.0" 202 Accepted 2026-04-14 04:44:08,908 - lava_callback - INFO - Starting async job submit for node 69db230f0a04df09a44eb125 2026-04-14 04:44:08,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:44:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db230f0a04df09a44eb125 HTTP/1.1" 200 None 2026-04-14 04:44:08,933 - lava_callback - DEBUG - Processing node 69db230f0a04df09a44eb125: baseline-arm-baylibre 2026-04-14 04:44:08,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db230f0a04df09a44eb125 2026-04-14 04:44:08,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:44:08,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db230f0a04df09a44eb125 HTTP/1.1" 200 None 2026-04-14 04:44:08,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:44:08,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:44:08,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:44:08,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db230f0a04df09a44eb125 HTTP/1.1" 200 None 2026-04-14 04:44:08,995 - lava_callback - ERROR - Error processing callback for node 69db230f0a04df09a44eb125: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:45:08,980 - lava_callback - INFO - Received callback for node 69db23420a04df09a44eb13a INFO: 172.20.0.1:38638 - "POST /node/69db23420a04df09a44eb13a HTTP/1.0" 202 Accepted 2026-04-14 04:45:08,987 - lava_callback - INFO - Starting async job submit for node 69db23420a04df09a44eb13a 2026-04-14 04:45:08,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:09,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23420a04df09a44eb13a HTTP/1.1" 200 None 2026-04-14 04:45:09,006 - lava_callback - DEBUG - Processing node 69db23420a04df09a44eb13a: baseline-arm-baylibre 2026-04-14 04:45:09,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db23420a04df09a44eb13a 2026-04-14 04:45:09,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:09,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23420a04df09a44eb13a HTTP/1.1" 200 None 2026-04-14 04:45:09,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:09,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:45:09,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:09,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db23420a04df09a44eb13a HTTP/1.1" 200 None 2026-04-14 04:45:09,054 - lava_callback - ERROR - Error processing callback for node 69db23420a04df09a44eb13a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:45:28,928 - lava_callback - INFO - Received callback for node 69db23630a04df09a44eb167 INFO: 172.20.0.1:38874 - "POST /node/69db23630a04df09a44eb167 HTTP/1.0" 202 Accepted 2026-04-14 04:45:28,933 - lava_callback - INFO - Starting async job submit for node 69db23630a04df09a44eb167 2026-04-14 04:45:28,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:28,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23630a04df09a44eb167 HTTP/1.1" 200 None 2026-04-14 04:45:28,949 - lava_callback - DEBUG - Processing node 69db23630a04df09a44eb167: baseline-arm-baylibre 2026-04-14 04:45:28,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db23630a04df09a44eb167 2026-04-14 04:45:28,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:28,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23630a04df09a44eb167 HTTP/1.1" 200 None 2026-04-14 04:45:28,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:28,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:45:28,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:45:28,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db23630a04df09a44eb167 HTTP/1.1" 200 None 2026-04-14 04:45:29,000 - lava_callback - ERROR - Error processing callback for node 69db23630a04df09a44eb167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET /node/69830827409235c29c0dd51b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58186 - "GET /node/6989392885773790cd34d46f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56508 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 04:47:16,464 - lava_callback - INFO - Received callback for node 69db23c50a04df09a44eb1c6 INFO: 172.20.0.1:56520 - "POST /node/69db23c50a04df09a44eb1c6 HTTP/1.0" 202 Accepted 2026-04-14 04:47:16,470 - lava_callback - INFO - Starting async job submit for node 69db23c50a04df09a44eb1c6 2026-04-14 04:47:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:16,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23c50a04df09a44eb1c6 HTTP/1.1" 200 None 2026-04-14 04:47:16,486 - lava_callback - DEBUG - Processing node 69db23c50a04df09a44eb1c6: baseline-arm-clabbe 2026-04-14 04:47:16,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db23c50a04df09a44eb1c6 2026-04-14 04:47:16,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:16,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23c50a04df09a44eb1c6 HTTP/1.1" 200 None 2026-04-14 04:47:16,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:16,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:47:16,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56536 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:47:16,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db23c50a04df09a44eb1c6 HTTP/1.1" 200 None 2026-04-14 04:47:16,539 - lava_callback - ERROR - Error processing callback for node 69db23c50a04df09a44eb1c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:47:56,121 - lava_callback - INFO - Received callback for node 69db23ee0a04df09a44eb1d6 INFO: 172.20.0.1:41954 - "POST /node/69db23ee0a04df09a44eb1d6 HTTP/1.0" 202 Accepted 2026-04-14 04:47:56,127 - lava_callback - INFO - Starting async job submit for node 69db23ee0a04df09a44eb1d6 2026-04-14 04:47:56,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:56,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23ee0a04df09a44eb1d6 HTTP/1.1" 200 None 2026-04-14 04:47:56,142 - lava_callback - DEBUG - Processing node 69db23ee0a04df09a44eb1d6: baseline-arm-clabbe 2026-04-14 04:47:56,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db23ee0a04df09a44eb1d6 2026-04-14 04:47:56,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:56,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db23ee0a04df09a44eb1d6 HTTP/1.1" 200 None 2026-04-14 04:47:56,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:56,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:47:56,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:47:56,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db23ee0a04df09a44eb1d6 HTTP/1.1" 200 None 2026-04-14 04:47:56,202 - lava_callback - ERROR - Error processing callback for node 69db23ee0a04df09a44eb1d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36614 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:48:36,178 - lava_callback - INFO - Received callback for node 69db24120a04df09a44eb1e6 INFO: 172.20.0.1:33110 - "POST /node/69db24120a04df09a44eb1e6 HTTP/1.0" 202 Accepted 2026-04-14 04:48:36,184 - lava_callback - INFO - Starting async job submit for node 69db24120a04df09a44eb1e6 2026-04-14 04:48:36,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:36,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24120a04df09a44eb1e6 HTTP/1.1" 200 None 2026-04-14 04:48:36,199 - lava_callback - DEBUG - Processing node 69db24120a04df09a44eb1e6: baseline-arm-clabbe 2026-04-14 04:48:36,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24120a04df09a44eb1e6 2026-04-14 04:48:36,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:36,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24120a04df09a44eb1e6 HTTP/1.1" 200 None 2026-04-14 04:48:36,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:36,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:48:36,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:36,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24120a04df09a44eb1e6 HTTP/1.1" 200 None 2026-04-14 04:48:36,249 - lava_callback - ERROR - Error processing callback for node 69db24120a04df09a44eb1e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:48:56,172 - lava_callback - INFO - Received callback for node 69db24350a04df09a44eb216 INFO: 172.20.0.1:37928 - "POST /node/69db24350a04df09a44eb216 HTTP/1.0" 202 Accepted 2026-04-14 04:48:56,177 - lava_callback - INFO - Starting async job submit for node 69db24350a04df09a44eb216 2026-04-14 04:48:56,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24350a04df09a44eb216 HTTP/1.1" 200 None 2026-04-14 04:48:56,193 - lava_callback - DEBUG - Processing node 69db24350a04df09a44eb216: baseline-arm-clabbe 2026-04-14 04:48:56,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24350a04df09a44eb216 2026-04-14 04:48:56,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:56,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24350a04df09a44eb216 HTTP/1.1" 200 None 2026-04-14 04:48:56,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:56,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:48:56,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:48:56,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24350a04df09a44eb216 HTTP/1.1" 200 None 2026-04-14 04:48:56,250 - lava_callback - ERROR - Error processing callback for node 69db24350a04df09a44eb216: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:49:36,271 - lava_callback - INFO - Received callback for node 69db24570a04df09a44eb23c INFO: 172.20.0.1:33798 - "POST /node/69db24570a04df09a44eb23c HTTP/1.0" 202 Accepted 2026-04-14 04:49:36,281 - lava_callback - INFO - Starting async job submit for node 69db24570a04df09a44eb23c 2026-04-14 04:49:36,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:49:36,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24570a04df09a44eb23c HTTP/1.1" 200 None 2026-04-14 04:49:36,297 - lava_callback - DEBUG - Processing node 69db24570a04df09a44eb23c: baseline-arm-clabbe 2026-04-14 04:49:36,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24570a04df09a44eb23c 2026-04-14 04:49:36,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:49:36,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24570a04df09a44eb23c HTTP/1.1" 200 None 2026-04-14 04:49:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:49:36,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:49:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:49:36,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24570a04df09a44eb23c HTTP/1.1" 200 None 2026-04-14 04:49:36,365 - lava_callback - ERROR - Error processing callback for node 69db24570a04df09a44eb23c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33812 - "GET /node/695c59f05dac150a0e83ca68%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:50:09,496 - lava_callback - INFO - Received callback for node 69db24740a04df09a44eb25e INFO: 172.20.0.1:57010 - "POST /node/69db24740a04df09a44eb25e HTTP/1.0" 202 Accepted 2026-04-14 04:50:09,501 - lava_callback - INFO - Starting async job submit for node 69db24740a04df09a44eb25e 2026-04-14 04:50:09,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:09,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24740a04df09a44eb25e HTTP/1.1" 200 None 2026-04-14 04:50:09,524 - lava_callback - DEBUG - Processing node 69db24740a04df09a44eb25e: baseline-arm-baylibre 2026-04-14 04:50:09,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24740a04df09a44eb25e 2026-04-14 04:50:09,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:09,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24740a04df09a44eb25e HTTP/1.1" 200 None 2026-04-14 04:50:09,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:09,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:50:09,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:09,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24740a04df09a44eb25e HTTP/1.1" 200 None 2026-04-14 04:50:09,573 - lava_callback - ERROR - Error processing callback for node 69db24740a04df09a44eb25e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36346 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:50:36,284 - lava_callback - INFO - Received callback for node 69db24960a04df09a44eb28d INFO: 172.20.0.1:49564 - "POST /node/69db24960a04df09a44eb28d HTTP/1.0" 202 Accepted 2026-04-14 04:50:36,290 - lava_callback - INFO - Starting async job submit for node 69db24960a04df09a44eb28d 2026-04-14 04:50:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:36,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24960a04df09a44eb28d HTTP/1.1" 200 None 2026-04-14 04:50:36,306 - lava_callback - DEBUG - Processing node 69db24960a04df09a44eb28d: baseline-arm-clabbe 2026-04-14 04:50:36,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24960a04df09a44eb28d 2026-04-14 04:50:36,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:36,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24960a04df09a44eb28d HTTP/1.1" 200 None 2026-04-14 04:50:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:36,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:50:36,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:50:36,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24960a04df09a44eb28d HTTP/1.1" 200 None 2026-04-14 04:50:36,353 - lava_callback - ERROR - Error processing callback for node 69db24960a04df09a44eb28d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57424 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 04:51:16,329 - lava_callback - INFO - Received callback for node 69db24b70a04df09a44eb2c2 INFO: 172.20.0.1:57434 - "POST /node/69db24b70a04df09a44eb2c2 HTTP/1.0" 202 Accepted 2026-04-14 04:51:16,335 - lava_callback - INFO - Starting async job submit for node 69db24b70a04df09a44eb2c2 2026-04-14 04:51:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:16,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24b70a04df09a44eb2c2 HTTP/1.1" 200 None 2026-04-14 04:51:16,356 - lava_callback - DEBUG - Processing node 69db24b70a04df09a44eb2c2: baseline-arm-clabbe 2026-04-14 04:51:16,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24b70a04df09a44eb2c2 2026-04-14 04:51:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:16,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24b70a04df09a44eb2c2 HTTP/1.1" 200 None 2026-04-14 04:51:16,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:16,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:51:16,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:16,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24b70a04df09a44eb2c2 HTTP/1.1" 200 None 2026-04-14 04:51:16,422 - lava_callback - ERROR - Error processing callback for node 69db24b70a04df09a44eb2c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:51:49,356 - lava_callback - INFO - Received callback for node 69db24d40a04df09a44eb2cf INFO: 172.20.0.1:38444 - "POST /node/69db24d40a04df09a44eb2cf HTTP/1.0" 202 Accepted 2026-04-14 04:51:49,362 - lava_callback - INFO - Starting async job submit for node 69db24d40a04df09a44eb2cf 2026-04-14 04:51:49,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:49,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24d40a04df09a44eb2cf HTTP/1.1" 200 None 2026-04-14 04:51:49,378 - lava_callback - DEBUG - Processing node 69db24d40a04df09a44eb2cf: baseline-arm-baylibre 2026-04-14 04:51:49,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24d40a04df09a44eb2cf 2026-04-14 04:51:49,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:49,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24d40a04df09a44eb2cf HTTP/1.1" 200 None 2026-04-14 04:51:49,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:49,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:51:49,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:51:49,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24d40a04df09a44eb2cf HTTP/1.1" 200 None 2026-04-14 04:51:49,432 - lava_callback - ERROR - Error processing callback for node 69db24d40a04df09a44eb2cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:52:09,339 - lava_callback - INFO - Received callback for node 69db24f40a04df09a44eb2f0 INFO: 172.20.0.1:53796 - "POST /node/69db24f40a04df09a44eb2f0 HTTP/1.0" 202 Accepted 2026-04-14 04:52:09,345 - lava_callback - INFO - Starting async job submit for node 69db24f40a04df09a44eb2f0 2026-04-14 04:52:09,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:09,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24f40a04df09a44eb2f0 HTTP/1.1" 200 None 2026-04-14 04:52:09,361 - lava_callback - DEBUG - Processing node 69db24f40a04df09a44eb2f0: baseline-arm-baylibre 2026-04-14 04:52:09,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db24f40a04df09a44eb2f0 2026-04-14 04:52:09,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db24f40a04df09a44eb2f0 HTTP/1.1" 200 None 2026-04-14 04:52:09,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:09,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:52:09,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:09,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db24f40a04df09a44eb2f0 HTTP/1.1" 200 None 2026-04-14 04:52:09,440 - lava_callback - ERROR - Error processing callback for node 69db24f40a04df09a44eb2f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:52:36,390 - lava_callback - INFO - Received callback for node 69db25110a04df09a44eb32f INFO: 172.20.0.1:34752 - "POST /node/69db25110a04df09a44eb32f HTTP/1.0" 202 Accepted 2026-04-14 04:52:36,396 - lava_callback - INFO - Starting async job submit for node 69db25110a04df09a44eb32f 2026-04-14 04:52:36,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:36,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25110a04df09a44eb32f HTTP/1.1" 200 None 2026-04-14 04:52:36,420 - lava_callback - DEBUG - Processing node 69db25110a04df09a44eb32f: baseline-arm-clabbe 2026-04-14 04:52:36,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db25110a04df09a44eb32f 2026-04-14 04:52:36,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:36,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25110a04df09a44eb32f HTTP/1.1" 200 None 2026-04-14 04:52:36,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:36,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:52:36,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:52:36,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db25110a04df09a44eb32f HTTP/1.1" 200 None 2026-04-14 04:52:36,477 - lava_callback - ERROR - Error processing callback for node 69db25110a04df09a44eb32f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 04:53:16,377 - lava_callback - INFO - Received callback for node 69db25350a04df09a44eb355 INFO: 172.20.0.1:54880 - "POST /node/69db25350a04df09a44eb355 HTTP/1.0" 202 Accepted 2026-04-14 04:53:16,383 - lava_callback - INFO - Starting async job submit for node 69db25350a04df09a44eb355 2026-04-14 04:53:16,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:16,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25350a04df09a44eb355 HTTP/1.1" 200 None 2026-04-14 04:53:16,426 - lava_callback - DEBUG - Processing node 69db25350a04df09a44eb355: baseline-arm-clabbe 2026-04-14 04:53:16,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db25350a04df09a44eb355 2026-04-14 04:53:16,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:16,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25350a04df09a44eb355 HTTP/1.1" 200 None 2026-04-14 04:53:16,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:16,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-14 04:53:16,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:16,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db25350a04df09a44eb355 HTTP/1.1" 200 None 2026-04-14 04:53:16,473 - lava_callback - ERROR - Error processing callback for node 69db25350a04df09a44eb355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34896 - "GET /node/698b8d5e0a16aea5a0dc8dc7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34902 - "GET /node/695b0ce38156fad0b1221908%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:53:49,499 - lava_callback - INFO - Received callback for node 69db25540a04df09a44eb36c INFO: 172.20.0.1:43730 - "POST /node/69db25540a04df09a44eb36c HTTP/1.0" 202 Accepted 2026-04-14 04:53:49,504 - lava_callback - INFO - Starting async job submit for node 69db25540a04df09a44eb36c 2026-04-14 04:53:49,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:49,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25540a04df09a44eb36c HTTP/1.1" 200 None 2026-04-14 04:53:49,520 - lava_callback - DEBUG - Processing node 69db25540a04df09a44eb36c: baseline-arm-baylibre 2026-04-14 04:53:49,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db25540a04df09a44eb36c 2026-04-14 04:53:49,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:49,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25540a04df09a44eb36c HTTP/1.1" 200 None 2026-04-14 04:53:49,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:53:49,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:53:49,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db25540a04df09a44eb36c HTTP/1.1" 200 None 2026-04-14 04:53:49,583 - lava_callback - ERROR - Error processing callback for node 69db25540a04df09a44eb36c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53618 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:55:09,538 - lava_callback - INFO - Received callback for node 69db25aa0a04df09a44eb3c5 INFO: 172.20.0.1:53628 - "POST /node/69db25aa0a04df09a44eb3c5 HTTP/1.0" 202 Accepted 2026-04-14 04:55:09,543 - lava_callback - INFO - Starting async job submit for node 69db25aa0a04df09a44eb3c5 2026-04-14 04:55:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:55:09,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25aa0a04df09a44eb3c5 HTTP/1.1" 200 None 2026-04-14 04:55:09,560 - lava_callback - DEBUG - Processing node 69db25aa0a04df09a44eb3c5: baseline-arm-baylibre 2026-04-14 04:55:09,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db25aa0a04df09a44eb3c5 2026-04-14 04:55:09,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:55:09,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25aa0a04df09a44eb3c5 HTTP/1.1" 200 None 2026-04-14 04:55:09,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:55:09,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:55:09,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:55:09,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db25aa0a04df09a44eb3c5 HTTP/1.1" 200 None 2026-04-14 04:55:09,609 - lava_callback - ERROR - Error processing callback for node 69db25aa0a04df09a44eb3c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36786 - "GET /node/695b06f98156fad0b122122c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36794 - "GET /node/698a0e4b22b4cc0f227ad831%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:56:36,527 - lava_callback - INFO - Received callback for node 69db25f30a04df09a44eb3f3 INFO: 172.20.0.1:36358 - "POST /node/69db25f30a04df09a44eb3f3 HTTP/1.0" 202 Accepted 2026-04-14 04:56:36,532 - lava_callback - INFO - Starting async job submit for node 69db25f30a04df09a44eb3f3 2026-04-14 04:56:36,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:56:36,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25f30a04df09a44eb3f3 HTTP/1.1" 200 None 2026-04-14 04:56:36,548 - lava_callback - DEBUG - Processing node 69db25f30a04df09a44eb3f3: baseline-arm-clabbe 2026-04-14 04:56:36,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db25f30a04df09a44eb3f3 2026-04-14 04:56:36,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:56:36,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db25f30a04df09a44eb3f3 HTTP/1.1" 200 None 2026-04-14 04:56:36,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:56:36,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:56:36,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:56:36,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db25f30a04df09a44eb3f3 HTTP/1.1" 200 None 2026-04-14 04:56:36,598 - lava_callback - ERROR - Error processing callback for node 69db25f30a04df09a44eb3f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:57:09,652 - lava_callback - INFO - Received callback for node 69db26130a04df09a44eb40e INFO: 172.20.0.1:58114 - "POST /node/69db26130a04df09a44eb40e HTTP/1.0" 202 Accepted 2026-04-14 04:57:09,657 - lava_callback - INFO - Starting async job submit for node 69db26130a04df09a44eb40e 2026-04-14 04:57:09,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:57:09,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26130a04df09a44eb40e HTTP/1.1" 200 None 2026-04-14 04:57:09,678 - lava_callback - DEBUG - Processing node 69db26130a04df09a44eb40e: baseline-arm-baylibre 2026-04-14 04:57:09,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26130a04df09a44eb40e 2026-04-14 04:57:09,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:57:09,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26130a04df09a44eb40e HTTP/1.1" 200 None 2026-04-14 04:57:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:57:09,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:57:09,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:57:09,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26130a04df09a44eb40e HTTP/1.1" 200 None 2026-04-14 04:57:09,737 - lava_callback - ERROR - Error processing callback for node 69db26130a04df09a44eb40e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57122 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:58:16,607 - lava_callback - INFO - Received callback for node 69db26550a04df09a44eb45e INFO: 172.20.0.1:57136 - "POST /node/69db26550a04df09a44eb45e HTTP/1.0" 202 Accepted 2026-04-14 04:58:16,613 - lava_callback - INFO - Starting async job submit for node 69db26550a04df09a44eb45e 2026-04-14 04:58:16,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26550a04df09a44eb45e HTTP/1.1" 200 None 2026-04-14 04:58:16,633 - lava_callback - DEBUG - Processing node 69db26550a04df09a44eb45e: baseline-arm-clabbe 2026-04-14 04:58:16,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26550a04df09a44eb45e 2026-04-14 04:58:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:16,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26550a04df09a44eb45e HTTP/1.1" 200 None 2026-04-14 04:58:16,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:16,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:58:16,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:16,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26550a04df09a44eb45e HTTP/1.1" 200 None 2026-04-14 04:58:16,691 - lava_callback - ERROR - Error processing callback for node 69db26550a04df09a44eb45e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43966 - "GET /node/698931ca85773790cd34bfe3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:58:36,564 - lava_callback - INFO - Received callback for node 69db26740a04df09a44eb496 INFO: 172.20.0.1:47292 - "POST /node/69db26740a04df09a44eb496 HTTP/1.0" 202 Accepted 2026-04-14 04:58:36,569 - lava_callback - INFO - Starting async job submit for node 69db26740a04df09a44eb496 2026-04-14 04:58:36,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:36,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26740a04df09a44eb496 HTTP/1.1" 200 None 2026-04-14 04:58:36,585 - lava_callback - DEBUG - Processing node 69db26740a04df09a44eb496: baseline-arm-clabbe 2026-04-14 04:58:36,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26740a04df09a44eb496 2026-04-14 04:58:36,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:36,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26740a04df09a44eb496 HTTP/1.1" 200 None 2026-04-14 04:58:36,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:36,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:58:36,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:58:36,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26740a04df09a44eb496 HTTP/1.1" 200 None 2026-04-14 04:58:36,634 - lava_callback - ERROR - Error processing callback for node 69db26740a04df09a44eb496: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:59:16,611 - lava_callback - INFO - Received callback for node 69db26980a04df09a44eb4a9 INFO: 172.20.0.1:40020 - "POST /node/69db26980a04df09a44eb4a9 HTTP/1.0" 202 Accepted 2026-04-14 04:59:16,616 - lava_callback - INFO - Starting async job submit for node 69db26980a04df09a44eb4a9 2026-04-14 04:59:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26980a04df09a44eb4a9 HTTP/1.1" 200 None 2026-04-14 04:59:16,633 - lava_callback - DEBUG - Processing node 69db26980a04df09a44eb4a9: baseline-arm-clabbe 2026-04-14 04:59:16,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26980a04df09a44eb4a9 2026-04-14 04:59:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:16,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26980a04df09a44eb4a9 HTTP/1.1" 200 None 2026-04-14 04:59:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:16,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:59:16,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:16,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26980a04df09a44eb4a9 HTTP/1.1" 200 None 2026-04-14 04:59:16,680 - lava_callback - ERROR - Error processing callback for node 69db26980a04df09a44eb4a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50670 - "GET / HTTP/1.0" 200 OK 2026-04-14 04:59:56,602 - lava_callback - INFO - Received callback for node 69db26b90a04df09a44eb4cc INFO: 172.20.0.1:50682 - "POST /node/69db26b90a04df09a44eb4cc HTTP/1.0" 202 Accepted 2026-04-14 04:59:56,607 - lava_callback - INFO - Starting async job submit for node 69db26b90a04df09a44eb4cc 2026-04-14 04:59:56,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:56,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26b90a04df09a44eb4cc HTTP/1.1" 200 None 2026-04-14 04:59:56,623 - lava_callback - DEBUG - Processing node 69db26b90a04df09a44eb4cc: baseline-arm-clabbe 2026-04-14 04:59:56,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26b90a04df09a44eb4cc 2026-04-14 04:59:56,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:56,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26b90a04df09a44eb4cc HTTP/1.1" 200 None 2026-04-14 04:59:56,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:56,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 04:59:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 04:59:56,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26b90a04df09a44eb4cc HTTP/1.1" 200 None 2026-04-14 04:59:56,670 - lava_callback - ERROR - Error processing callback for node 69db26b90a04df09a44eb4cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 05:00:16,644 - lava_callback - INFO - Received callback for node 69db26d90a04df09a44eb4f1 INFO: 172.20.0.1:40194 - "POST /node/69db26d90a04df09a44eb4f1 HTTP/1.0" 202 Accepted 2026-04-14 05:00:16,650 - lava_callback - INFO - Starting async job submit for node 69db26d90a04df09a44eb4f1 2026-04-14 05:00:16,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:16,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26d90a04df09a44eb4f1 HTTP/1.1" 200 None 2026-04-14 05:00:16,665 - lava_callback - DEBUG - Processing node 69db26d90a04df09a44eb4f1: baseline-arm-clabbe 2026-04-14 05:00:16,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26d90a04df09a44eb4f1 2026-04-14 05:00:16,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:16,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26d90a04df09a44eb4f1 HTTP/1.1" 200 None 2026-04-14 05:00:16,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:00:16,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:00:16,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:16,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26d90a04df09a44eb4f1 HTTP/1.1" 200 None 2026-04-14 05:00:16,718 - lava_callback - ERROR - Error processing callback for node 69db26d90a04df09a44eb4f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48524 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:00:56,656 - lava_callback - INFO - Received callback for node 69db26fb0a04df09a44eb51d INFO: 172.20.0.1:48536 - "POST /node/69db26fb0a04df09a44eb51d HTTP/1.0" 202 Accepted 2026-04-14 05:00:56,661 - lava_callback - INFO - Starting async job submit for node 69db26fb0a04df09a44eb51d 2026-04-14 05:00:56,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:56,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26fb0a04df09a44eb51d HTTP/1.1" 200 None 2026-04-14 05:00:56,677 - lava_callback - DEBUG - Processing node 69db26fb0a04df09a44eb51d: baseline-arm-clabbe 2026-04-14 05:00:56,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db26fb0a04df09a44eb51d 2026-04-14 05:00:56,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:56,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db26fb0a04df09a44eb51d HTTP/1.1" 200 None 2026-04-14 05:00:56,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:56,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:00:56,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:00:56,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db26fb0a04df09a44eb51d HTTP/1.1" 200 None 2026-04-14 05:00:56,729 - lava_callback - ERROR - Error processing callback for node 69db26fb0a04df09a44eb51d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:01:16,696 - lava_callback - INFO - Received callback for node 69db27190a04df09a44eb53b INFO: 172.20.0.1:44726 - "POST /node/69db27190a04df09a44eb53b HTTP/1.0" 202 Accepted 2026-04-14 05:01:16,702 - lava_callback - INFO - Starting async job submit for node 69db27190a04df09a44eb53b 2026-04-14 05:01:16,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:16,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27190a04df09a44eb53b HTTP/1.1" 200 None 2026-04-14 05:01:16,718 - lava_callback - DEBUG - Processing node 69db27190a04df09a44eb53b: baseline-arm-clabbe 2026-04-14 05:01:16,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db27190a04df09a44eb53b 2026-04-14 05:01:16,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:16,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27190a04df09a44eb53b HTTP/1.1" 200 None 2026-04-14 05:01:16,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:01:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:16,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db27190a04df09a44eb53b HTTP/1.1" 200 None 2026-04-14 05:01:16,766 - lava_callback - ERROR - Error processing callback for node 69db27190a04df09a44eb53b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54018 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:01:56,669 - lava_callback - INFO - Received callback for node 69db273d0a04df09a44eb572 INFO: 172.20.0.1:54030 - "POST /node/69db273d0a04df09a44eb572 HTTP/1.0" 202 Accepted 2026-04-14 05:01:56,675 - lava_callback - INFO - Starting async job submit for node 69db273d0a04df09a44eb572 2026-04-14 05:01:56,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:56,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db273d0a04df09a44eb572 HTTP/1.1" 200 None 2026-04-14 05:01:56,707 - lava_callback - DEBUG - Processing node 69db273d0a04df09a44eb572: baseline-arm-clabbe 2026-04-14 05:01:56,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db273d0a04df09a44eb572 2026-04-14 05:01:56,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:56,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db273d0a04df09a44eb572 HTTP/1.1" 200 None 2026-04-14 05:01:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:56,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:01:56,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:01:56,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db273d0a04df09a44eb572 HTTP/1.1" 200 None 2026-04-14 05:01:56,756 - lava_callback - ERROR - Error processing callback for node 69db273d0a04df09a44eb572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60508 - "GET /node/693e59e9407f32424eb63e04%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41050 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:02:36,760 - lava_callback - INFO - Received callback for node 69db27610a04df09a44eb589 INFO: 172.20.0.1:41060 - "POST /node/69db27610a04df09a44eb589 HTTP/1.0" 202 Accepted 2026-04-14 05:02:36,765 - lava_callback - INFO - Starting async job submit for node 69db27610a04df09a44eb589 2026-04-14 05:02:36,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:02:36,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27610a04df09a44eb589 HTTP/1.1" 200 None 2026-04-14 05:02:36,781 - lava_callback - DEBUG - Processing node 69db27610a04df09a44eb589: baseline-arm-clabbe 2026-04-14 05:02:36,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db27610a04df09a44eb589 2026-04-14 05:02:36,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:02:36,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27610a04df09a44eb589 HTTP/1.1" 200 None 2026-04-14 05:02:36,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:02:36,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:02:36,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:02:36,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db27610a04df09a44eb589 HTTP/1.1" 200 None 2026-04-14 05:02:36,829 - lava_callback - ERROR - Error processing callback for node 69db27610a04df09a44eb589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:03:16,725 - lava_callback - INFO - Received callback for node 69db27830a04df09a44eb5ac INFO: 172.20.0.1:38766 - "POST /node/69db27830a04df09a44eb5ac HTTP/1.0" 202 Accepted 2026-04-14 05:03:16,731 - lava_callback - INFO - Starting async job submit for node 69db27830a04df09a44eb5ac 2026-04-14 05:03:16,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27830a04df09a44eb5ac HTTP/1.1" 200 None 2026-04-14 05:03:16,747 - lava_callback - DEBUG - Processing node 69db27830a04df09a44eb5ac: baseline-arm-clabbe 2026-04-14 05:03:16,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db27830a04df09a44eb5ac 2026-04-14 05:03:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:16,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27830a04df09a44eb5ac HTTP/1.1" 200 None 2026-04-14 05:03:16,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:16,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:03:16,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:16,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db27830a04df09a44eb5ac HTTP/1.1" 200 None 2026-04-14 05:03:16,794 - lava_callback - ERROR - Error processing callback for node 69db27830a04df09a44eb5ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32830 - "GET /node/69865457177ca0f097bd4030%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32836 - "GET /node/6980d2bc1ab488c16c858e9b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:03:36,788 - lava_callback - INFO - Received callback for node 69db27a20a04df09a44eb5e0 INFO: 172.20.0.1:47886 - "POST /node/69db27a20a04df09a44eb5e0 HTTP/1.0" 202 Accepted 2026-04-14 05:03:36,793 - lava_callback - INFO - Starting async job submit for node 69db27a20a04df09a44eb5e0 2026-04-14 05:03:36,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:36,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27a20a04df09a44eb5e0 HTTP/1.1" 200 None 2026-04-14 05:03:36,811 - lava_callback - DEBUG - Processing node 69db27a20a04df09a44eb5e0: baseline-arm-clabbe 2026-04-14 05:03:36,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db27a20a04df09a44eb5e0 2026-04-14 05:03:36,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:36,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27a20a04df09a44eb5e0 HTTP/1.1" 200 None 2026-04-14 05:03:36,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:36,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:03:36,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:03:36,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db27a20a04df09a44eb5e0 HTTP/1.1" 200 None 2026-04-14 05:03:36,862 - lava_callback - ERROR - Error processing callback for node 69db27a20a04df09a44eb5e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43474 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:04:16,772 - lava_callback - INFO - Received callback for node 69db27c60a04df09a44eb5f3 INFO: 172.20.0.1:43484 - "POST /node/69db27c60a04df09a44eb5f3 HTTP/1.0" 202 Accepted 2026-04-14 05:04:16,778 - lava_callback - INFO - Starting async job submit for node 69db27c60a04df09a44eb5f3 2026-04-14 05:04:16,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:04:16,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27c60a04df09a44eb5f3 HTTP/1.1" 200 None 2026-04-14 05:04:16,793 - lava_callback - DEBUG - Processing node 69db27c60a04df09a44eb5f3: baseline-arm-clabbe 2026-04-14 05:04:16,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db27c60a04df09a44eb5f3 2026-04-14 05:04:16,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:04:16,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db27c60a04df09a44eb5f3 HTTP/1.1" 200 None 2026-04-14 05:04:16,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:04:16,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:04:16,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:04:16,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db27c60a04df09a44eb5f3 HTTP/1.1" 200 None 2026-04-14 05:04:16,867 - lava_callback - ERROR - Error processing callback for node 69db27c60a04df09a44eb5f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET /node/69876d83e31b58f834f19d36%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58996 - "GET /node/6939a1415206d8a4495e8912%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32902 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:05:56,891 - lava_callback - INFO - Received callback for node 69db28250a04df09a44eb669 INFO: 172.20.0.1:32906 - "POST /node/69db28250a04df09a44eb669 HTTP/1.0" 202 Accepted 2026-04-14 05:05:56,897 - lava_callback - INFO - Starting async job submit for node 69db28250a04df09a44eb669 2026-04-14 05:05:56,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:05:56,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28250a04df09a44eb669 HTTP/1.1" 200 None 2026-04-14 05:05:56,913 - lava_callback - DEBUG - Processing node 69db28250a04df09a44eb669: baseline-arm-clabbe 2026-04-14 05:05:56,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28250a04df09a44eb669 2026-04-14 05:05:56,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:05:56,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28250a04df09a44eb669 HTTP/1.1" 200 None 2026-04-14 05:05:56,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:05:56,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:05:56,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:05:56,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28250a04df09a44eb669 HTTP/1.1" 200 None 2026-04-14 05:05:56,968 - lava_callback - ERROR - Error processing callback for node 69db28250a04df09a44eb669: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:06:36,914 - lava_callback - INFO - Received callback for node 69db28470a04df09a44eb682 INFO: 172.20.0.1:47224 - "POST /node/69db28470a04df09a44eb682 HTTP/1.0" 202 Accepted 2026-04-14 05:06:36,919 - lava_callback - INFO - Starting async job submit for node 69db28470a04df09a44eb682 2026-04-14 05:06:36,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:36,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28470a04df09a44eb682 HTTP/1.1" 200 None 2026-04-14 05:06:36,935 - lava_callback - DEBUG - Processing node 69db28470a04df09a44eb682: baseline-arm-clabbe 2026-04-14 05:06:36,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28470a04df09a44eb682 2026-04-14 05:06:36,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:36,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28470a04df09a44eb682 HTTP/1.1" 200 None 2026-04-14 05:06:36,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:36,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:06:36,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:36,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28470a04df09a44eb682 HTTP/1.1" 200 None 2026-04-14 05:06:36,990 - lava_callback - ERROR - Error processing callback for node 69db28470a04df09a44eb682: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38450 - "GET /node/695a26f22c9ee8be2a342bd0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52864 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:06:56,940 - lava_callback - INFO - Received callback for node 69db28690a04df09a44eb6a2 INFO: 172.20.0.1:52876 - "POST /node/69db28690a04df09a44eb6a2 HTTP/1.0" 202 Accepted 2026-04-14 05:06:56,946 - lava_callback - INFO - Starting async job submit for node 69db28690a04df09a44eb6a2 2026-04-14 05:06:56,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:56,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28690a04df09a44eb6a2 HTTP/1.1" 200 None 2026-04-14 05:06:56,972 - lava_callback - DEBUG - Processing node 69db28690a04df09a44eb6a2: baseline-arm-clabbe 2026-04-14 05:06:56,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28690a04df09a44eb6a2 2026-04-14 05:06:56,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:56,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28690a04df09a44eb6a2 HTTP/1.1" 200 None 2026-04-14 05:06:56,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:57,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:06:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:06:57,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28690a04df09a44eb6a2 HTTP/1.1" 200 None 2026-04-14 05:06:57,025 - lava_callback - ERROR - Error processing callback for node 69db28690a04df09a44eb6a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60752 - "GET /node/695c77f95dac150a0e83daa1%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 05:08:10,288 - lava_callback - INFO - Received callback for node 69db28a60a04df09a44eb6e7 INFO: 172.20.0.1:47614 - "POST /node/69db28a60a04df09a44eb6e7 HTTP/1.0" 202 Accepted 2026-04-14 05:08:10,294 - lava_callback - INFO - Starting async job submit for node 69db28a60a04df09a44eb6e7 2026-04-14 05:08:10,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:10,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28a60a04df09a44eb6e7 HTTP/1.1" 200 None 2026-04-14 05:08:10,321 - lava_callback - DEBUG - Processing node 69db28a60a04df09a44eb6e7: baseline-arm-baylibre 2026-04-14 05:08:10,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28a60a04df09a44eb6e7 2026-04-14 05:08:10,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:10,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28a60a04df09a44eb6e7 HTTP/1.1" 200 None 2026-04-14 05:08:10,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:10,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:08:10,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:10,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28a60a04df09a44eb6e7 HTTP/1.1" 200 None 2026-04-14 05:08:10,369 - lava_callback - ERROR - Error processing callback for node 69db28a60a04df09a44eb6e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:08:37,037 - lava_callback - INFO - Received callback for node 69db28cf0a04df09a44eb71e INFO: 172.20.0.1:33334 - "POST /node/69db28cf0a04df09a44eb71e HTTP/1.0" 202 Accepted 2026-04-14 05:08:37,042 - lava_callback - INFO - Starting async job submit for node 69db28cf0a04df09a44eb71e 2026-04-14 05:08:37,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:37,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28cf0a04df09a44eb71e HTTP/1.1" 200 None 2026-04-14 05:08:37,059 - lava_callback - DEBUG - Processing node 69db28cf0a04df09a44eb71e: baseline-arm-clabbe 2026-04-14 05:08:37,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28cf0a04df09a44eb71e 2026-04-14 05:08:37,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:37,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28cf0a04df09a44eb71e HTTP/1.1" 200 None 2026-04-14 05:08:37,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:37,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:08:37,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:08:37,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28cf0a04df09a44eb71e HTTP/1.1" 200 None 2026-04-14 05:08:37,112 - lava_callback - ERROR - Error processing callback for node 69db28cf0a04df09a44eb71e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33346 - "GET /node/693f81620d8ce4018da96881%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:09:17,065 - lava_callback - INFO - Received callback for node 69db28f10a04df09a44eb731 INFO: 172.20.0.1:34576 - "POST /node/69db28f10a04df09a44eb731 HTTP/1.0" 202 Accepted 2026-04-14 05:09:17,071 - lava_callback - INFO - Starting async job submit for node 69db28f10a04df09a44eb731 2026-04-14 05:09:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:09:17,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28f10a04df09a44eb731 HTTP/1.1" 200 None 2026-04-14 05:09:17,087 - lava_callback - DEBUG - Processing node 69db28f10a04df09a44eb731: baseline-arm-clabbe 2026-04-14 05:09:17,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db28f10a04df09a44eb731 2026-04-14 05:09:17,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:09:17,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db28f10a04df09a44eb731 HTTP/1.1" 200 None 2026-04-14 05:09:17,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:09:17,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:09:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:09:17,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db28f10a04df09a44eb731 HTTP/1.1" 200 None 2026-04-14 05:09:17,140 - lava_callback - ERROR - Error processing callback for node 69db28f10a04df09a44eb731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46042 - "GET /node/6953085b9912bd6bbcea6fc2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46048 - "GET /node/698623ef177ca0f097bd1c27%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET /node/6988b376e408e9ea60fb1665%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:10:17,328 - lava_callback - INFO - Received callback for node 69db292e0a04df09a44eb793 INFO: 172.20.0.1:54370 - "POST /node/69db292e0a04df09a44eb793 HTTP/1.0" 202 Accepted 2026-04-14 05:10:17,334 - lava_callback - INFO - Starting async job submit for node 69db292e0a04df09a44eb793 2026-04-14 05:10:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:17,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db292e0a04df09a44eb793 HTTP/1.1" 200 None 2026-04-14 05:10:17,350 - lava_callback - DEBUG - Processing node 69db292e0a04df09a44eb793: baseline-arm-clabbe 2026-04-14 05:10:17,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db292e0a04df09a44eb793 2026-04-14 05:10:17,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:17,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db292e0a04df09a44eb793 HTTP/1.1" 200 None 2026-04-14 05:10:17,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:17,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:10:17,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:17,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db292e0a04df09a44eb793 HTTP/1.1" 200 None 2026-04-14 05:10:17,399 - lava_callback - ERROR - Error processing callback for node 69db292e0a04df09a44eb793: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43120 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:10:57,120 - lava_callback - INFO - Received callback for node 69db294f0a04df09a44eb7c4 INFO: 172.20.0.1:43122 - "POST /node/69db294f0a04df09a44eb7c4 HTTP/1.0" 202 Accepted 2026-04-14 05:10:57,126 - lava_callback - INFO - Starting async job submit for node 69db294f0a04df09a44eb7c4 2026-04-14 05:10:57,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db294f0a04df09a44eb7c4 HTTP/1.1" 200 None 2026-04-14 05:10:57,143 - lava_callback - DEBUG - Processing node 69db294f0a04df09a44eb7c4: baseline-arm-clabbe 2026-04-14 05:10:57,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db294f0a04df09a44eb7c4 2026-04-14 05:10:57,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:57,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db294f0a04df09a44eb7c4 HTTP/1.1" 200 None 2026-04-14 05:10:57,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:57,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:10:57,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:10:57,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db294f0a04df09a44eb7c4 HTTP/1.1" 200 None 2026-04-14 05:10:57,205 - lava_callback - ERROR - Error processing callback for node 69db294f0a04df09a44eb7c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:11:30,341 - lava_callback - INFO - Received callback for node 69db29750a04df09a44eb7df INFO: 172.20.0.1:52680 - "POST /node/69db29750a04df09a44eb7df HTTP/1.0" 202 Accepted 2026-04-14 05:11:30,347 - lava_callback - INFO - Starting async job submit for node 69db29750a04df09a44eb7df 2026-04-14 05:11:30,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:11:30,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29750a04df09a44eb7df HTTP/1.1" 200 None 2026-04-14 05:11:30,364 - lava_callback - DEBUG - Processing node 69db29750a04df09a44eb7df: baseline-arm64-baylibre 2026-04-14 05:11:30,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db29750a04df09a44eb7df 2026-04-14 05:11:30,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:11:30,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29750a04df09a44eb7df HTTP/1.1" 200 None 2026-04-14 05:11:30,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:11:30,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:11:30,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:11:30,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db29750a04df09a44eb7df HTTP/1.1" 200 None 2026-04-14 05:11:30,436 - lava_callback - ERROR - Error processing callback for node 69db29750a04df09a44eb7df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:12:37,261 - lava_callback - INFO - Received callback for node 69db29b20a04df09a44eb820 INFO: 172.20.0.1:38708 - "POST /node/69db29b20a04df09a44eb820 HTTP/1.0" 202 Accepted 2026-04-14 05:12:37,266 - lava_callback - INFO - Starting async job submit for node 69db29b20a04df09a44eb820 2026-04-14 05:12:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:37,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29b20a04df09a44eb820 HTTP/1.1" 200 None 2026-04-14 05:12:37,282 - lava_callback - DEBUG - Processing node 69db29b20a04df09a44eb820: baseline-arm-clabbe 2026-04-14 05:12:37,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db29b20a04df09a44eb820 2026-04-14 05:12:37,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:37,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29b20a04df09a44eb820 HTTP/1.1" 200 None 2026-04-14 05:12:37,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:37,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:12:37,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:37,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db29b20a04df09a44eb820 HTTP/1.1" 200 None 2026-04-14 05:12:37,355 - lava_callback - ERROR - Error processing callback for node 69db29b20a04df09a44eb820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37082 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:12:57,212 - lava_callback - INFO - Received callback for node 69db29d60a04df09a44eb854 INFO: 172.20.0.1:37090 - "POST /node/69db29d60a04df09a44eb854 HTTP/1.0" 202 Accepted 2026-04-14 05:12:57,218 - lava_callback - INFO - Starting async job submit for node 69db29d60a04df09a44eb854 2026-04-14 05:12:57,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:57,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29d60a04df09a44eb854 HTTP/1.1" 200 None 2026-04-14 05:12:57,236 - lava_callback - DEBUG - Processing node 69db29d60a04df09a44eb854: baseline-arm-clabbe 2026-04-14 05:12:57,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db29d60a04df09a44eb854 2026-04-14 05:12:57,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:57,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db29d60a04df09a44eb854 HTTP/1.1" 200 None 2026-04-14 05:12:57,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:57,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:12:57,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:12:57,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db29d60a04df09a44eb854 HTTP/1.1" 200 None 2026-04-14 05:12:57,289 - lava_callback - ERROR - Error processing callback for node 69db29d60a04df09a44eb854: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58314 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:13:50,505 - lava_callback - INFO - Received callback for node 69db2a000a04df09a44eb864 INFO: 172.20.0.1:44310 - "POST /node/69db2a000a04df09a44eb864 HTTP/1.0" 202 Accepted 2026-04-14 05:13:50,511 - lava_callback - INFO - Starting async job submit for node 69db2a000a04df09a44eb864 2026-04-14 05:13:50,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:13:50,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a000a04df09a44eb864 HTTP/1.1" 200 None 2026-04-14 05:13:50,533 - lava_callback - DEBUG - Processing node 69db2a000a04df09a44eb864: baseline-arm64-baylibre 2026-04-14 05:13:50,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2a000a04df09a44eb864 2026-04-14 05:13:50,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:13:50,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a000a04df09a44eb864 HTTP/1.1" 200 None 2026-04-14 05:13:50,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:13:50,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:13:50,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:13:50,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2a000a04df09a44eb864 HTTP/1.1" 200 None 2026-04-14 05:13:50,595 - lava_callback - ERROR - Error processing callback for node 69db2a000a04df09a44eb864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55732 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:14:57,348 - lava_callback - INFO - Received callback for node 69db2a3e0a04df09a44eb895 INFO: 172.20.0.1:55748 - "POST /node/69db2a3e0a04df09a44eb895 HTTP/1.0" 202 Accepted 2026-04-14 05:14:57,354 - lava_callback - INFO - Starting async job submit for node 69db2a3e0a04df09a44eb895 2026-04-14 05:14:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:14:57,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a3e0a04df09a44eb895 HTTP/1.1" 200 None 2026-04-14 05:14:57,369 - lava_callback - DEBUG - Processing node 69db2a3e0a04df09a44eb895: baseline-arm-clabbe 2026-04-14 05:14:57,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2a3e0a04df09a44eb895 2026-04-14 05:14:57,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:14:57,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a3e0a04df09a44eb895 HTTP/1.1" 200 None 2026-04-14 05:14:57,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:14:57,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:14:57,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:14:57,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2a3e0a04df09a44eb895 HTTP/1.1" 200 None 2026-04-14 05:14:57,417 - lava_callback - ERROR - Error processing callback for node 69db2a3e0a04df09a44eb895: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34338 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:15:17,305 - lava_callback - INFO - Received callback for node 69db2a5e0a04df09a44eb8c3 INFO: 172.20.0.1:34342 - "POST /node/69db2a5e0a04df09a44eb8c3 HTTP/1.0" 202 Accepted 2026-04-14 05:15:17,314 - lava_callback - INFO - Starting async job submit for node 69db2a5e0a04df09a44eb8c3 2026-04-14 05:15:17,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:15:17,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a5e0a04df09a44eb8c3 HTTP/1.1" 200 None 2026-04-14 05:15:17,332 - lava_callback - DEBUG - Processing node 69db2a5e0a04df09a44eb8c3: baseline-arm-clabbe 2026-04-14 05:15:17,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2a5e0a04df09a44eb8c3 2026-04-14 05:15:17,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:15:17,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a5e0a04df09a44eb8c3 HTTP/1.1" 200 None 2026-04-14 05:15:17,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:15:17,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:15:17,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:15:17,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2a5e0a04df09a44eb8c3 HTTP/1.1" 200 None 2026-04-14 05:15:17,400 - lava_callback - ERROR - Error processing callback for node 69db2a5e0a04df09a44eb8c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48978 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:16:10,671 - lava_callback - INFO - Received callback for node 69db2a890a04df09a44eb8f8 INFO: 172.20.0.1:34120 - "POST /node/69db2a890a04df09a44eb8f8 HTTP/1.0" 202 Accepted 2026-04-14 05:16:10,677 - lava_callback - INFO - Starting async job submit for node 69db2a890a04df09a44eb8f8 2026-04-14 05:16:10,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:10,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a890a04df09a44eb8f8 HTTP/1.1" 200 None 2026-04-14 05:16:10,692 - lava_callback - DEBUG - Processing node 69db2a890a04df09a44eb8f8: baseline-arm64-baylibre 2026-04-14 05:16:10,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2a890a04df09a44eb8f8 2026-04-14 05:16:10,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:10,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2a890a04df09a44eb8f8 HTTP/1.1" 200 None 2026-04-14 05:16:10,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:10,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:16:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:10,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2a890a04df09a44eb8f8 HTTP/1.1" 200 None 2026-04-14 05:16:10,739 - lava_callback - ERROR - Error processing callback for node 69db2a890a04df09a44eb8f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET /node/695c65e75dac150a0e83cd97%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:16:57,442 - lava_callback - INFO - Received callback for node 69db2ac00a04df09a44eb93c INFO: 172.20.0.1:41832 - "POST /node/69db2ac00a04df09a44eb93c HTTP/1.0" 202 Accepted 2026-04-14 05:16:57,448 - lava_callback - INFO - Starting async job submit for node 69db2ac00a04df09a44eb93c 2026-04-14 05:16:57,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:57,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ac00a04df09a44eb93c HTTP/1.1" 200 None 2026-04-14 05:16:57,464 - lava_callback - DEBUG - Processing node 69db2ac00a04df09a44eb93c: baseline-arm-clabbe 2026-04-14 05:16:57,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2ac00a04df09a44eb93c 2026-04-14 05:16:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:57,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ac00a04df09a44eb93c HTTP/1.1" 200 None 2026-04-14 05:16:57,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:57,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:16:57,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:16:57,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2ac00a04df09a44eb93c HTTP/1.1" 200 None 2026-04-14 05:16:57,513 - lava_callback - ERROR - Error processing callback for node 69db2ac00a04df09a44eb93c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:17:37,553 - lava_callback - INFO - Received callback for node 69db2ae20a04df09a44eb983 INFO: 172.20.0.1:36332 - "POST /node/69db2ae20a04df09a44eb983 HTTP/1.0" 202 Accepted 2026-04-14 05:17:37,559 - lava_callback - INFO - Starting async job submit for node 69db2ae20a04df09a44eb983 2026-04-14 05:17:37,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:17:37,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ae20a04df09a44eb983 HTTP/1.1" 200 None 2026-04-14 05:17:37,579 - lava_callback - DEBUG - Processing node 69db2ae20a04df09a44eb983: baseline-arm-clabbe 2026-04-14 05:17:37,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2ae20a04df09a44eb983 2026-04-14 05:17:37,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:17:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ae20a04df09a44eb983 HTTP/1.1" 200 None 2026-04-14 05:17:37,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:17:37,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:17:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:17:37,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2ae20a04df09a44eb983 HTTP/1.1" 200 None 2026-04-14 05:17:37,627 - lava_callback - ERROR - Error processing callback for node 69db2ae20a04df09a44eb983: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38734 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:18:17,574 - lava_callback - INFO - Received callback for node 69db2b050a04df09a44eb999 INFO: 172.20.0.1:38744 - "POST /node/69db2b050a04df09a44eb999 HTTP/1.0" 202 Accepted 2026-04-14 05:18:17,580 - lava_callback - INFO - Starting async job submit for node 69db2b050a04df09a44eb999 2026-04-14 05:18:17,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:17,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b050a04df09a44eb999 HTTP/1.1" 200 None 2026-04-14 05:18:17,622 - lava_callback - DEBUG - Processing node 69db2b050a04df09a44eb999: baseline-arm-clabbe 2026-04-14 05:18:17,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2b050a04df09a44eb999 2026-04-14 05:18:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:17,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b050a04df09a44eb999 HTTP/1.1" 200 None 2026-04-14 05:18:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:17,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d14d2f20cf7d61e8b62a HTTP/1.1" 200 None 2026-04-14 05:18:17,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:17,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2b050a04df09a44eb999 HTTP/1.1" 200 None 2026-04-14 05:18:17,674 - lava_callback - ERROR - Error processing callback for node 69db2b050a04df09a44eb999: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:18:50,754 - lava_callback - INFO - Received callback for node 69db2b310a04df09a44eb9af INFO: 172.20.0.1:60902 - "POST /node/69db2b310a04df09a44eb9af HTTP/1.0" 202 Accepted 2026-04-14 05:18:50,759 - lava_callback - INFO - Starting async job submit for node 69db2b310a04df09a44eb9af 2026-04-14 05:18:50,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:50,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b310a04df09a44eb9af HTTP/1.1" 200 None 2026-04-14 05:18:50,775 - lava_callback - DEBUG - Processing node 69db2b310a04df09a44eb9af: baseline-arm64-baylibre 2026-04-14 05:18:50,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2b310a04df09a44eb9af 2026-04-14 05:18:50,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:50,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b310a04df09a44eb9af HTTP/1.1" 200 None 2026-04-14 05:18:50,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:18:50,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:18:50,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2b310a04df09a44eb9af HTTP/1.1" 200 None 2026-04-14 05:18:50,826 - lava_callback - ERROR - Error processing callback for node 69db2b310a04df09a44eb9af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50594 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:20:10,825 - lava_callback - INFO - Received callback for node 69db2b750a04df09a44eb9d7 INFO: 172.20.0.1:59318 - "POST /node/69db2b750a04df09a44eb9d7 HTTP/1.0" 202 Accepted 2026-04-14 05:20:10,831 - lava_callback - INFO - Starting async job submit for node 69db2b750a04df09a44eb9d7 2026-04-14 05:20:10,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:20:10,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b750a04df09a44eb9d7 HTTP/1.1" 200 None 2026-04-14 05:20:10,847 - lava_callback - DEBUG - Processing node 69db2b750a04df09a44eb9d7: baseline-arm64-baylibre 2026-04-14 05:20:10,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2b750a04df09a44eb9d7 2026-04-14 05:20:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:20:10,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2b750a04df09a44eb9d7 HTTP/1.1" 200 None 2026-04-14 05:20:10,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:20:10,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:20:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:20:10,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2b750a04df09a44eb9d7 HTTP/1.1" 200 None 2026-04-14 05:20:10,894 - lava_callback - ERROR - Error processing callback for node 69db2b750a04df09a44eb9d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56408 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:21:10,865 - lava_callback - INFO - Received callback for node 69db2bbc0a04df09a44eba33 INFO: 172.20.0.1:51048 - "POST /node/69db2bbc0a04df09a44eba33 HTTP/1.0" 202 Accepted 2026-04-14 05:21:10,870 - lava_callback - INFO - Starting async job submit for node 69db2bbc0a04df09a44eba33 2026-04-14 05:21:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:21:10,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2bbc0a04df09a44eba33 HTTP/1.1" 200 None 2026-04-14 05:21:10,889 - lava_callback - DEBUG - Processing node 69db2bbc0a04df09a44eba33: baseline-arm64-baylibre 2026-04-14 05:21:10,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2bbc0a04df09a44eba33 2026-04-14 05:21:10,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:21:10,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2bbc0a04df09a44eba33 HTTP/1.1" 200 None 2026-04-14 05:21:10,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:21:10,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:21:10,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:21:10,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2bbc0a04df09a44eba33 HTTP/1.1" 200 None 2026-04-14 05:21:10,963 - lava_callback - ERROR - Error processing callback for node 69db2bbc0a04df09a44eba33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:22:10,980 - lava_callback - INFO - Received callback for node 69db2c010a04df09a44eba6e INFO: 172.20.0.1:52026 - "POST /node/69db2c010a04df09a44eba6e HTTP/1.0" 202 Accepted 2026-04-14 05:22:10,988 - lava_callback - INFO - Starting async job submit for node 69db2c010a04df09a44eba6e 2026-04-14 05:22:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:22:11,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c010a04df09a44eba6e HTTP/1.1" 200 None 2026-04-14 05:22:11,005 - lava_callback - DEBUG - Processing node 69db2c010a04df09a44eba6e: baseline-arm64-baylibre 2026-04-14 05:22:11,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2c010a04df09a44eba6e 2026-04-14 05:22:11,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:22:11,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c010a04df09a44eba6e HTTP/1.1" 200 None 2026-04-14 05:22:11,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:22:11,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:22:11,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:22:11,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2c010a04df09a44eba6e HTTP/1.1" 200 None 2026-04-14 05:22:11,069 - lava_callback - ERROR - Error processing callback for node 69db2c010a04df09a44eba6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52058 - "GET /node/69d8491cb28893fa2e231562%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47754 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:23:37,818 - lava_callback - INFO - Received callback for node 69db2c450a04df09a44ebad8 INFO: 172.20.0.1:47762 - "POST /node/69db2c450a04df09a44ebad8 HTTP/1.0" 202 Accepted 2026-04-14 05:23:37,824 - lava_callback - INFO - Starting async job submit for node 69db2c450a04df09a44ebad8 2026-04-14 05:23:37,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:23:37,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c450a04df09a44ebad8 HTTP/1.1" 200 None 2026-04-14 05:23:37,875 - lava_callback - DEBUG - Processing node 69db2c450a04df09a44ebad8: baseline-arm64-clabbe 2026-04-14 05:23:37,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2c450a04df09a44ebad8 2026-04-14 05:23:37,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:23:37,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c450a04df09a44ebad8 HTTP/1.1" 200 None 2026-04-14 05:23:37,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:23:37,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:23:37,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:23:37,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2c450a04df09a44ebad8 HTTP/1.1" 200 None 2026-04-14 05:23:37,927 - lava_callback - ERROR - Error processing callback for node 69db2c450a04df09a44ebad8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET /node/695c67865dac150a0e83cebf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:24:31,073 - lava_callback - INFO - Received callback for node 69db2c870a04df09a44ebb17 INFO: 172.20.0.1:38772 - "POST /node/69db2c870a04df09a44ebb17 HTTP/1.0" 202 Accepted 2026-04-14 05:24:31,079 - lava_callback - INFO - Starting async job submit for node 69db2c870a04df09a44ebb17 2026-04-14 05:24:31,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:24:31,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c870a04df09a44ebb17 HTTP/1.1" 200 None 2026-04-14 05:24:31,095 - lava_callback - DEBUG - Processing node 69db2c870a04df09a44ebb17: baseline-arm64-baylibre 2026-04-14 05:24:31,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2c870a04df09a44ebb17 2026-04-14 05:24:31,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:24:31,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2c870a04df09a44ebb17 HTTP/1.1" 200 None 2026-04-14 05:24:31,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:24:31,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:24:31,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:24:31,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2c870a04df09a44ebb17 HTTP/1.1" 200 None 2026-04-14 05:24:31,142 - lava_callback - ERROR - Error processing callback for node 69db2c870a04df09a44ebb17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55226 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:25:57,902 - lava_callback - INFO - Received callback for node 69db2cd30a04df09a44ebb4d INFO: 172.20.0.1:55232 - "POST /node/69db2cd30a04df09a44ebb4d HTTP/1.0" 202 Accepted 2026-04-14 05:25:57,908 - lava_callback - INFO - Starting async job submit for node 69db2cd30a04df09a44ebb4d 2026-04-14 05:25:57,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:25:57,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2cd30a04df09a44ebb4d HTTP/1.1" 200 None 2026-04-14 05:25:57,930 - lava_callback - DEBUG - Processing node 69db2cd30a04df09a44ebb4d: baseline-arm64-clabbe 2026-04-14 05:25:57,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2cd30a04df09a44ebb4d 2026-04-14 05:25:57,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:25:57,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2cd30a04df09a44ebb4d HTTP/1.1" 200 None 2026-04-14 05:25:58,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:25:58,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:25:58,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:25:58,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2cd30a04df09a44ebb4d HTTP/1.1" 200 None 2026-04-14 05:25:58,056 - lava_callback - ERROR - Error processing callback for node 69db2cd30a04df09a44ebb4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48528 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:26:51,190 - lava_callback - INFO - Received callback for node 69db2d140a04df09a44ebb85 INFO: 172.20.0.1:32888 - "POST /node/69db2d140a04df09a44ebb85 HTTP/1.0" 202 Accepted 2026-04-14 05:26:51,196 - lava_callback - INFO - Starting async job submit for node 69db2d140a04df09a44ebb85 2026-04-14 05:26:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:26:51,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2d140a04df09a44ebb85 HTTP/1.1" 200 None 2026-04-14 05:26:51,216 - lava_callback - DEBUG - Processing node 69db2d140a04df09a44ebb85: baseline-arm64-baylibre 2026-04-14 05:26:51,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2d140a04df09a44ebb85 2026-04-14 05:26:51,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:26:51,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2d140a04df09a44ebb85 HTTP/1.1" 200 None 2026-04-14 05:26:51,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:26:51,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:26:51,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:26:51,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2d140a04df09a44ebb85 HTTP/1.1" 200 None 2026-04-14 05:26:51,265 - lava_callback - ERROR - Error processing callback for node 69db2d140a04df09a44ebb85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32906 - "GET /node/695224ec5318368af0c485e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59336 - "GET /node/693784160c55536e7dddb8bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:27:51,222 - lava_callback - INFO - Received callback for node 69db2d540a04df09a44ebbda INFO: 172.20.0.1:50634 - "POST /node/69db2d540a04df09a44ebbda HTTP/1.0" 202 Accepted 2026-04-14 05:27:51,227 - lava_callback - INFO - Starting async job submit for node 69db2d540a04df09a44ebbda 2026-04-14 05:27:51,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:27:51,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2d540a04df09a44ebbda HTTP/1.1" 200 None 2026-04-14 05:27:51,243 - lava_callback - DEBUG - Processing node 69db2d540a04df09a44ebbda: baseline-arm64-baylibre 2026-04-14 05:27:51,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2d540a04df09a44ebbda 2026-04-14 05:27:51,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:27:51,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2d540a04df09a44ebbda HTTP/1.1" 200 None 2026-04-14 05:27:51,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:27:51,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:27:51,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:27:51,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2d540a04df09a44ebbda HTTP/1.1" 200 None 2026-04-14 05:27:51,300 - lava_callback - ERROR - Error processing callback for node 69db2d540a04df09a44ebbda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:29:18,050 - lava_callback - INFO - Received callback for node 69db2da20a04df09a44ebc18 INFO: 172.20.0.1:52144 - "POST /node/69db2da20a04df09a44ebc18 HTTP/1.0" 202 Accepted 2026-04-14 05:29:18,055 - lava_callback - INFO - Starting async job submit for node 69db2da20a04df09a44ebc18 2026-04-14 05:29:18,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:29:18,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2da20a04df09a44ebc18 HTTP/1.1" 200 None 2026-04-14 05:29:18,072 - lava_callback - DEBUG - Processing node 69db2da20a04df09a44ebc18: baseline-arm64-clabbe 2026-04-14 05:29:18,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2da20a04df09a44ebc18 2026-04-14 05:29:18,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:29:18,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2da20a04df09a44ebc18 HTTP/1.1" 200 None 2026-04-14 05:29:18,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:29:18,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:29:18,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:29:18,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2da20a04df09a44ebc18 HTTP/1.1" 200 None 2026-04-14 05:29:18,132 - lava_callback - ERROR - Error processing callback for node 69db2da20a04df09a44ebc18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46988 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:30:31,642 - lava_callback - INFO - Received callback for node 69db2de40a04df09a44ebc3e INFO: 172.20.0.1:44796 - "POST /node/69db2de40a04df09a44ebc3e HTTP/1.0" 202 Accepted 2026-04-14 05:30:31,648 - lava_callback - INFO - Starting async job submit for node 69db2de40a04df09a44ebc3e 2026-04-14 05:30:31,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:30:31,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2de40a04df09a44ebc3e HTTP/1.1" 200 None 2026-04-14 05:30:31,664 - lava_callback - DEBUG - Processing node 69db2de40a04df09a44ebc3e: baseline-arm64-baylibre 2026-04-14 05:30:31,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2de40a04df09a44ebc3e 2026-04-14 05:30:31,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:30:31,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2de40a04df09a44ebc3e HTTP/1.1" 200 None 2026-04-14 05:30:31,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:30:31,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:30:31,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:30:31,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2de40a04df09a44ebc3e HTTP/1.1" 200 None 2026-04-14 05:30:31,718 - lava_callback - ERROR - Error processing callback for node 69db2de40a04df09a44ebc3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37316 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:31:38,135 - lava_callback - INFO - Received callback for node 69db2e310a04df09a44ebc7f INFO: 172.20.0.1:37320 - "POST /node/69db2e310a04df09a44ebc7f HTTP/1.0" 202 Accepted 2026-04-14 05:31:38,142 - lava_callback - INFO - Starting async job submit for node 69db2e310a04df09a44ebc7f 2026-04-14 05:31:38,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:31:38,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2e310a04df09a44ebc7f HTTP/1.1" 200 None 2026-04-14 05:31:38,161 - lava_callback - DEBUG - Processing node 69db2e310a04df09a44ebc7f: baseline-arm64-clabbe 2026-04-14 05:31:38,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2e310a04df09a44ebc7f 2026-04-14 05:31:38,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:31:38,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2e310a04df09a44ebc7f HTTP/1.1" 200 None 2026-04-14 05:31:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:31:38,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:31:38,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:31:38,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2e310a04df09a44ebc7f HTTP/1.1" 200 None 2026-04-14 05:31:38,212 - lava_callback - ERROR - Error processing callback for node 69db2e310a04df09a44ebc7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42236 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:32:38,194 - lava_callback - INFO - Received callback for node 69db2e6b0a04df09a44ebcf0 INFO: 172.20.0.1:42244 - "POST /node/69db2e6b0a04df09a44ebcf0 HTTP/1.0" 202 Accepted 2026-04-14 05:32:38,199 - lava_callback - INFO - Starting async job submit for node 69db2e6b0a04df09a44ebcf0 2026-04-14 05:32:38,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:32:38,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2e6b0a04df09a44ebcf0 HTTP/1.1" 200 None 2026-04-14 05:32:38,224 - lava_callback - DEBUG - Processing node 69db2e6b0a04df09a44ebcf0: baseline-arm64-clabbe 2026-04-14 05:32:38,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2e6b0a04df09a44ebcf0 2026-04-14 05:32:38,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:32:38,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2e6b0a04df09a44ebcf0 HTTP/1.1" 200 None 2026-04-14 05:32:38,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:32:38,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:32:38,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:32:38,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2e6b0a04df09a44ebcf0 HTTP/1.1" 200 None 2026-04-14 05:32:38,273 - lava_callback - ERROR - Error processing callback for node 69db2e6b0a04df09a44ebcf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42588 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:33:31,597 - lava_callback - INFO - Received callback for node 69db2ea20a04df09a44ebd36 INFO: 172.20.0.1:47138 - "POST /node/69db2ea20a04df09a44ebd36 HTTP/1.0" 202 Accepted 2026-04-14 05:33:31,603 - lava_callback - INFO - Starting async job submit for node 69db2ea20a04df09a44ebd36 2026-04-14 05:33:31,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:33:31,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ea20a04df09a44ebd36 HTTP/1.1" 200 None 2026-04-14 05:33:31,619 - lava_callback - DEBUG - Processing node 69db2ea20a04df09a44ebd36: baseline-arm64-baylibre 2026-04-14 05:33:31,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2ea20a04df09a44ebd36 2026-04-14 05:33:31,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:33:31,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ea20a04df09a44ebd36 HTTP/1.1" 200 None 2026-04-14 05:33:31,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:33:31,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:33:31,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:33:31,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2ea20a04df09a44ebd36 HTTP/1.1" 200 None 2026-04-14 05:33:31,677 - lava_callback - ERROR - Error processing callback for node 69db2ea20a04df09a44ebd36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46924 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:34:38,190 - lava_callback - INFO - Received callback for node 69db2ee90a04df09a44ebdb5 INFO: 172.20.0.1:46926 - "POST /node/69db2ee90a04df09a44ebdb5 HTTP/1.0" 202 Accepted 2026-04-14 05:34:38,196 - lava_callback - INFO - Starting async job submit for node 69db2ee90a04df09a44ebdb5 2026-04-14 05:34:38,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:34:38,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ee90a04df09a44ebdb5 HTTP/1.1" 200 None 2026-04-14 05:34:38,217 - lava_callback - DEBUG - Processing node 69db2ee90a04df09a44ebdb5: baseline-arm64-clabbe 2026-04-14 05:34:38,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2ee90a04df09a44ebdb5 2026-04-14 05:34:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:34:38,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ee90a04df09a44ebdb5 HTTP/1.1" 200 None 2026-04-14 05:34:38,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:34:38,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:34:38,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:34:38,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2ee90a04df09a44ebdb5 HTTP/1.1" 200 None 2026-04-14 05:34:38,272 - lava_callback - ERROR - Error processing callback for node 69db2ee90a04df09a44ebdb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:35:58,273 - lava_callback - INFO - Received callback for node 69db2f2e0a04df09a44ebdf1 INFO: 172.20.0.1:46468 - "POST /node/69db2f2e0a04df09a44ebdf1 HTTP/1.0" 202 Accepted 2026-04-14 05:35:58,279 - lava_callback - INFO - Starting async job submit for node 69db2f2e0a04df09a44ebdf1 2026-04-14 05:35:58,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:35:58,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2f2e0a04df09a44ebdf1 HTTP/1.1" 200 None 2026-04-14 05:35:58,302 - lava_callback - DEBUG - Processing node 69db2f2e0a04df09a44ebdf1: baseline-arm64-clabbe 2026-04-14 05:35:58,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2f2e0a04df09a44ebdf1 2026-04-14 05:35:58,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:35:58,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2f2e0a04df09a44ebdf1 HTTP/1.1" 200 None 2026-04-14 05:35:58,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:35:58,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:35:58,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:35:58,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2f2e0a04df09a44ebdf1 HTTP/1.1" 200 None 2026-04-14 05:35:58,359 - lava_callback - ERROR - Error processing callback for node 69db2f2e0a04df09a44ebdf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:36:58,268 - lava_callback - INFO - Received callback for node 69db2f750a04df09a44ebe37 INFO: 172.20.0.1:37868 - "POST /node/69db2f750a04df09a44ebe37 HTTP/1.0" 202 Accepted 2026-04-14 05:36:58,274 - lava_callback - INFO - Starting async job submit for node 69db2f750a04df09a44ebe37 2026-04-14 05:36:58,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:36:58,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2f750a04df09a44ebe37 HTTP/1.1" 200 None 2026-04-14 05:36:58,293 - lava_callback - DEBUG - Processing node 69db2f750a04df09a44ebe37: baseline-arm64-clabbe 2026-04-14 05:36:58,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2f750a04df09a44ebe37 2026-04-14 05:36:58,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:36:58,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2f750a04df09a44ebe37 HTTP/1.1" 200 None 2026-04-14 05:36:58,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:36:58,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:36:58,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:36:58,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2f750a04df09a44ebe37 HTTP/1.1" 200 None 2026-04-14 05:36:58,359 - lava_callback - ERROR - Error processing callback for node 69db2f750a04df09a44ebe37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:37:56,750 - lava_callback - INFO - Received callback for node 69dd9cffc2164e674d72091a INFO: 172.20.0.1:39608 - "POST /node/69dd9cffc2164e674d72091a HTTP/1.0" 202 Accepted 2026-04-14 05:37:56,756 - lava_callback - INFO - Starting async job submit for node 69dd9cffc2164e674d72091a 2026-04-14 05:37:56,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:37:56,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cffc2164e674d72091a HTTP/1.1" 200 None 2026-04-14 05:37:56,791 - lava_callback - DEBUG - Processing node 69dd9cffc2164e674d72091a: baseline-arm64 2026-04-14 05:37:57,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 05:37:57,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 05:37:57,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9cffc2164e674d72091a/log.txt.gz 2026-04-14 05:37:57,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 05:37:57,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 05:37:57,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9cffc2164e674d72091a/lava-logs.yaml 2026-04-14 05:37:57,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 05:37:58,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 05:37:58,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dd9cffc2164e674d72091a/lava_callback.json.gz 2026-04-14 05:37:58,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:37:58,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cffc2164e674d72091a HTTP/1.1" 200 None 2026-04-14 05:37:58,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:37:58,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 05:37:58,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:37:58,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9cffc2164e674d72091a HTTP/1.1" 200 None 2026-04-14 05:37:58,316 - lava_callback - INFO - Completed processing callback for node 69dd9cffc2164e674d72091a INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:38:07,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:38:07,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-14 05:38:11,856 - lava_callback - INFO - Received callback for node 69db2fb20a04df09a44ebe6c INFO: 172.20.0.1:37142 - "POST /node/69db2fb20a04df09a44ebe6c HTTP/1.0" 202 Accepted 2026-04-14 05:38:11,861 - lava_callback - INFO - Starting async job submit for node 69db2fb20a04df09a44ebe6c 2026-04-14 05:38:11,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:38:11,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2fb20a04df09a44ebe6c HTTP/1.1" 200 None 2026-04-14 05:38:11,877 - lava_callback - DEBUG - Processing node 69db2fb20a04df09a44ebe6c: baseline-arm64-baylibre 2026-04-14 05:38:11,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2fb20a04df09a44ebe6c 2026-04-14 05:38:11,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:38:11,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2fb20a04df09a44ebe6c HTTP/1.1" 200 None 2026-04-14 05:38:11,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:38:11,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:38:11,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:38:11,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2fb20a04df09a44ebe6c HTTP/1.1" 200 None 2026-04-14 05:38:11,952 - lava_callback - ERROR - Error processing callback for node 69db2fb20a04df09a44ebe6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:39:18,375 - lava_callback - INFO - Received callback for node 69db2ffb0a04df09a44ebeb1 INFO: 172.20.0.1:40116 - "POST /node/69db2ffb0a04df09a44ebeb1 HTTP/1.0" 202 Accepted 2026-04-14 05:39:18,381 - lava_callback - INFO - Starting async job submit for node 69db2ffb0a04df09a44ebeb1 2026-04-14 05:39:18,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:39:18,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ffb0a04df09a44ebeb1 HTTP/1.1" 200 None 2026-04-14 05:39:18,397 - lava_callback - DEBUG - Processing node 69db2ffb0a04df09a44ebeb1: baseline-arm64-clabbe 2026-04-14 05:39:18,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db2ffb0a04df09a44ebeb1 2026-04-14 05:39:18,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:39:18,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db2ffb0a04df09a44ebeb1 HTTP/1.1" 200 None 2026-04-14 05:39:18,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:39:18,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:39:18,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:39:18,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db2ffb0a04df09a44ebeb1 HTTP/1.1" 200 None 2026-04-14 05:39:18,465 - lava_callback - ERROR - Error processing callback for node 69db2ffb0a04df09a44ebeb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44288 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:40:32,034 - lava_callback - INFO - Received callback for node 69db303b0a04df09a44ebee5 INFO: 172.20.0.1:40578 - "POST /node/69db303b0a04df09a44ebee5 HTTP/1.0" 202 Accepted 2026-04-14 05:40:32,040 - lava_callback - INFO - Starting async job submit for node 69db303b0a04df09a44ebee5 2026-04-14 05:40:32,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:40:32,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db303b0a04df09a44ebee5 HTTP/1.1" 200 None 2026-04-14 05:40:32,056 - lava_callback - DEBUG - Processing node 69db303b0a04df09a44ebee5: baseline-arm64-baylibre 2026-04-14 05:40:32,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db303b0a04df09a44ebee5 2026-04-14 05:40:32,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:40:32,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db303b0a04df09a44ebee5 HTTP/1.1" 200 None 2026-04-14 05:40:32,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:40:32,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:40:32,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:40:32,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db303b0a04df09a44ebee5 HTTP/1.1" 200 None 2026-04-14 05:40:32,117 - lava_callback - ERROR - Error processing callback for node 69db303b0a04df09a44ebee5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58214 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:41:38,521 - lava_callback - INFO - Received callback for node 69db30820a04df09a44ebf33 INFO: 172.20.0.1:58218 - "POST /node/69db30820a04df09a44ebf33 HTTP/1.0" 202 Accepted 2026-04-14 05:41:38,527 - lava_callback - INFO - Starting async job submit for node 69db30820a04df09a44ebf33 2026-04-14 05:41:38,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:41:38,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db30820a04df09a44ebf33 HTTP/1.1" 200 None 2026-04-14 05:41:38,542 - lava_callback - DEBUG - Processing node 69db30820a04df09a44ebf33: baseline-arm64-clabbe 2026-04-14 05:41:38,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db30820a04df09a44ebf33 2026-04-14 05:41:38,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:41:38,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db30820a04df09a44ebf33 HTTP/1.1" 200 None 2026-04-14 05:41:38,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:41:38,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:41:38,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:41:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db30820a04df09a44ebf33 HTTP/1.1" 200 None 2026-04-14 05:41:38,594 - lava_callback - ERROR - Error processing callback for node 69db30820a04df09a44ebf33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:42:38,487 - lava_callback - INFO - Received callback for node 69db30c70a04df09a44ebf82 INFO: 172.20.0.1:52752 - "POST /node/69db30c70a04df09a44ebf82 HTTP/1.0" 202 Accepted 2026-04-14 05:42:38,492 - lava_callback - INFO - Starting async job submit for node 69db30c70a04df09a44ebf82 2026-04-14 05:42:38,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:42:38,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db30c70a04df09a44ebf82 HTTP/1.1" 200 None 2026-04-14 05:42:38,538 - lava_callback - DEBUG - Processing node 69db30c70a04df09a44ebf82: baseline-arm64-clabbe 2026-04-14 05:42:38,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db30c70a04df09a44ebf82 2026-04-14 05:42:38,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:42:38,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db30c70a04df09a44ebf82 HTTP/1.1" 200 None 2026-04-14 05:42:38,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:42:38,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:42:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:42:38,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db30c70a04df09a44ebf82 HTTP/1.1" 200 None 2026-04-14 05:42:38,619 - lava_callback - ERROR - Error processing callback for node 69db30c70a04df09a44ebf82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:50:32,627 - lava_callback - INFO - Received callback for node 69db32990a04df09a44ec157 INFO: 172.20.0.1:36838 - "POST /node/69db32990a04df09a44ec157 HTTP/1.0" 202 Accepted 2026-04-14 05:50:32,632 - lava_callback - INFO - Starting async job submit for node 69db32990a04df09a44ec157 2026-04-14 05:50:32,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:50:32,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db32990a04df09a44ec157 HTTP/1.1" 200 None 2026-04-14 05:50:32,648 - lava_callback - DEBUG - Processing node 69db32990a04df09a44ec157: baseline-arm64-baylibre 2026-04-14 05:50:32,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db32990a04df09a44ec157 2026-04-14 05:50:32,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:50:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db32990a04df09a44ec157 HTTP/1.1" 200 None 2026-04-14 05:50:32,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:50:32,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:50:32,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:50:32,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db32990a04df09a44ec157 HTTP/1.1" 200 None 2026-04-14 05:50:32,695 - lava_callback - ERROR - Error processing callback for node 69db32990a04df09a44ec157: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54254 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:51:32,520 - lava_callback - INFO - Received callback for node 69db32de0a04df09a44ec1a7 INFO: 172.20.0.1:59810 - "POST /node/69db32de0a04df09a44ec1a7 HTTP/1.0" 202 Accepted 2026-04-14 05:51:32,526 - lava_callback - INFO - Starting async job submit for node 69db32de0a04df09a44ec1a7 2026-04-14 05:51:32,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:51:32,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db32de0a04df09a44ec1a7 HTTP/1.1" 200 None 2026-04-14 05:51:32,542 - lava_callback - DEBUG - Processing node 69db32de0a04df09a44ec1a7: baseline-arm64-baylibre 2026-04-14 05:51:32,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db32de0a04df09a44ec1a7 2026-04-14 05:51:32,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:51:32,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db32de0a04df09a44ec1a7 HTTP/1.1" 200 None 2026-04-14 05:51:32,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:51:32,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:51:32,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:51:32,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db32de0a04df09a44ec1a7 HTTP/1.1" 200 None 2026-04-14 05:51:32,590 - lava_callback - ERROR - Error processing callback for node 69db32de0a04df09a44ec1a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51190 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:54:52,733 - lava_callback - INFO - Received callback for node 69db33a80a04df09a44ec2a2 INFO: 172.20.0.1:60262 - "POST /node/69db33a80a04df09a44ec2a2 HTTP/1.0" 202 Accepted 2026-04-14 05:54:52,738 - lava_callback - INFO - Starting async job submit for node 69db33a80a04df09a44ec2a2 2026-04-14 05:54:52,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:54:52,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db33a80a04df09a44ec2a2 HTTP/1.1" 200 None 2026-04-14 05:54:52,753 - lava_callback - DEBUG - Processing node 69db33a80a04df09a44ec2a2: baseline-arm64-baylibre 2026-04-14 05:54:52,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db33a80a04df09a44ec2a2 2026-04-14 05:54:52,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:54:52,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db33a80a04df09a44ec2a2 HTTP/1.1" 200 None 2026-04-14 05:54:52,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:54:52,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:54:52,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:54:52,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db33a80a04df09a44ec2a2 HTTP/1.1" 200 None 2026-04-14 05:54:52,820 - lava_callback - ERROR - Error processing callback for node 69db33a80a04df09a44ec2a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:55:59,079 - lava_callback - INFO - Received callback for node 69db33e80a04df09a44ec30b INFO: 172.20.0.1:49322 - "POST /node/69db33e80a04df09a44ec30b HTTP/1.0" 202 Accepted 2026-04-14 05:55:59,084 - lava_callback - INFO - Starting async job submit for node 69db33e80a04df09a44ec30b 2026-04-14 05:55:59,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:55:59,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db33e80a04df09a44ec30b HTTP/1.1" 200 None 2026-04-14 05:55:59,106 - lava_callback - DEBUG - Processing node 69db33e80a04df09a44ec30b: baseline-arm64-clabbe 2026-04-14 05:55:59,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db33e80a04df09a44ec30b 2026-04-14 05:55:59,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:55:59,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db33e80a04df09a44ec30b HTTP/1.1" 200 None 2026-04-14 05:55:59,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:55:59,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 05:55:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:55:59,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db33e80a04df09a44ec30b HTTP/1.1" 200 None 2026-04-14 05:55:59,159 - lava_callback - ERROR - Error processing callback for node 69db33e80a04df09a44ec30b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38500 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:57:19,130 - lava_callback - INFO - Received callback for node 69db34320a04df09a44ec33a INFO: 172.20.0.1:38502 - "POST /node/69db34320a04df09a44ec33a HTTP/1.0" 202 Accepted 2026-04-14 05:57:19,135 - lava_callback - INFO - Starting async job submit for node 69db34320a04df09a44ec33a 2026-04-14 05:57:19,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:57:19,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34320a04df09a44ec33a HTTP/1.1" 200 None 2026-04-14 05:57:19,152 - lava_callback - DEBUG - Processing node 69db34320a04df09a44ec33a: baseline-arm64-clabbe 2026-04-14 05:57:19,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db34320a04df09a44ec33a 2026-04-14 05:57:19,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:57:19,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34320a04df09a44ec33a HTTP/1.1" 200 None 2026-04-14 05:57:19,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:57:19,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:57:19,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:57:19,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db34320a04df09a44ec33a HTTP/1.1" 200 None 2026-04-14 05:57:19,200 - lava_callback - ERROR - Error processing callback for node 69db34320a04df09a44ec33a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38102 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:58:39,198 - lava_callback - INFO - Received callback for node 69db34790a04df09a44ec377 INFO: 172.20.0.1:38106 - "POST /node/69db34790a04df09a44ec377 HTTP/1.0" 202 Accepted 2026-04-14 05:58:39,203 - lava_callback - INFO - Starting async job submit for node 69db34790a04df09a44ec377 2026-04-14 05:58:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:58:39,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34790a04df09a44ec377 HTTP/1.1" 200 None 2026-04-14 05:58:39,218 - lava_callback - DEBUG - Processing node 69db34790a04df09a44ec377: baseline-arm64-clabbe 2026-04-14 05:58:39,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db34790a04df09a44ec377 2026-04-14 05:58:39,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:58:39,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34790a04df09a44ec377 HTTP/1.1" 200 None 2026-04-14 05:58:39,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:58:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:58:39,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:58:39,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db34790a04df09a44ec377 HTTP/1.1" 200 None 2026-04-14 05:58:39,276 - lava_callback - ERROR - Error processing callback for node 69db34790a04df09a44ec377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40930 - "GET / HTTP/1.0" 200 OK 2026-04-14 05:59:39,227 - lava_callback - INFO - Received callback for node 69db34be0a04df09a44ec3c9 INFO: 172.20.0.1:40936 - "POST /node/69db34be0a04df09a44ec3c9 HTTP/1.0" 202 Accepted 2026-04-14 05:59:39,233 - lava_callback - INFO - Starting async job submit for node 69db34be0a04df09a44ec3c9 2026-04-14 05:59:39,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:59:39,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34be0a04df09a44ec3c9 HTTP/1.1" 200 None 2026-04-14 05:59:39,251 - lava_callback - DEBUG - Processing node 69db34be0a04df09a44ec3c9: baseline-arm64-clabbe 2026-04-14 05:59:39,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db34be0a04df09a44ec3c9 2026-04-14 05:59:39,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:59:39,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db34be0a04df09a44ec3c9 HTTP/1.1" 200 None 2026-04-14 05:59:39,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:59:39,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 05:59:39,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 05:59:39,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db34be0a04df09a44ec3c9 HTTP/1.1" 200 None 2026-04-14 05:59:39,303 - lava_callback - ERROR - Error processing callback for node 69db34be0a04df09a44ec3c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:00:39,263 - lava_callback - INFO - Received callback for node 69db35040a04df09a44ec40e INFO: 172.20.0.1:54134 - "POST /node/69db35040a04df09a44ec40e HTTP/1.0" 202 Accepted 2026-04-14 06:00:39,269 - lava_callback - INFO - Starting async job submit for node 69db35040a04df09a44ec40e 2026-04-14 06:00:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:00:39,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db35040a04df09a44ec40e HTTP/1.1" 200 None 2026-04-14 06:00:39,296 - lava_callback - DEBUG - Processing node 69db35040a04df09a44ec40e: baseline-arm64-clabbe 2026-04-14 06:00:39,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db35040a04df09a44ec40e 2026-04-14 06:00:39,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:00:39,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db35040a04df09a44ec40e HTTP/1.1" 200 None 2026-04-14 06:00:39,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:00:39,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 06:00:39,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:00:39,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db35040a04df09a44ec40e HTTP/1.1" 200 None 2026-04-14 06:00:39,346 - lava_callback - ERROR - Error processing callback for node 69db35040a04df09a44ec40e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:01:59,307 - lava_callback - INFO - Received callback for node 69db354b0a04df09a44ec447 INFO: 172.20.0.1:57014 - "POST /node/69db354b0a04df09a44ec447 HTTP/1.0" 202 Accepted 2026-04-14 06:01:59,313 - lava_callback - INFO - Starting async job submit for node 69db354b0a04df09a44ec447 2026-04-14 06:01:59,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:01:59,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db354b0a04df09a44ec447 HTTP/1.1" 200 None 2026-04-14 06:01:59,329 - lava_callback - DEBUG - Processing node 69db354b0a04df09a44ec447: baseline-arm64-clabbe 2026-04-14 06:01:59,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db354b0a04df09a44ec447 2026-04-14 06:01:59,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:01:59,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db354b0a04df09a44ec447 HTTP/1.1" 200 None 2026-04-14 06:01:59,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:01:59,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 06:01:59,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:01:59,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db354b0a04df09a44ec447 HTTP/1.1" 200 None 2026-04-14 06:01:59,380 - lava_callback - ERROR - Error processing callback for node 69db354b0a04df09a44ec447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46598 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:02:59,346 - lava_callback - INFO - Received callback for node 69db358e0a04df09a44ec4ac INFO: 172.20.0.1:46600 - "POST /node/69db358e0a04df09a44ec4ac HTTP/1.0" 202 Accepted 2026-04-14 06:02:59,352 - lava_callback - INFO - Starting async job submit for node 69db358e0a04df09a44ec4ac 2026-04-14 06:02:59,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:02:59,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db358e0a04df09a44ec4ac HTTP/1.1" 200 None 2026-04-14 06:02:59,369 - lava_callback - DEBUG - Processing node 69db358e0a04df09a44ec4ac: baseline-arm64-clabbe 2026-04-14 06:02:59,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db358e0a04df09a44ec4ac 2026-04-14 06:02:59,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:02:59,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db358e0a04df09a44ec4ac HTTP/1.1" 200 None 2026-04-14 06:02:59,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:02:59,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 06:02:59,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:02:59,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db358e0a04df09a44ec4ac HTTP/1.1" 200 None 2026-04-14 06:02:59,419 - lava_callback - ERROR - Error processing callback for node 69db358e0a04df09a44ec4ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47492 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:04:19,421 - lava_callback - INFO - Received callback for node 69db35d70a04df09a44ec4cd INFO: 172.20.0.1:47496 - "POST /node/69db35d70a04df09a44ec4cd HTTP/1.0" 202 Accepted 2026-04-14 06:04:19,427 - lava_callback - INFO - Starting async job submit for node 69db35d70a04df09a44ec4cd 2026-04-14 06:04:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:04:19,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db35d70a04df09a44ec4cd HTTP/1.1" 200 None 2026-04-14 06:04:19,443 - lava_callback - DEBUG - Processing node 69db35d70a04df09a44ec4cd: baseline-arm64-clabbe 2026-04-14 06:04:19,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db35d70a04df09a44ec4cd 2026-04-14 06:04:19,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:04:19,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db35d70a04df09a44ec4cd HTTP/1.1" 200 None 2026-04-14 06:04:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:04:19,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-14 06:04:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:04:19,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db35d70a04df09a44ec4cd HTTP/1.1" 200 None 2026-04-14 06:04:19,495 - lava_callback - ERROR - Error processing callback for node 69db35d70a04df09a44ec4cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:05:19,478 - lava_callback - INFO - Received callback for node 69db361c0a04df09a44ec511 INFO: 172.20.0.1:43588 - "POST /node/69db361c0a04df09a44ec511 HTTP/1.0" 202 Accepted 2026-04-14 06:05:19,484 - lava_callback - INFO - Starting async job submit for node 69db361c0a04df09a44ec511 2026-04-14 06:05:19,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:05:19,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db361c0a04df09a44ec511 HTTP/1.1" 200 None 2026-04-14 06:05:19,501 - lava_callback - DEBUG - Processing node 69db361c0a04df09a44ec511: baseline-arm64-clabbe 2026-04-14 06:05:19,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db361c0a04df09a44ec511 2026-04-14 06:05:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:05:19,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db361c0a04df09a44ec511 HTTP/1.1" 200 None 2026-04-14 06:05:19,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:05:19,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:05:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:05:19,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db361c0a04df09a44ec511 HTTP/1.1" 200 None 2026-04-14 06:05:19,555 - lava_callback - ERROR - Error processing callback for node 69db361c0a04df09a44ec511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:06:39,528 - lava_callback - INFO - Received callback for node 69db36640a04df09a44ec548 INFO: 172.20.0.1:38680 - "POST /node/69db36640a04df09a44ec548 HTTP/1.0" 202 Accepted 2026-04-14 06:06:39,534 - lava_callback - INFO - Starting async job submit for node 69db36640a04df09a44ec548 2026-04-14 06:06:39,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:06:39,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36640a04df09a44ec548 HTTP/1.1" 200 None 2026-04-14 06:06:39,550 - lava_callback - DEBUG - Processing node 69db36640a04df09a44ec548: baseline-arm64-clabbe 2026-04-14 06:06:39,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db36640a04df09a44ec548 2026-04-14 06:06:39,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:06:39,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36640a04df09a44ec548 HTTP/1.1" 200 None 2026-04-14 06:06:39,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:06:39,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:06:39,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:06:39,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db36640a04df09a44ec548 HTTP/1.1" 200 None 2026-04-14 06:06:39,598 - lava_callback - ERROR - Error processing callback for node 69db36640a04df09a44ec548: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50302 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:07:59,587 - lava_callback - INFO - Received callback for node 69db36ac0a04df09a44ec577 INFO: 172.20.0.1:50316 - "POST /node/69db36ac0a04df09a44ec577 HTTP/1.0" 202 Accepted 2026-04-14 06:07:59,593 - lava_callback - INFO - Starting async job submit for node 69db36ac0a04df09a44ec577 2026-04-14 06:07:59,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:07:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36ac0a04df09a44ec577 HTTP/1.1" 200 None 2026-04-14 06:07:59,609 - lava_callback - DEBUG - Processing node 69db36ac0a04df09a44ec577: baseline-arm64-clabbe 2026-04-14 06:07:59,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db36ac0a04df09a44ec577 2026-04-14 06:07:59,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:07:59,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36ac0a04df09a44ec577 HTTP/1.1" 200 None 2026-04-14 06:07:59,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:07:59,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:07:59,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:07:59,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db36ac0a04df09a44ec577 HTTP/1.1" 200 None 2026-04-14 06:07:59,659 - lava_callback - ERROR - Error processing callback for node 69db36ac0a04df09a44ec577: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:08:59,635 - lava_callback - INFO - Received callback for node 69db36f10a04df09a44ec5c1 INFO: 172.20.0.1:48470 - "POST /node/69db36f10a04df09a44ec5c1 HTTP/1.0" 202 Accepted 2026-04-14 06:08:59,640 - lava_callback - INFO - Starting async job submit for node 69db36f10a04df09a44ec5c1 2026-04-14 06:08:59,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:08:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36f10a04df09a44ec5c1 HTTP/1.1" 200 None 2026-04-14 06:08:59,655 - lava_callback - DEBUG - Processing node 69db36f10a04df09a44ec5c1: baseline-arm64-clabbe 2026-04-14 06:08:59,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db36f10a04df09a44ec5c1 2026-04-14 06:08:59,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:08:59,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db36f10a04df09a44ec5c1 HTTP/1.1" 200 None 2026-04-14 06:08:59,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:08:59,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:08:59,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:08:59,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db36f10a04df09a44ec5c1 HTTP/1.1" 200 None 2026-04-14 06:08:59,716 - lava_callback - ERROR - Error processing callback for node 69db36f10a04df09a44ec5c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-14 06:09:03,071 - lava_callback - INFO - Received callback for node 69dd34ed17c944d2f17dc209 INFO: 172.20.0.1:45818 - "POST /node/69dd34ed17c944d2f17dc209 HTTP/1.0" 202 Accepted 2026-04-14 06:09:03,078 - lava_callback - INFO - Starting async job submit for node 69dd34ed17c944d2f17dc209 2026-04-14 06:09:03,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:03,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd34ed17c944d2f17dc209 HTTP/1.1" 200 None 2026-04-14 06:09:03,115 - lava_callback - DEBUG - Processing node 69dd34ed17c944d2f17dc209: baseline-arm64-broonie 2026-04-14 06:09:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:09:03,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:09:03,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd34ed17c944d2f17dc209/log.txt.gz 2026-04-14 06:09:03,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:09:03,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:09:03,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd34ed17c944d2f17dc209/lava-logs.yaml 2026-04-14 06:09:03,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:09:04,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:09:04,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd34ed17c944d2f17dc209/lava_callback.json.gz 2026-04-14 06:09:04,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:04,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd34ed17c944d2f17dc209 HTTP/1.1" 200 None 2026-04-14 06:09:04,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:04,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-14 06:09:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:04,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd34ed17c944d2f17dc209 HTTP/1.1" 200 None 2026-04-14 06:09:04,130 - lava_callback - INFO - Completed processing callback for node 69dd34ed17c944d2f17dc209 INFO: 172.20.0.1:45826 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:09:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:07,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:09:59,708 - lava_callback - INFO - Received callback for node 69db372c0a04df09a44ec626 INFO: 172.20.0.1:58700 - "POST /node/69db372c0a04df09a44ec626 HTTP/1.0" 202 Accepted 2026-04-14 06:09:59,718 - lava_callback - INFO - Starting async job submit for node 69db372c0a04df09a44ec626 2026-04-14 06:09:59,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:59,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db372c0a04df09a44ec626 HTTP/1.1" 200 None 2026-04-14 06:09:59,737 - lava_callback - DEBUG - Processing node 69db372c0a04df09a44ec626: baseline-arm64-clabbe 2026-04-14 06:09:59,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db372c0a04df09a44ec626 2026-04-14 06:09:59,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:59,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db372c0a04df09a44ec626 HTTP/1.1" 200 None 2026-04-14 06:09:59,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:59,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:09:59,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:09:59,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db372c0a04df09a44ec626 HTTP/1.1" 200 None 2026-04-14 06:09:59,788 - lava_callback - ERROR - Error processing callback for node 69db372c0a04df09a44ec626: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:11:03,152 - lava_callback - INFO - Received callback for node 69dd8d52c2164e674d71f4b3 INFO: 172.20.0.1:47902 - "POST /node/69dd8d52c2164e674d71f4b3 HTTP/1.0" 202 Accepted 2026-04-14 06:11:03,159 - lava_callback - INFO - Starting async job submit for node 69dd8d52c2164e674d71f4b3 2026-04-14 06:11:03,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:03,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d52c2164e674d71f4b3 HTTP/1.1" 200 None 2026-04-14 06:11:03,196 - lava_callback - DEBUG - Processing node 69dd8d52c2164e674d71f4b3: baseline-arm64-broonie 2026-04-14 06:11:03,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:11:03,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:11:03,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd8d52c2164e674d71f4b3/log.txt.gz 2026-04-14 06:11:03,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:11:04,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:11:04,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd8d52c2164e674d71f4b3/lava-logs.yaml 2026-04-14 06:11:04,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:11:04,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:11:04,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd8d52c2164e674d71f4b3/lava_callback.json.gz 2026-04-14 06:11:04,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:04,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d52c2164e674d71f4b3 HTTP/1.1" 200 None 2026-04-14 06:11:04,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:04,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-14 06:11:04,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:04,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8d52c2164e674d71f4b3 HTTP/1.1" 200 None 2026-04-14 06:11:04,268 - lava_callback - INFO - Completed processing callback for node 69dd8d52c2164e674d71f4b3 INFO: 172.20.0.1:47910 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:11:07,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:07,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:11:19,719 - lava_callback - INFO - Received callback for node 69db37770a04df09a44ec660 INFO: 172.20.0.1:58890 - "POST /node/69db37770a04df09a44ec660 HTTP/1.0" 202 Accepted 2026-04-14 06:11:19,725 - lava_callback - INFO - Starting async job submit for node 69db37770a04df09a44ec660 2026-04-14 06:11:19,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:19,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db37770a04df09a44ec660 HTTP/1.1" 200 None 2026-04-14 06:11:19,741 - lava_callback - DEBUG - Processing node 69db37770a04df09a44ec660: baseline-arm64-clabbe 2026-04-14 06:11:19,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db37770a04df09a44ec660 2026-04-14 06:11:19,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:19,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db37770a04df09a44ec660 HTTP/1.1" 200 None 2026-04-14 06:11:19,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:19,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:11:19,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:11:19,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db37770a04df09a44ec660 HTTP/1.1" 200 None 2026-04-14 06:11:19,790 - lava_callback - ERROR - Error processing callback for node 69db37770a04df09a44ec660: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:12:19,760 - lava_callback - INFO - Received callback for node 69db37bf0a04df09a44ec692 INFO: 172.20.0.1:49878 - "POST /node/69db37bf0a04df09a44ec692 HTTP/1.0" 202 Accepted 2026-04-14 06:12:19,766 - lava_callback - INFO - Starting async job submit for node 69db37bf0a04df09a44ec692 2026-04-14 06:12:19,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:12:19,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db37bf0a04df09a44ec692 HTTP/1.1" 200 None 2026-04-14 06:12:19,781 - lava_callback - DEBUG - Processing node 69db37bf0a04df09a44ec692: baseline-arm64-clabbe 2026-04-14 06:12:19,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db37bf0a04df09a44ec692 2026-04-14 06:12:19,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:12:19,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db37bf0a04df09a44ec692 HTTP/1.1" 200 None 2026-04-14 06:12:19,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:12:19,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:12:19,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:12:19,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db37bf0a04df09a44ec692 HTTP/1.1" 200 None 2026-04-14 06:12:19,844 - lava_callback - ERROR - Error processing callback for node 69db37bf0a04df09a44ec692: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:13:03,442 - lava_callback - INFO - Received callback for node 69dd9026c2164e674d71f8e3 INFO: 172.20.0.1:54206 - "POST /node/69dd9026c2164e674d71f8e3 HTTP/1.0" 202 Accepted 2026-04-14 06:13:03,448 - lava_callback - INFO - Starting async job submit for node 69dd9026c2164e674d71f8e3 2026-04-14 06:13:03,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:03,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9026c2164e674d71f8e3 HTTP/1.1" 200 None 2026-04-14 06:13:03,486 - lava_callback - DEBUG - Processing node 69dd9026c2164e674d71f8e3: baseline-arm64-broonie 2026-04-14 06:13:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:13:03,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:13:03,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9026c2164e674d71f8e3/log.txt.gz 2026-04-14 06:13:04,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:13:04,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:13:04,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9026c2164e674d71f8e3/lava-logs.yaml 2026-04-14 06:13:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-14 06:13:04,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-14 06:13:04,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69dd9026c2164e674d71f8e3/lava_callback.json.gz 2026-04-14 06:13:04,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:04,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9026c2164e674d71f8e3 HTTP/1.1" 200 None 2026-04-14 06:13:04,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:04,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-14 06:13:04,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:04,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9026c2164e674d71f8e3 HTTP/1.1" 200 None 2026-04-14 06:13:04,611 - lava_callback - INFO - Completed processing callback for node 69dd9026c2164e674d71f8e3 INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:13:07,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:07,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42200 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:13:39,833 - lava_callback - INFO - Received callback for node 69db38060a04df09a44ec6d7 INFO: 172.20.0.1:46360 - "POST /node/69db38060a04df09a44ec6d7 HTTP/1.0" 202 Accepted 2026-04-14 06:13:39,839 - lava_callback - INFO - Starting async job submit for node 69db38060a04df09a44ec6d7 2026-04-14 06:13:39,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:39,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db38060a04df09a44ec6d7 HTTP/1.1" 200 None 2026-04-14 06:13:39,857 - lava_callback - DEBUG - Processing node 69db38060a04df09a44ec6d7: baseline-arm64-clabbe 2026-04-14 06:13:39,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db38060a04df09a44ec6d7 2026-04-14 06:13:39,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:39,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db38060a04df09a44ec6d7 HTTP/1.1" 200 None 2026-04-14 06:13:39,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:39,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:13:39,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:13:39,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db38060a04df09a44ec6d7 HTTP/1.1" 200 None 2026-04-14 06:13:39,913 - lava_callback - ERROR - Error processing callback for node 69db38060a04df09a44ec6d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49006 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:14:59,915 - lava_callback - INFO - Received callback for node 69db38500a04df09a44ec6f3 INFO: 172.20.0.1:56548 - "POST /node/69db38500a04df09a44ec6f3 HTTP/1.0" 202 Accepted 2026-04-14 06:14:59,920 - lava_callback - INFO - Starting async job submit for node 69db38500a04df09a44ec6f3 2026-04-14 06:14:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:14:59,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db38500a04df09a44ec6f3 HTTP/1.1" 200 None 2026-04-14 06:14:59,936 - lava_callback - DEBUG - Processing node 69db38500a04df09a44ec6f3: baseline-arm64-clabbe 2026-04-14 06:14:59,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db38500a04df09a44ec6f3 2026-04-14 06:14:59,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:14:59,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db38500a04df09a44ec6f3 HTTP/1.1" 200 None 2026-04-14 06:14:59,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:14:59,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7d1612f20cf7d61e8b646 HTTP/1.1" 200 None 2026-04-14 06:14:59,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:14:59,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db38500a04df09a44ec6f3 HTTP/1.1" 200 None 2026-04-14 06:15:00,000 - lava_callback - ERROR - Error processing callback for node 69db38500a04df09a44ec6f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:36:34,984 - lava_callback - INFO - Received callback for node 69db3d6f0a04df09a44ec759 INFO: 172.20.0.1:38812 - "POST /node/69db3d6f0a04df09a44ec759 HTTP/1.0" 202 Accepted 2026-04-14 06:36:34,989 - lava_callback - INFO - Starting async job submit for node 69db3d6f0a04df09a44ec759 2026-04-14 06:36:34,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:36:35,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3d6f0a04df09a44ec759 HTTP/1.1" 200 None 2026-04-14 06:36:35,005 - lava_callback - DEBUG - Processing node 69db3d6f0a04df09a44ec759: baseline-arm-baylibre 2026-04-14 06:36:35,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3d6f0a04df09a44ec759 2026-04-14 06:36:35,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:36:35,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3d6f0a04df09a44ec759 HTTP/1.1" 200 None 2026-04-14 06:36:35,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:36:35,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:36:35,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:36:35,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3d6f0a04df09a44ec759 HTTP/1.1" 200 None 2026-04-14 06:36:35,073 - lava_callback - ERROR - Error processing callback for node 69db3d6f0a04df09a44ec759: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57798 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:38:15,111 - lava_callback - INFO - Received callback for node 69db3dd10a04df09a44ec7df INFO: 172.20.0.1:58716 - "POST /node/69db3dd10a04df09a44ec7df HTTP/1.0" 202 Accepted 2026-04-14 06:38:15,116 - lava_callback - INFO - Starting async job submit for node 69db3dd10a04df09a44ec7df 2026-04-14 06:38:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:15,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3dd10a04df09a44ec7df HTTP/1.1" 200 None 2026-04-14 06:38:15,133 - lava_callback - DEBUG - Processing node 69db3dd10a04df09a44ec7df: baseline-arm-baylibre 2026-04-14 06:38:15,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3dd10a04df09a44ec7df 2026-04-14 06:38:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:15,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3dd10a04df09a44ec7df HTTP/1.1" 200 None 2026-04-14 06:38:15,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:15,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:38:15,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:58726 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 06:38:15,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3dd10a04df09a44ec7df HTTP/1.1" 200 None 2026-04-14 06:38:15,182 - lava_callback - ERROR - Error processing callback for node 69db3dd10a04df09a44ec7df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40320 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:38:55,046 - lava_callback - INFO - Received callback for node 69db3df30a04df09a44ec815 INFO: 172.20.0.1:40328 - "POST /node/69db3df30a04df09a44ec815 HTTP/1.0" 202 Accepted 2026-04-14 06:38:55,053 - lava_callback - INFO - Starting async job submit for node 69db3df30a04df09a44ec815 2026-04-14 06:38:55,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:55,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3df30a04df09a44ec815 HTTP/1.1" 200 None 2026-04-14 06:38:55,069 - lava_callback - DEBUG - Processing node 69db3df30a04df09a44ec815: baseline-arm-baylibre 2026-04-14 06:38:55,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3df30a04df09a44ec815 2026-04-14 06:38:55,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:55,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3df30a04df09a44ec815 HTTP/1.1" 200 None 2026-04-14 06:38:55,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:55,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:38:55,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:38:55,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3df30a04df09a44ec815 HTTP/1.1" 200 None 2026-04-14 06:38:55,122 - lava_callback - ERROR - Error processing callback for node 69db3df30a04df09a44ec815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:41:55,349 - lava_callback - INFO - Received callback for node 69db3eb00a04df09a44ec8e9 INFO: 172.20.0.1:36350 - "POST /node/69db3eb00a04df09a44ec8e9 HTTP/1.0" 202 Accepted 2026-04-14 06:41:55,358 - lava_callback - INFO - Starting async job submit for node 69db3eb00a04df09a44ec8e9 2026-04-14 06:41:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:41:55,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3eb00a04df09a44ec8e9 HTTP/1.1" 200 None 2026-04-14 06:41:55,396 - lava_callback - DEBUG - Processing node 69db3eb00a04df09a44ec8e9: baseline-arm-baylibre 2026-04-14 06:41:55,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3eb00a04df09a44ec8e9 2026-04-14 06:41:55,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:41:55,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3eb00a04df09a44ec8e9 HTTP/1.1" 200 None 2026-04-14 06:41:55,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:41:55,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:41:55,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:41:55,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3eb00a04df09a44ec8e9 HTTP/1.1" 200 None 2026-04-14 06:41:55,464 - lava_callback - ERROR - Error processing callback for node 69db3eb00a04df09a44ec8e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:44:21,227 - lava_callback - INFO - Received callback for node 69db3f340a04df09a44ec9ab INFO: 172.20.0.1:50684 - "POST /node/69db3f340a04df09a44ec9ab HTTP/1.0" 202 Accepted 2026-04-14 06:44:21,232 - lava_callback - INFO - Starting async job submit for node 69db3f340a04df09a44ec9ab 2026-04-14 06:44:21,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:21,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f340a04df09a44ec9ab HTTP/1.1" 200 None 2026-04-14 06:44:21,248 - lava_callback - DEBUG - Processing node 69db3f340a04df09a44ec9ab: baseline-arm-clabbe 2026-04-14 06:44:21,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3f340a04df09a44ec9ab 2026-04-14 06:44:21,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:21,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f340a04df09a44ec9ab HTTP/1.1" 200 None 2026-04-14 06:44:21,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:21,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:44:21,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:21,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3f340a04df09a44ec9ab HTTP/1.1" 200 None 2026-04-14 06:44:21,310 - lava_callback - ERROR - Error processing callback for node 69db3f340a04df09a44ec9ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54888 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:44:41,158 - lava_callback - INFO - Received callback for node 69db3f550a04df09a44ec9d1 INFO: 172.20.0.1:49460 - "POST /node/69db3f550a04df09a44ec9d1 HTTP/1.0" 202 Accepted 2026-04-14 06:44:41,164 - lava_callback - INFO - Starting async job submit for node 69db3f550a04df09a44ec9d1 2026-04-14 06:44:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:41,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f550a04df09a44ec9d1 HTTP/1.1" 200 None 2026-04-14 06:44:41,180 - lava_callback - DEBUG - Processing node 69db3f550a04df09a44ec9d1: baseline-arm-clabbe 2026-04-14 06:44:41,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3f550a04df09a44ec9d1 2026-04-14 06:44:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:41,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f550a04df09a44ec9d1 HTTP/1.1" 200 None 2026-04-14 06:44:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:41,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:44:41,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:44:41,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3f550a04df09a44ec9d1 HTTP/1.1" 200 None 2026-04-14 06:44:41,234 - lava_callback - ERROR - Error processing callback for node 69db3f550a04df09a44ec9d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51074 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:45:21,184 - lava_callback - INFO - Received callback for node 69db3f7a0a04df09a44ec9e8 INFO: 172.20.0.1:39598 - "POST /node/69db3f7a0a04df09a44ec9e8 HTTP/1.0" 202 Accepted 2026-04-14 06:45:21,189 - lava_callback - INFO - Starting async job submit for node 69db3f7a0a04df09a44ec9e8 2026-04-14 06:45:21,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:45:21,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f7a0a04df09a44ec9e8 HTTP/1.1" 200 None 2026-04-14 06:45:21,209 - lava_callback - DEBUG - Processing node 69db3f7a0a04df09a44ec9e8: baseline-arm-clabbe 2026-04-14 06:45:21,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3f7a0a04df09a44ec9e8 2026-04-14 06:45:21,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:45:21,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f7a0a04df09a44ec9e8 HTTP/1.1" 200 None 2026-04-14 06:45:21,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:45:21,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:45:21,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:45:21,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3f7a0a04df09a44ec9e8 HTTP/1.1" 200 None 2026-04-14 06:45:21,278 - lava_callback - ERROR - Error processing callback for node 69db3f7a0a04df09a44ec9e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55454 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:46:01,220 - lava_callback - INFO - Received callback for node 69db3f9f0a04df09a44ec9fc INFO: 172.20.0.1:57146 - "POST /node/69db3f9f0a04df09a44ec9fc HTTP/1.0" 202 Accepted 2026-04-14 06:46:01,226 - lava_callback - INFO - Starting async job submit for node 69db3f9f0a04df09a44ec9fc 2026-04-14 06:46:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:01,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f9f0a04df09a44ec9fc HTTP/1.1" 200 None 2026-04-14 06:46:01,242 - lava_callback - DEBUG - Processing node 69db3f9f0a04df09a44ec9fc: baseline-arm-clabbe 2026-04-14 06:46:01,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3f9f0a04df09a44ec9fc 2026-04-14 06:46:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:01,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3f9f0a04df09a44ec9fc HTTP/1.1" 200 None 2026-04-14 06:46:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:01,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:46:01,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:01,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3f9f0a04df09a44ec9fc HTTP/1.1" 200 None 2026-04-14 06:46:01,293 - lava_callback - ERROR - Error processing callback for node 69db3f9f0a04df09a44ec9fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45770 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:46:41,267 - lava_callback - INFO - Received callback for node 69db3fbd0a04df09a44eca0d INFO: 172.20.0.1:55242 - "POST /node/69db3fbd0a04df09a44eca0d HTTP/1.0" 202 Accepted 2026-04-14 06:46:41,272 - lava_callback - INFO - Starting async job submit for node 69db3fbd0a04df09a44eca0d 2026-04-14 06:46:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:41,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3fbd0a04df09a44eca0d HTTP/1.1" 200 None 2026-04-14 06:46:41,288 - lava_callback - DEBUG - Processing node 69db3fbd0a04df09a44eca0d: baseline-arm-clabbe 2026-04-14 06:46:41,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3fbd0a04df09a44eca0d 2026-04-14 06:46:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:41,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3fbd0a04df09a44eca0d HTTP/1.1" 200 None 2026-04-14 06:46:41,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:41,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:46:41,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:46:41,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3fbd0a04df09a44eca0d HTTP/1.1" 200 None 2026-04-14 06:46:41,345 - lava_callback - ERROR - Error processing callback for node 69db3fbd0a04df09a44eca0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:47:01,248 - lava_callback - INFO - Received callback for node 69db3fe00a04df09a44eca4e INFO: 172.20.0.1:38312 - "POST /node/69db3fe00a04df09a44eca4e HTTP/1.0" 202 Accepted 2026-04-14 06:47:01,254 - lava_callback - INFO - Starting async job submit for node 69db3fe00a04df09a44eca4e 2026-04-14 06:47:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:01,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3fe00a04df09a44eca4e HTTP/1.1" 200 None 2026-04-14 06:47:01,273 - lava_callback - DEBUG - Processing node 69db3fe00a04df09a44eca4e: baseline-arm-clabbe 2026-04-14 06:47:01,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db3fe00a04df09a44eca4e 2026-04-14 06:47:01,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:01,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db3fe00a04df09a44eca4e HTTP/1.1" 200 None 2026-04-14 06:47:01,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:01,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:47:01,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:01,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db3fe00a04df09a44eca4e HTTP/1.1" 200 None 2026-04-14 06:47:01,333 - lava_callback - ERROR - Error processing callback for node 69db3fe00a04df09a44eca4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:47:41,276 - lava_callback - INFO - Received callback for node 69db40020a04df09a44eca70 INFO: 172.20.0.1:33320 - "POST /node/69db40020a04df09a44eca70 HTTP/1.0" 202 Accepted 2026-04-14 06:47:41,281 - lava_callback - INFO - Starting async job submit for node 69db40020a04df09a44eca70 2026-04-14 06:47:41,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:41,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40020a04df09a44eca70 HTTP/1.1" 200 None 2026-04-14 06:47:41,302 - lava_callback - DEBUG - Processing node 69db40020a04df09a44eca70: baseline-arm-clabbe 2026-04-14 06:47:41,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db40020a04df09a44eca70 2026-04-14 06:47:41,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:41,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40020a04df09a44eca70 HTTP/1.1" 200 None 2026-04-14 06:47:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:41,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:47:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:47:41,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db40020a04df09a44eca70 HTTP/1.1" 200 None 2026-04-14 06:47:41,355 - lava_callback - ERROR - Error processing callback for node 69db40020a04df09a44eca70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:48:21,293 - lava_callback - INFO - Received callback for node 69db40260a04df09a44eca7e INFO: 172.20.0.1:42282 - "POST /node/69db40260a04df09a44eca7e HTTP/1.0" 202 Accepted 2026-04-14 06:48:21,298 - lava_callback - INFO - Starting async job submit for node 69db40260a04df09a44eca7e 2026-04-14 06:48:21,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:48:21,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40260a04df09a44eca7e HTTP/1.1" 200 None 2026-04-14 06:48:21,314 - lava_callback - DEBUG - Processing node 69db40260a04df09a44eca7e: baseline-arm-clabbe 2026-04-14 06:48:21,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db40260a04df09a44eca7e 2026-04-14 06:48:21,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:48:21,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40260a04df09a44eca7e HTTP/1.1" 200 None 2026-04-14 06:48:21,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:48:21,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:48:21,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:48:21,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db40260a04df09a44eca7e HTTP/1.1" 200 None 2026-04-14 06:48:21,364 - lava_callback - ERROR - Error processing callback for node 69db40260a04df09a44eca7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33200 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:49:01,360 - lava_callback - INFO - Received callback for node 69db40480a04df09a44eca98 INFO: 172.20.0.1:35068 - "POST /node/69db40480a04df09a44eca98 HTTP/1.0" 202 Accepted 2026-04-14 06:49:01,366 - lava_callback - INFO - Starting async job submit for node 69db40480a04df09a44eca98 2026-04-14 06:49:01,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:01,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40480a04df09a44eca98 HTTP/1.1" 200 None 2026-04-14 06:49:01,381 - lava_callback - DEBUG - Processing node 69db40480a04df09a44eca98: baseline-arm-clabbe 2026-04-14 06:49:01,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db40480a04df09a44eca98 2026-04-14 06:49:01,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:01,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40480a04df09a44eca98 HTTP/1.1" 200 None 2026-04-14 06:49:01,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:01,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:49:01,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db40480a04df09a44eca98 HTTP/1.1" 200 None 2026-04-14 06:49:01,443 - lava_callback - ERROR - Error processing callback for node 69db40480a04df09a44eca98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35082 - "GET /node/699279ed98a8bdb31c3940d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33800 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:49:21,341 - lava_callback - INFO - Received callback for node 69db40650a04df09a44ecac1 INFO: 172.20.0.1:37738 - "POST /node/69db40650a04df09a44ecac1 HTTP/1.0" 202 Accepted 2026-04-14 06:49:21,347 - lava_callback - INFO - Starting async job submit for node 69db40650a04df09a44ecac1 2026-04-14 06:49:21,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:21,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40650a04df09a44ecac1 HTTP/1.1" 200 None 2026-04-14 06:49:21,367 - lava_callback - DEBUG - Processing node 69db40650a04df09a44ecac1: baseline-arm-clabbe 2026-04-14 06:49:21,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db40650a04df09a44ecac1 2026-04-14 06:49:21,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40650a04df09a44ecac1 HTTP/1.1" 200 None 2026-04-14 06:49:21,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:21,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-14 06:49:21,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:49:21,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db40650a04df09a44ecac1 HTTP/1.1" 200 None 2026-04-14 06:49:21,418 - lava_callback - ERROR - Error processing callback for node 69db40650a04df09a44ecac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49298 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:50:21,398 - lava_callback - INFO - Received callback for node 69db409e0a04df09a44ecb2b INFO: 172.20.0.1:34598 - "POST /node/69db409e0a04df09a44ecb2b HTTP/1.0" 202 Accepted 2026-04-14 06:50:21,404 - lava_callback - INFO - Starting async job submit for node 69db409e0a04df09a44ecb2b 2026-04-14 06:50:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:21,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db409e0a04df09a44ecb2b HTTP/1.1" 200 None 2026-04-14 06:50:21,420 - lava_callback - DEBUG - Processing node 69db409e0a04df09a44ecb2b: baseline-arm-clabbe 2026-04-14 06:50:21,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db409e0a04df09a44ecb2b 2026-04-14 06:50:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:21,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db409e0a04df09a44ecb2b HTTP/1.1" 200 None 2026-04-14 06:50:21,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:21,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:50:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:21,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db409e0a04df09a44ecb2b HTTP/1.1" 200 None 2026-04-14 06:50:21,479 - lava_callback - ERROR - Error processing callback for node 69db409e0a04df09a44ecb2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET /node/69288863acdde99814a233e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37486 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:50:41,405 - lava_callback - INFO - Received callback for node 69db40bd0a04df09a44ecb59 INFO: 172.20.0.1:51916 - "POST /node/69db40bd0a04df09a44ecb59 HTTP/1.0" 202 Accepted 2026-04-14 06:50:41,410 - lava_callback - INFO - Starting async job submit for node 69db40bd0a04df09a44ecb59 2026-04-14 06:50:41,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:41,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40bd0a04df09a44ecb59 HTTP/1.1" 200 None 2026-04-14 06:50:41,426 - lava_callback - DEBUG - Processing node 69db40bd0a04df09a44ecb59: baseline-arm-clabbe 2026-04-14 06:50:41,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db40bd0a04df09a44ecb59 2026-04-14 06:50:41,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:41,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db40bd0a04df09a44ecb59 HTTP/1.1" 200 None 2026-04-14 06:50:41,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:41,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:50:41,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:50:41,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db40bd0a04df09a44ecb59 HTTP/1.1" 200 None 2026-04-14 06:50:41,482 - lava_callback - ERROR - Error processing callback for node 69db40bd0a04df09a44ecb59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET /node/691027dbf4a91d81a0ec2dcf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET /node/6990adfac45febfe44522050%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38170 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:52:21,470 - lava_callback - INFO - Received callback for node 69db411e0a04df09a44ecb81 INFO: 172.20.0.1:54096 - "POST /node/69db411e0a04df09a44ecb81 HTTP/1.0" 202 Accepted 2026-04-14 06:52:21,479 - lava_callback - INFO - Starting async job submit for node 69db411e0a04df09a44ecb81 2026-04-14 06:52:21,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:52:21,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db411e0a04df09a44ecb81 HTTP/1.1" 200 None 2026-04-14 06:52:21,498 - lava_callback - DEBUG - Processing node 69db411e0a04df09a44ecb81: baseline-arm-clabbe 2026-04-14 06:52:21,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db411e0a04df09a44ecb81 2026-04-14 06:52:21,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:52:21,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db411e0a04df09a44ecb81 HTTP/1.1" 200 None 2026-04-14 06:52:21,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:52:21,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:52:21,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:52:21,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db411e0a04df09a44ecb81 HTTP/1.1" 200 None 2026-04-14 06:52:21,563 - lava_callback - ERROR - Error processing callback for node 69db411e0a04df09a44ecb81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49822 - "GET /node/69d5a4d034043de23ba14039%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 06:53:01,441 - lava_callback - INFO - Received callback for node 69db41450a04df09a44ecb92 INFO: 172.20.0.1:49824 - "POST /node/69db41450a04df09a44ecb92 HTTP/1.0" 202 Accepted 2026-04-14 06:53:01,447 - lava_callback - INFO - Starting async job submit for node 69db41450a04df09a44ecb92 2026-04-14 06:53:01,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:01,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41450a04df09a44ecb92 HTTP/1.1" 200 None 2026-04-14 06:53:01,472 - lava_callback - DEBUG - Processing node 69db41450a04df09a44ecb92: baseline-arm-clabbe 2026-04-14 06:53:01,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db41450a04df09a44ecb92 2026-04-14 06:53:01,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:01,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41450a04df09a44ecb92 HTTP/1.1" 200 None 2026-04-14 06:53:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:01,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:53:01,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:01,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db41450a04df09a44ecb92 HTTP/1.1" 200 None 2026-04-14 06:53:01,524 - lava_callback - ERROR - Error processing callback for node 69db41450a04df09a44ecb92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:53:41,540 - lava_callback - INFO - Received callback for node 69db41660a04df09a44ecbac INFO: 172.20.0.1:56932 - "POST /node/69db41660a04df09a44ecbac HTTP/1.0" 202 Accepted 2026-04-14 06:53:41,546 - lava_callback - INFO - Starting async job submit for node 69db41660a04df09a44ecbac 2026-04-14 06:53:41,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:41,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41660a04df09a44ecbac HTTP/1.1" 200 None 2026-04-14 06:53:41,563 - lava_callback - DEBUG - Processing node 69db41660a04df09a44ecbac: baseline-arm-clabbe 2026-04-14 06:53:41,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db41660a04df09a44ecbac 2026-04-14 06:53:41,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:41,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41660a04df09a44ecbac HTTP/1.1" 200 None 2026-04-14 06:53:41,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:53:41,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:53:41,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db41660a04df09a44ecbac HTTP/1.1" 200 None 2026-04-14 06:53:41,619 - lava_callback - ERROR - Error processing callback for node 69db41660a04df09a44ecbac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET /node/693b7da141fb4c9509763ab4%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 06:54:21,534 - lava_callback - INFO - Received callback for node 69db418a0a04df09a44ecbbc INFO: 172.20.0.1:43648 - "POST /node/69db418a0a04df09a44ecbbc HTTP/1.0" 202 Accepted 2026-04-14 06:54:21,540 - lava_callback - INFO - Starting async job submit for node 69db418a0a04df09a44ecbbc 2026-04-14 06:54:21,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:54:21,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db418a0a04df09a44ecbbc HTTP/1.1" 200 None 2026-04-14 06:54:21,556 - lava_callback - DEBUG - Processing node 69db418a0a04df09a44ecbbc: baseline-arm-clabbe 2026-04-14 06:54:21,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db418a0a04df09a44ecbbc 2026-04-14 06:54:21,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:54:21,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db418a0a04df09a44ecbbc HTTP/1.1" 200 None 2026-04-14 06:54:21,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:54:21,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:54:21,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:54:21,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db418a0a04df09a44ecbbc HTTP/1.1" 200 None 2026-04-14 06:54:21,603 - lava_callback - ERROR - Error processing callback for node 69db418a0a04df09a44ecbbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:55:01,647 - lava_callback - INFO - Received callback for node 69db41af0a04df09a44ecbc6 INFO: 172.20.0.1:56378 - "POST /node/69db41af0a04df09a44ecbc6 HTTP/1.0" 202 Accepted 2026-04-14 06:55:01,653 - lava_callback - INFO - Starting async job submit for node 69db41af0a04df09a44ecbc6 2026-04-14 06:55:01,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:01,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41af0a04df09a44ecbc6 HTTP/1.1" 200 None 2026-04-14 06:55:01,669 - lava_callback - DEBUG - Processing node 69db41af0a04df09a44ecbc6: baseline-arm-clabbe 2026-04-14 06:55:01,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db41af0a04df09a44ecbc6 2026-04-14 06:55:01,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:01,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41af0a04df09a44ecbc6 HTTP/1.1" 200 None 2026-04-14 06:55:01,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:01,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:55:01,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:01,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db41af0a04df09a44ecbc6 HTTP/1.1" 200 None 2026-04-14 06:55:01,766 - lava_callback - ERROR - Error processing callback for node 69db41af0a04df09a44ecbc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44264 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:55:21,572 - lava_callback - INFO - Received callback for node 69db41d40a04df09a44ecbd3 INFO: 172.20.0.1:33730 - "POST /node/69db41d40a04df09a44ecbd3 HTTP/1.0" 202 Accepted 2026-04-14 06:55:21,577 - lava_callback - INFO - Starting async job submit for node 69db41d40a04df09a44ecbd3 2026-04-14 06:55:21,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:21,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41d40a04df09a44ecbd3 HTTP/1.1" 200 None 2026-04-14 06:55:21,594 - lava_callback - DEBUG - Processing node 69db41d40a04df09a44ecbd3: baseline-arm-clabbe 2026-04-14 06:55:21,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db41d40a04df09a44ecbd3 2026-04-14 06:55:21,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:21,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41d40a04df09a44ecbd3 HTTP/1.1" 200 None 2026-04-14 06:55:21,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:21,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:55:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:55:21,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db41d40a04df09a44ecbd3 HTTP/1.1" 200 None 2026-04-14 06:55:21,651 - lava_callback - ERROR - Error processing callback for node 69db41d40a04df09a44ecbd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40108 - "GET /node/69d7da4e2f20cf7d61e8bb70%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57666 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:56:01,666 - lava_callback - INFO - Received callback for node 69db41f20a04df09a44ecbeb INFO: 172.20.0.1:43944 - "POST /node/69db41f20a04df09a44ecbeb HTTP/1.0" 202 Accepted 2026-04-14 06:56:01,672 - lava_callback - INFO - Starting async job submit for node 69db41f20a04df09a44ecbeb 2026-04-14 06:56:01,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:01,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41f20a04df09a44ecbeb HTTP/1.1" 200 None 2026-04-14 06:56:01,693 - lava_callback - DEBUG - Processing node 69db41f20a04df09a44ecbeb: baseline-arm-clabbe 2026-04-14 06:56:01,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db41f20a04df09a44ecbeb 2026-04-14 06:56:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:01,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db41f20a04df09a44ecbeb HTTP/1.1" 200 None 2026-04-14 06:56:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:01,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:56:01,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:01,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db41f20a04df09a44ecbeb HTTP/1.1" 200 None 2026-04-14 06:56:01,777 - lava_callback - ERROR - Error processing callback for node 69db41f20a04df09a44ecbeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43954 - "GET /node/695b5d748156fad0b1225546%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:56:41,615 - lava_callback - INFO - Received callback for node 69db42140a04df09a44ecc13 INFO: 172.20.0.1:57906 - "POST /node/69db42140a04df09a44ecc13 HTTP/1.0" 202 Accepted 2026-04-14 06:56:41,621 - lava_callback - INFO - Starting async job submit for node 69db42140a04df09a44ecc13 2026-04-14 06:56:41,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:41,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42140a04df09a44ecc13 HTTP/1.1" 200 None 2026-04-14 06:56:41,640 - lava_callback - DEBUG - Processing node 69db42140a04df09a44ecc13: baseline-arm-clabbe 2026-04-14 06:56:41,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42140a04df09a44ecc13 2026-04-14 06:56:41,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:41,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42140a04df09a44ecc13 HTTP/1.1" 200 None 2026-04-14 06:56:41,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:41,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:56:41,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:56:41,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42140a04df09a44ecc13 HTTP/1.1" 200 None 2026-04-14 06:56:41,692 - lava_callback - ERROR - Error processing callback for node 69db42140a04df09a44ecc13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:57:01,702 - lava_callback - INFO - Received callback for node 69db42360a04df09a44ecc2b INFO: 172.20.0.1:43338 - "POST /node/69db42360a04df09a44ecc2b HTTP/1.0" 202 Accepted 2026-04-14 06:57:01,707 - lava_callback - INFO - Starting async job submit for node 69db42360a04df09a44ecc2b 2026-04-14 06:57:01,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:01,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42360a04df09a44ecc2b HTTP/1.1" 200 None 2026-04-14 06:57:01,723 - lava_callback - DEBUG - Processing node 69db42360a04df09a44ecc2b: baseline-arm-clabbe 2026-04-14 06:57:01,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42360a04df09a44ecc2b 2026-04-14 06:57:01,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42360a04df09a44ecc2b HTTP/1.1" 200 None 2026-04-14 06:57:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:01,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:57:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:01,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42360a04df09a44ecc2b HTTP/1.1" 200 None 2026-04-14 06:57:01,784 - lava_callback - ERROR - Error processing callback for node 69db42360a04df09a44ecc2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48236 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:57:41,688 - lava_callback - INFO - Received callback for node 69db42570a04df09a44ecc5a INFO: 172.20.0.1:33338 - "POST /node/69db42570a04df09a44ecc5a HTTP/1.0" 202 Accepted 2026-04-14 06:57:41,694 - lava_callback - INFO - Starting async job submit for node 69db42570a04df09a44ecc5a 2026-04-14 06:57:41,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:41,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42570a04df09a44ecc5a HTTP/1.1" 200 None 2026-04-14 06:57:41,711 - lava_callback - DEBUG - Processing node 69db42570a04df09a44ecc5a: baseline-arm-clabbe 2026-04-14 06:57:41,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42570a04df09a44ecc5a 2026-04-14 06:57:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:41,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42570a04df09a44ecc5a HTTP/1.1" 200 None 2026-04-14 06:57:41,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:57:41,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:57:41,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42570a04df09a44ecc5a HTTP/1.1" 200 None 2026-04-14 06:57:41,806 - lava_callback - ERROR - Error processing callback for node 69db42570a04df09a44ecc5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:58:01,785 - lava_callback - INFO - Received callback for node 69db42760a04df09a44ecc8b INFO: 172.20.0.1:36998 - "POST /node/69db42760a04df09a44ecc8b HTTP/1.0" 202 Accepted 2026-04-14 06:58:01,791 - lava_callback - INFO - Starting async job submit for node 69db42760a04df09a44ecc8b 2026-04-14 06:58:01,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:01,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42760a04df09a44ecc8b HTTP/1.1" 200 None 2026-04-14 06:58:01,808 - lava_callback - DEBUG - Processing node 69db42760a04df09a44ecc8b: baseline-arm-clabbe 2026-04-14 06:58:01,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42760a04df09a44ecc8b 2026-04-14 06:58:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:01,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42760a04df09a44ecc8b HTTP/1.1" 200 None 2026-04-14 06:58:01,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:01,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:58:01,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:01,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42760a04df09a44ecc8b HTTP/1.1" 200 None 2026-04-14 06:58:01,860 - lava_callback - ERROR - Error processing callback for node 69db42760a04df09a44ecc8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET /node/69485e2b9214b49387168d32%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35842 - "GET /node/694024d9575bc060ce153f12%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45696 - "GET /node/695b081d8156fad0b122129a%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 06:58:41,771 - lava_callback - INFO - Received callback for node 69db42920a04df09a44eccbe INFO: 172.20.0.1:45514 - "POST /node/69db42920a04df09a44eccbe HTTP/1.0" 202 Accepted 2026-04-14 06:58:41,776 - lava_callback - INFO - Starting async job submit for node 69db42920a04df09a44eccbe 2026-04-14 06:58:41,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:41,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42920a04df09a44eccbe HTTP/1.1" 200 None 2026-04-14 06:58:41,794 - lava_callback - DEBUG - Processing node 69db42920a04df09a44eccbe: baseline-arm-clabbe 2026-04-14 06:58:41,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42920a04df09a44eccbe 2026-04-14 06:58:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:41,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42920a04df09a44eccbe HTTP/1.1" 200 None 2026-04-14 06:58:41,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:41,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:58:41,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:58:41,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42920a04df09a44eccbe HTTP/1.1" 200 None 2026-04-14 06:58:41,842 - lava_callback - ERROR - Error processing callback for node 69db42920a04df09a44eccbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:59:01,790 - lava_callback - INFO - Received callback for node 69db42b30a04df09a44ecce8 INFO: 172.20.0.1:45642 - "POST /node/69db42b30a04df09a44ecce8 HTTP/1.0" 202 Accepted 2026-04-14 06:59:01,796 - lava_callback - INFO - Starting async job submit for node 69db42b30a04df09a44ecce8 2026-04-14 06:59:01,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:01,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42b30a04df09a44ecce8 HTTP/1.1" 200 None 2026-04-14 06:59:01,813 - lava_callback - DEBUG - Processing node 69db42b30a04df09a44ecce8: baseline-arm-clabbe 2026-04-14 06:59:01,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42b30a04df09a44ecce8 2026-04-14 06:59:01,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:01,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42b30a04df09a44ecce8 HTTP/1.1" 200 None 2026-04-14 06:59:01,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:01,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:59:01,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:01,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42b30a04df09a44ecce8 HTTP/1.1" 200 None 2026-04-14 06:59:01,985 - lava_callback - ERROR - Error processing callback for node 69db42b30a04df09a44ecce8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38174 - "GET /node/699446625ae459b9df3d9f8f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34128 - "GET / HTTP/1.0" 200 OK 2026-04-14 06:59:41,746 - lava_callback - INFO - Received callback for node 69db42ce0a04df09a44ecd26 INFO: 172.20.0.1:49924 - "POST /node/69db42ce0a04df09a44ecd26 HTTP/1.0" 202 Accepted 2026-04-14 06:59:41,751 - lava_callback - INFO - Starting async job submit for node 69db42ce0a04df09a44ecd26 2026-04-14 06:59:41,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:41,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42ce0a04df09a44ecd26 HTTP/1.1" 200 None 2026-04-14 06:59:41,773 - lava_callback - DEBUG - Processing node 69db42ce0a04df09a44ecd26: baseline-arm-clabbe 2026-04-14 06:59:41,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42ce0a04df09a44ecd26 2026-04-14 06:59:41,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:41,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42ce0a04df09a44ecd26 HTTP/1.1" 200 None 2026-04-14 06:59:41,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:41,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 06:59:41,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 06:59:41,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42ce0a04df09a44ecd26 HTTP/1.1" 200 None 2026-04-14 06:59:41,826 - lava_callback - ERROR - Error processing callback for node 69db42ce0a04df09a44ecd26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33334 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:00:21,859 - lava_callback - INFO - Received callback for node 69db42ef0a04df09a44ecd5d INFO: 172.20.0.1:52322 - "POST /node/69db42ef0a04df09a44ecd5d HTTP/1.0" 202 Accepted 2026-04-14 07:00:21,864 - lava_callback - INFO - Starting async job submit for node 69db42ef0a04df09a44ecd5d 2026-04-14 07:00:21,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:21,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42ef0a04df09a44ecd5d HTTP/1.1" 200 None 2026-04-14 07:00:21,886 - lava_callback - DEBUG - Processing node 69db42ef0a04df09a44ecd5d: baseline-arm-clabbe 2026-04-14 07:00:21,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db42ef0a04df09a44ecd5d 2026-04-14 07:00:21,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:21,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db42ef0a04df09a44ecd5d HTTP/1.1" 200 None 2026-04-14 07:00:21,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:21,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-14 07:00:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db42ef0a04df09a44ecd5d HTTP/1.1" 200 None 2026-04-14 07:00:21,944 - lava_callback - ERROR - Error processing callback for node 69db42ef0a04df09a44ecd5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:00:36,262 - lava_callback - INFO - Received callback for node 69db430b0a04df09a44ecd92 INFO: 172.20.0.1:36420 - "POST /node/69db430b0a04df09a44ecd92 HTTP/1.0" 202 Accepted 2026-04-14 07:00:36,267 - lava_callback - INFO - Starting async job submit for node 69db430b0a04df09a44ecd92 2026-04-14 07:00:36,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db430b0a04df09a44ecd92 HTTP/1.1" 200 None 2026-04-14 07:00:36,284 - lava_callback - DEBUG - Processing node 69db430b0a04df09a44ecd92: baseline-arm-baylibre 2026-04-14 07:00:36,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db430b0a04df09a44ecd92 2026-04-14 07:00:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:36,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db430b0a04df09a44ecd92 HTTP/1.1" 200 None 2026-04-14 07:00:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:36,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:00:36,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:00:36,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db430b0a04df09a44ecd92 HTTP/1.1" 200 None 2026-04-14 07:00:36,333 - lava_callback - ERROR - Error processing callback for node 69db430b0a04df09a44ecd92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39512 - "GET /node/698fcb2c76d4b6342e9d74dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39528 - "GET /node/695efcebd1383f7c235337f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 07:01:16,277 - lava_callback - INFO - Received callback for node 69db43290a04df09a44ecdca INFO: 172.20.0.1:43632 - "POST /node/69db43290a04df09a44ecdca HTTP/1.0" 202 Accepted 2026-04-14 07:01:16,282 - lava_callback - INFO - Starting async job submit for node 69db43290a04df09a44ecdca 2026-04-14 07:01:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:16,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43290a04df09a44ecdca HTTP/1.1" 200 None 2026-04-14 07:01:16,301 - lava_callback - DEBUG - Processing node 69db43290a04df09a44ecdca: baseline-arm-baylibre 2026-04-14 07:01:16,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43290a04df09a44ecdca 2026-04-14 07:01:16,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:16,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43290a04df09a44ecdca HTTP/1.1" 200 None 2026-04-14 07:01:16,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:16,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:01:16,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:16,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43290a04df09a44ecdca HTTP/1.1" 200 None 2026-04-14 07:01:16,359 - lava_callback - ERROR - Error processing callback for node 69db43290a04df09a44ecdca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET /node/695c79e45dac150a0e83db93%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-14 07:01:36,315 - lava_callback - INFO - Received callback for node 69db43460a04df09a44ece07 INFO: 172.20.0.1:60990 - "POST /node/69db43460a04df09a44ece07 HTTP/1.0" 202 Accepted 2026-04-14 07:01:36,320 - lava_callback - INFO - Starting async job submit for node 69db43460a04df09a44ece07 2026-04-14 07:01:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:36,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43460a04df09a44ece07 HTTP/1.1" 200 None 2026-04-14 07:01:36,336 - lava_callback - DEBUG - Processing node 69db43460a04df09a44ece07: baseline-arm-baylibre 2026-04-14 07:01:36,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43460a04df09a44ece07 2026-04-14 07:01:36,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:36,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43460a04df09a44ece07 HTTP/1.1" 200 None 2026-04-14 07:01:36,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:36,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:01:36,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:01:36,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43460a04df09a44ece07 HTTP/1.1" 200 None 2026-04-14 07:01:36,414 - lava_callback - ERROR - Error processing callback for node 69db43460a04df09a44ece07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 07:02:16,337 - lava_callback - INFO - Received callback for node 69db43660a04df09a44ece3a INFO: 172.20.0.1:48168 - "POST /node/69db43660a04df09a44ece3a HTTP/1.0" 202 Accepted 2026-04-14 07:02:16,342 - lava_callback - INFO - Starting async job submit for node 69db43660a04df09a44ece3a 2026-04-14 07:02:16,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:16,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43660a04df09a44ece3a HTTP/1.1" 200 None 2026-04-14 07:02:16,358 - lava_callback - DEBUG - Processing node 69db43660a04df09a44ece3a: baseline-arm-baylibre 2026-04-14 07:02:16,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43660a04df09a44ece3a 2026-04-14 07:02:16,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:16,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43660a04df09a44ece3a HTTP/1.1" 200 None 2026-04-14 07:02:16,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:16,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:02:16,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:16,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43660a04df09a44ece3a HTTP/1.1" 200 None 2026-04-14 07:02:16,410 - lava_callback - ERROR - Error processing callback for node 69db43660a04df09a44ece3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48524 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:02:36,350 - lava_callback - INFO - Received callback for node 69db43840a04df09a44ece6e INFO: 172.20.0.1:51712 - "POST /node/69db43840a04df09a44ece6e HTTP/1.0" 202 Accepted 2026-04-14 07:02:36,355 - lava_callback - INFO - Starting async job submit for node 69db43840a04df09a44ece6e 2026-04-14 07:02:36,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:36,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43840a04df09a44ece6e HTTP/1.1" 200 None 2026-04-14 07:02:36,371 - lava_callback - DEBUG - Processing node 69db43840a04df09a44ece6e: baseline-arm-baylibre 2026-04-14 07:02:36,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43840a04df09a44ece6e 2026-04-14 07:02:36,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:36,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43840a04df09a44ece6e HTTP/1.1" 200 None 2026-04-14 07:02:36,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:36,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:02:36,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:02:36,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43840a04df09a44ece6e HTTP/1.1" 200 None 2026-04-14 07:02:36,452 - lava_callback - ERROR - Error processing callback for node 69db43840a04df09a44ece6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51082 - "GET /node/698ef62df0e3ffbba67d2f0a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET /node/69c963abf2866272ea51e775%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47528 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-14 07:03:16,397 - lava_callback - INFO - Received callback for node 69db43ae0a04df09a44ece87 INFO: 172.20.0.1:47534 - "POST /node/69db43ae0a04df09a44ece87 HTTP/1.0" 202 Accepted 2026-04-14 07:03:16,403 - lava_callback - INFO - Starting async job submit for node 69db43ae0a04df09a44ece87 2026-04-14 07:03:16,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:03:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43ae0a04df09a44ece87 HTTP/1.1" 200 None 2026-04-14 07:03:16,419 - lava_callback - DEBUG - Processing node 69db43ae0a04df09a44ece87: baseline-arm64-baylibre 2026-04-14 07:03:16,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43ae0a04df09a44ece87 2026-04-14 07:03:16,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:03:16,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43ae0a04df09a44ece87 HTTP/1.1" 200 None 2026-04-14 07:03:16,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:03:16,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:03:16,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:03:16,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43ae0a04df09a44ece87 HTTP/1.1" 200 None 2026-04-14 07:03:16,468 - lava_callback - ERROR - Error processing callback for node 69db43ae0a04df09a44ece87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52860 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:04:16,530 - lava_callback - INFO - Received callback for node 69db43ee0a04df09a44ecee4 INFO: 172.20.0.1:52866 - "POST /node/69db43ee0a04df09a44ecee4 HTTP/1.0" 202 Accepted 2026-04-14 07:04:16,535 - lava_callback - INFO - Starting async job submit for node 69db43ee0a04df09a44ecee4 2026-04-14 07:04:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:04:16,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43ee0a04df09a44ecee4 HTTP/1.1" 200 None 2026-04-14 07:04:16,553 - lava_callback - DEBUG - Processing node 69db43ee0a04df09a44ecee4: baseline-arm64-baylibre 2026-04-14 07:04:16,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db43ee0a04df09a44ecee4 2026-04-14 07:04:16,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:04:16,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db43ee0a04df09a44ecee4 HTTP/1.1" 200 None 2026-04-14 07:04:16,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:04:16,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:04:16,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:04:16,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db43ee0a04df09a44ecee4 HTTP/1.1" 200 None 2026-04-14 07:04:16,602 - lava_callback - ERROR - Error processing callback for node 69db43ee0a04df09a44ecee4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45624 - "GET /node/693f74940d8ce4018da93d89%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45636 - "GET /node/695195e62df1719e393cb48b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39530 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:05:36,543 - lava_callback - INFO - Received callback for node 69db442b0a04df09a44ecf55 INFO: 172.20.0.1:39542 - "POST /node/69db442b0a04df09a44ecf55 HTTP/1.0" 202 Accepted 2026-04-14 07:05:36,549 - lava_callback - INFO - Starting async job submit for node 69db442b0a04df09a44ecf55 2026-04-14 07:05:36,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:05:36,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db442b0a04df09a44ecf55 HTTP/1.1" 200 None 2026-04-14 07:05:36,569 - lava_callback - DEBUG - Processing node 69db442b0a04df09a44ecf55: baseline-arm64-baylibre 2026-04-14 07:05:36,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db442b0a04df09a44ecf55 2026-04-14 07:05:36,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:05:36,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db442b0a04df09a44ecf55 HTTP/1.1" 200 None 2026-04-14 07:05:36,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:05:36,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:05:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:05:36,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db442b0a04df09a44ecf55 HTTP/1.1" 200 None 2026-04-14 07:05:36,641 - lava_callback - ERROR - Error processing callback for node 69db442b0a04df09a44ecf55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET /node/69c02d5ec3d73288b0d08328%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58728 - "GET /node/698af5e93b3beb19e7616efa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:11:56,949 - lava_callback - INFO - Received callback for node 69db45ba0a04df09a44ed115 INFO: 172.20.0.1:38202 - "POST /node/69db45ba0a04df09a44ed115 HTTP/1.0" 202 Accepted 2026-04-14 07:11:56,958 - lava_callback - INFO - Starting async job submit for node 69db45ba0a04df09a44ed115 2026-04-14 07:11:56,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:11:56,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db45ba0a04df09a44ed115 HTTP/1.1" 200 None 2026-04-14 07:11:56,974 - lava_callback - DEBUG - Processing node 69db45ba0a04df09a44ed115: baseline-arm64-baylibre 2026-04-14 07:11:56,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db45ba0a04df09a44ed115 2026-04-14 07:11:56,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:11:56,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db45ba0a04df09a44ed115 HTTP/1.1" 200 None 2026-04-14 07:11:56,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:11:57,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:11:57,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:11:57,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db45ba0a04df09a44ed115 HTTP/1.1" 200 None 2026-04-14 07:11:57,034 - lava_callback - ERROR - Error processing callback for node 69db45ba0a04df09a44ed115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET /node/693b7b2a41fb4c9509762ce4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:13:17,206 - lava_callback - INFO - Received callback for node 69db45fc0a04df09a44ed192 INFO: 172.20.0.1:46556 - "POST /node/69db45fc0a04df09a44ed192 HTTP/1.0" 202 Accepted 2026-04-14 07:13:17,211 - lava_callback - INFO - Starting async job submit for node 69db45fc0a04df09a44ed192 2026-04-14 07:13:17,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:13:17,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db45fc0a04df09a44ed192 HTTP/1.1" 200 None 2026-04-14 07:13:17,227 - lava_callback - DEBUG - Processing node 69db45fc0a04df09a44ed192: baseline-arm64-baylibre 2026-04-14 07:13:17,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db45fc0a04df09a44ed192 2026-04-14 07:13:17,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:13:17,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db45fc0a04df09a44ed192 HTTP/1.1" 200 None 2026-04-14 07:13:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:13:17,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:13:17,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:13:17,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db45fc0a04df09a44ed192 HTTP/1.1" 200 None 2026-04-14 07:13:17,276 - lava_callback - ERROR - Error processing callback for node 69db45fc0a04df09a44ed192: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36310 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:15:37,100 - lava_callback - INFO - Received callback for node 69db46920a04df09a44ed239 INFO: 172.20.0.1:36318 - "POST /node/69db46920a04df09a44ed239 HTTP/1.0" 202 Accepted 2026-04-14 07:15:37,106 - lava_callback - INFO - Starting async job submit for node 69db46920a04df09a44ed239 2026-04-14 07:15:37,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:15:37,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db46920a04df09a44ed239 HTTP/1.1" 200 None 2026-04-14 07:15:37,122 - lava_callback - DEBUG - Processing node 69db46920a04df09a44ed239: baseline-arm64-baylibre 2026-04-14 07:15:37,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db46920a04df09a44ed239 2026-04-14 07:15:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:15:37,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db46920a04df09a44ed239 HTTP/1.1" 200 None 2026-04-14 07:15:37,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:15:37,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:15:37,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:15:37,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db46920a04df09a44ed239 HTTP/1.1" 200 None 2026-04-14 07:15:37,171 - lava_callback - ERROR - Error processing callback for node 69db46920a04df09a44ed239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45742 - "GET /node/69937937cebe99dd8e06b44b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:16:57,170 - lava_callback - INFO - Received callback for node 69db46d70a04df09a44ed28a INFO: 172.20.0.1:42094 - "POST /node/69db46d70a04df09a44ed28a HTTP/1.0" 202 Accepted 2026-04-14 07:16:57,176 - lava_callback - INFO - Starting async job submit for node 69db46d70a04df09a44ed28a 2026-04-14 07:16:57,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:16:57,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db46d70a04df09a44ed28a HTTP/1.1" 200 None 2026-04-14 07:16:57,193 - lava_callback - DEBUG - Processing node 69db46d70a04df09a44ed28a: baseline-arm64-baylibre 2026-04-14 07:16:57,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db46d70a04df09a44ed28a 2026-04-14 07:16:57,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:16:57,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db46d70a04df09a44ed28a HTTP/1.1" 200 None 2026-04-14 07:16:57,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:16:57,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:16:57,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:16:57,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db46d70a04df09a44ed28a HTTP/1.1" 200 None 2026-04-14 07:16:57,253 - lava_callback - ERROR - Error processing callback for node 69db46d70a04df09a44ed28a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35184 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:18:02,642 - lava_callback - INFO - Received callback for node 69db47210a04df09a44ed2c5 INFO: 172.20.0.1:56770 - "POST /node/69db47210a04df09a44ed2c5 HTTP/1.0" 202 Accepted 2026-04-14 07:18:02,648 - lava_callback - INFO - Starting async job submit for node 69db47210a04df09a44ed2c5 2026-04-14 07:18:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:18:02,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47210a04df09a44ed2c5 HTTP/1.1" 200 None 2026-04-14 07:18:02,664 - lava_callback - DEBUG - Processing node 69db47210a04df09a44ed2c5: baseline-arm64-clabbe 2026-04-14 07:18:02,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db47210a04df09a44ed2c5 2026-04-14 07:18:02,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:18:02,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47210a04df09a44ed2c5 HTTP/1.1" 200 None 2026-04-14 07:18:02,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:18:02,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:18:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:18:02,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db47210a04df09a44ed2c5 HTTP/1.1" 200 None 2026-04-14 07:18:02,710 - lava_callback - ERROR - Error processing callback for node 69db47210a04df09a44ed2c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:19:22,675 - lava_callback - INFO - Received callback for node 69db47690a04df09a44ed30f INFO: 172.20.0.1:55030 - "POST /node/69db47690a04df09a44ed30f HTTP/1.0" 202 Accepted 2026-04-14 07:19:22,681 - lava_callback - INFO - Starting async job submit for node 69db47690a04df09a44ed30f 2026-04-14 07:19:22,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:19:22,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47690a04df09a44ed30f HTTP/1.1" 200 None 2026-04-14 07:19:22,697 - lava_callback - DEBUG - Processing node 69db47690a04df09a44ed30f: baseline-arm64-clabbe 2026-04-14 07:19:22,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db47690a04df09a44ed30f 2026-04-14 07:19:22,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:19:22,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47690a04df09a44ed30f HTTP/1.1" 200 None 2026-04-14 07:19:22,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:19:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:19:22,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:19:22,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db47690a04df09a44ed30f HTTP/1.1" 200 None 2026-04-14 07:19:22,778 - lava_callback - ERROR - Error processing callback for node 69db47690a04df09a44ed30f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:20:22,740 - lava_callback - INFO - Received callback for node 69db47b10a04df09a44ed35b INFO: 172.20.0.1:53452 - "POST /node/69db47b10a04df09a44ed35b HTTP/1.0" 202 Accepted 2026-04-14 07:20:22,745 - lava_callback - INFO - Starting async job submit for node 69db47b10a04df09a44ed35b 2026-04-14 07:20:22,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:20:22,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47b10a04df09a44ed35b HTTP/1.1" 200 None 2026-04-14 07:20:22,766 - lava_callback - DEBUG - Processing node 69db47b10a04df09a44ed35b: baseline-arm64-clabbe 2026-04-14 07:20:22,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db47b10a04df09a44ed35b 2026-04-14 07:20:22,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:20:22,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47b10a04df09a44ed35b HTTP/1.1" 200 None 2026-04-14 07:20:22,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:20:22,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:20:22,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:20:22,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db47b10a04df09a44ed35b HTTP/1.1" 200 None 2026-04-14 07:20:22,816 - lava_callback - ERROR - Error processing callback for node 69db47b10a04df09a44ed35b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45878 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:21:42,778 - lava_callback - INFO - Received callback for node 69db47f70a04df09a44ed3be INFO: 172.20.0.1:43970 - "POST /node/69db47f70a04df09a44ed3be HTTP/1.0" 202 Accepted 2026-04-14 07:21:42,783 - lava_callback - INFO - Starting async job submit for node 69db47f70a04df09a44ed3be 2026-04-14 07:21:42,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:21:42,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47f70a04df09a44ed3be HTTP/1.1" 200 None 2026-04-14 07:21:42,801 - lava_callback - DEBUG - Processing node 69db47f70a04df09a44ed3be: baseline-arm64-clabbe 2026-04-14 07:21:42,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db47f70a04df09a44ed3be 2026-04-14 07:21:42,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:21:42,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db47f70a04df09a44ed3be HTTP/1.1" 200 None 2026-04-14 07:21:42,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:21:42,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:21:42,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:21:42,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db47f70a04df09a44ed3be HTTP/1.1" 200 None 2026-04-14 07:21:42,867 - lava_callback - ERROR - Error processing callback for node 69db47f70a04df09a44ed3be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:22:42,878 - lava_callback - INFO - Received callback for node 69db48390a04df09a44ed40b INFO: 172.20.0.1:38926 - "POST /node/69db48390a04df09a44ed40b HTTP/1.0" 202 Accepted 2026-04-14 07:22:42,884 - lava_callback - INFO - Starting async job submit for node 69db48390a04df09a44ed40b 2026-04-14 07:22:42,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:22:42,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48390a04df09a44ed40b HTTP/1.1" 200 None 2026-04-14 07:22:42,905 - lava_callback - DEBUG - Processing node 69db48390a04df09a44ed40b: baseline-arm64-clabbe 2026-04-14 07:22:42,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db48390a04df09a44ed40b 2026-04-14 07:22:42,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:22:42,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48390a04df09a44ed40b HTTP/1.1" 200 None 2026-04-14 07:22:42,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:22:42,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:22:42,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:22:42,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db48390a04df09a44ed40b HTTP/1.1" 200 None 2026-04-14 07:22:42,954 - lava_callback - ERROR - Error processing callback for node 69db48390a04df09a44ed40b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:24:02,922 - lava_callback - INFO - Received callback for node 69db48800a04df09a44ed457 INFO: 172.20.0.1:52006 - "POST /node/69db48800a04df09a44ed457 HTTP/1.0" 202 Accepted 2026-04-14 07:24:02,928 - lava_callback - INFO - Starting async job submit for node 69db48800a04df09a44ed457 2026-04-14 07:24:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:24:02,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48800a04df09a44ed457 HTTP/1.1" 200 None 2026-04-14 07:24:02,948 - lava_callback - DEBUG - Processing node 69db48800a04df09a44ed457: baseline-arm64-clabbe 2026-04-14 07:24:02,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db48800a04df09a44ed457 2026-04-14 07:24:02,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:24:02,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48800a04df09a44ed457 HTTP/1.1" 200 None 2026-04-14 07:24:02,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:24:03,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:24:03,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:24:03,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db48800a04df09a44ed457 HTTP/1.1" 200 None 2026-04-14 07:24:03,049 - lava_callback - ERROR - Error processing callback for node 69db48800a04df09a44ed457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:25:02,894 - lava_callback - INFO - Received callback for node 69db48c30a04df09a44ed497 INFO: 172.20.0.1:46732 - "POST /node/69db48c30a04df09a44ed497 HTTP/1.0" 202 Accepted 2026-04-14 07:25:02,899 - lava_callback - INFO - Starting async job submit for node 69db48c30a04df09a44ed497 2026-04-14 07:25:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:02,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48c30a04df09a44ed497 HTTP/1.1" 200 None 2026-04-14 07:25:02,915 - lava_callback - DEBUG - Processing node 69db48c30a04df09a44ed497: baseline-arm64-clabbe 2026-04-14 07:25:02,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db48c30a04df09a44ed497 2026-04-14 07:25:02,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:02,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48c30a04df09a44ed497 HTTP/1.1" 200 None 2026-04-14 07:25:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:02,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-14 07:25:02,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:02,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db48c30a04df09a44ed497 HTTP/1.1" 200 None 2026-04-14 07:25:02,966 - lava_callback - ERROR - Error processing callback for node 69db48c30a04df09a44ed497: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56608 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:25:57,677 - lava_callback - INFO - Received callback for node 69db48fe0a04df09a44ed4e8 INFO: 172.20.0.1:56610 - "POST /node/69db48fe0a04df09a44ed4e8 HTTP/1.0" 202 Accepted 2026-04-14 07:25:57,686 - lava_callback - INFO - Starting async job submit for node 69db48fe0a04df09a44ed4e8 2026-04-14 07:25:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:57,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48fe0a04df09a44ed4e8 HTTP/1.1" 200 None 2026-04-14 07:25:57,707 - lava_callback - DEBUG - Processing node 69db48fe0a04df09a44ed4e8: baseline-arm64-baylibre 2026-04-14 07:25:57,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db48fe0a04df09a44ed4e8 2026-04-14 07:25:57,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:57,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db48fe0a04df09a44ed4e8 HTTP/1.1" 200 None 2026-04-14 07:25:57,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:57,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:25:57,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:25:57,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db48fe0a04df09a44ed4e8 HTTP/1.1" 200 None 2026-04-14 07:25:57,783 - lava_callback - ERROR - Error processing callback for node 69db48fe0a04df09a44ed4e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52038 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:29:37,885 - lava_callback - INFO - Received callback for node 69db49ce0a04df09a44ed5ad INFO: 172.20.0.1:52046 - "POST /node/69db49ce0a04df09a44ed5ad HTTP/1.0" 202 Accepted 2026-04-14 07:29:37,895 - lava_callback - INFO - Starting async job submit for node 69db49ce0a04df09a44ed5ad 2026-04-14 07:29:37,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:29:37,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db49ce0a04df09a44ed5ad HTTP/1.1" 200 None 2026-04-14 07:29:37,914 - lava_callback - DEBUG - Processing node 69db49ce0a04df09a44ed5ad: baseline-arm64-baylibre 2026-04-14 07:29:37,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db49ce0a04df09a44ed5ad 2026-04-14 07:29:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:29:37,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db49ce0a04df09a44ed5ad HTTP/1.1" 200 None 2026-04-14 07:29:37,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:29:37,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:29:37,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:29:37,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db49ce0a04df09a44ed5ad HTTP/1.1" 200 None 2026-04-14 07:29:37,964 - lava_callback - ERROR - Error processing callback for node 69db49ce0a04df09a44ed5ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:30:23,198 - lava_callback - INFO - Received callback for node 69db4a070a04df09a44ed605 INFO: 172.20.0.1:54116 - "POST /node/69db4a070a04df09a44ed605 HTTP/1.0" 202 Accepted 2026-04-14 07:30:23,203 - lava_callback - INFO - Starting async job submit for node 69db4a070a04df09a44ed605 2026-04-14 07:30:23,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:30:23,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a070a04df09a44ed605 HTTP/1.1" 200 None 2026-04-14 07:30:23,221 - lava_callback - DEBUG - Processing node 69db4a070a04df09a44ed605: baseline-arm-clabbe 2026-04-14 07:30:23,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4a070a04df09a44ed605 2026-04-14 07:30:23,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:30:23,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a070a04df09a44ed605 HTTP/1.1" 200 None 2026-04-14 07:30:23,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:30:23,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:30:23,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:30:23,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4a070a04df09a44ed605 HTTP/1.1" 200 None 2026-04-14 07:30:23,284 - lava_callback - ERROR - Error processing callback for node 69db4a070a04df09a44ed605: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34988 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:31:03,168 - lava_callback - INFO - Received callback for node 69db4a240a04df09a44ed629 INFO: 172.20.0.1:59974 - "POST /node/69db4a240a04df09a44ed629 HTTP/1.0" 202 Accepted 2026-04-14 07:31:03,174 - lava_callback - INFO - Starting async job submit for node 69db4a240a04df09a44ed629 2026-04-14 07:31:03,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:03,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a240a04df09a44ed629 HTTP/1.1" 200 None 2026-04-14 07:31:03,190 - lava_callback - DEBUG - Processing node 69db4a240a04df09a44ed629: baseline-arm-clabbe 2026-04-14 07:31:03,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4a240a04df09a44ed629 2026-04-14 07:31:03,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:03,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a240a04df09a44ed629 HTTP/1.1" 200 None 2026-04-14 07:31:03,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:03,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:31:03,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:03,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4a240a04df09a44ed629 HTTP/1.1" 200 None 2026-04-14 07:31:03,240 - lava_callback - ERROR - Error processing callback for node 69db4a240a04df09a44ed629: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:31:37,995 - lava_callback - INFO - Received callback for node 69db4a510a04df09a44ed654 INFO: 172.20.0.1:55608 - "POST /node/69db4a510a04df09a44ed654 HTTP/1.0" 202 Accepted 2026-04-14 07:31:38,001 - lava_callback - INFO - Starting async job submit for node 69db4a510a04df09a44ed654 2026-04-14 07:31:38,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:38,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a510a04df09a44ed654 HTTP/1.1" 200 None 2026-04-14 07:31:38,017 - lava_callback - DEBUG - Processing node 69db4a510a04df09a44ed654: baseline-arm64-baylibre 2026-04-14 07:31:38,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4a510a04df09a44ed654 2026-04-14 07:31:38,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:38,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a510a04df09a44ed654 HTTP/1.1" 200 None 2026-04-14 07:31:38,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:38,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:31:38,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:31:38,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4a510a04df09a44ed654 HTTP/1.1" 200 None 2026-04-14 07:31:38,074 - lava_callback - ERROR - Error processing callback for node 69db4a510a04df09a44ed654: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:32:43,341 - lava_callback - INFO - Received callback for node 69db4a960a04df09a44ed6aa INFO: 172.20.0.1:48606 - "POST /node/69db4a960a04df09a44ed6aa HTTP/1.0" 202 Accepted 2026-04-14 07:32:43,348 - lava_callback - INFO - Starting async job submit for node 69db4a960a04df09a44ed6aa 2026-04-14 07:32:43,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:32:43,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a960a04df09a44ed6aa HTTP/1.1" 200 None 2026-04-14 07:32:43,366 - lava_callback - DEBUG - Processing node 69db4a960a04df09a44ed6aa: baseline-arm64-clabbe 2026-04-14 07:32:43,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4a960a04df09a44ed6aa 2026-04-14 07:32:43,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:32:43,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4a960a04df09a44ed6aa HTTP/1.1" 200 None 2026-04-14 07:32:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:32:43,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:32:43,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:32:43,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4a960a04df09a44ed6aa HTTP/1.1" 200 None 2026-04-14 07:32:43,428 - lava_callback - ERROR - Error processing callback for node 69db4a960a04df09a44ed6aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:35:03,339 - lava_callback - INFO - Received callback for node 69db4b1f0a04df09a44ed723 INFO: 172.20.0.1:49864 - "POST /node/69db4b1f0a04df09a44ed723 HTTP/1.0" 202 Accepted 2026-04-14 07:35:03,345 - lava_callback - INFO - Starting async job submit for node 69db4b1f0a04df09a44ed723 2026-04-14 07:35:03,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:35:03,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4b1f0a04df09a44ed723 HTTP/1.1" 200 None 2026-04-14 07:35:03,360 - lava_callback - DEBUG - Processing node 69db4b1f0a04df09a44ed723: baseline-arm64-clabbe 2026-04-14 07:35:03,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4b1f0a04df09a44ed723 2026-04-14 07:35:03,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:35:03,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4b1f0a04df09a44ed723 HTTP/1.1" 200 None 2026-04-14 07:35:03,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:35:03,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:35:03,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:35:03,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4b1f0a04df09a44ed723 HTTP/1.1" 200 None 2026-04-14 07:35:03,423 - lava_callback - ERROR - Error processing callback for node 69db4b1f0a04df09a44ed723: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50220 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:37:23,481 - lava_callback - INFO - Received callback for node 69db4ba20a04df09a44ed7d2 INFO: 172.20.0.1:43746 - "POST /node/69db4ba20a04df09a44ed7d2 HTTP/1.0" 202 Accepted 2026-04-14 07:37:23,486 - lava_callback - INFO - Starting async job submit for node 69db4ba20a04df09a44ed7d2 2026-04-14 07:37:23,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:37:23,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4ba20a04df09a44ed7d2 HTTP/1.1" 200 None 2026-04-14 07:37:23,502 - lava_callback - DEBUG - Processing node 69db4ba20a04df09a44ed7d2: baseline-arm64-clabbe 2026-04-14 07:37:23,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4ba20a04df09a44ed7d2 2026-04-14 07:37:23,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:37:23,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4ba20a04df09a44ed7d2 HTTP/1.1" 200 None 2026-04-14 07:37:23,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:37:23,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:37:23,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:37:23,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4ba20a04df09a44ed7d2 HTTP/1.1" 200 None 2026-04-14 07:37:23,552 - lava_callback - ERROR - Error processing callback for node 69db4ba20a04df09a44ed7d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:38:23,520 - lava_callback - INFO - Received callback for node 69db4be80a04df09a44ed820 INFO: 172.20.0.1:60686 - "POST /node/69db4be80a04df09a44ed820 HTTP/1.0" 202 Accepted 2026-04-14 07:38:23,526 - lava_callback - INFO - Starting async job submit for node 69db4be80a04df09a44ed820 2026-04-14 07:38:23,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:38:23,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4be80a04df09a44ed820 HTTP/1.1" 200 None 2026-04-14 07:38:23,541 - lava_callback - DEBUG - Processing node 69db4be80a04df09a44ed820: baseline-arm64-clabbe 2026-04-14 07:38:23,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4be80a04df09a44ed820 2026-04-14 07:38:23,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:38:23,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4be80a04df09a44ed820 HTTP/1.1" 200 None 2026-04-14 07:38:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:38:23,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:38:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:38:23,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4be80a04df09a44ed820 HTTP/1.1" 200 None 2026-04-14 07:38:23,597 - lava_callback - ERROR - Error processing callback for node 69db4be80a04df09a44ed820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:39:43,571 - lava_callback - INFO - Received callback for node 69db4c2f0a04df09a44ed857 INFO: 172.20.0.1:51744 - "POST /node/69db4c2f0a04df09a44ed857 HTTP/1.0" 202 Accepted 2026-04-14 07:39:43,577 - lava_callback - INFO - Starting async job submit for node 69db4c2f0a04df09a44ed857 2026-04-14 07:39:43,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:39:43,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4c2f0a04df09a44ed857 HTTP/1.1" 200 None 2026-04-14 07:39:43,604 - lava_callback - DEBUG - Processing node 69db4c2f0a04df09a44ed857: baseline-arm64-clabbe 2026-04-14 07:39:43,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4c2f0a04df09a44ed857 2026-04-14 07:39:43,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:39:43,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4c2f0a04df09a44ed857 HTTP/1.1" 200 None 2026-04-14 07:39:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:39:43,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:39:43,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:39:43,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4c2f0a04df09a44ed857 HTTP/1.1" 200 None 2026-04-14 07:39:43,674 - lava_callback - ERROR - Error processing callback for node 69db4c2f0a04df09a44ed857: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:40:43,647 - lava_callback - INFO - Received callback for node 69db4c720a04df09a44ed8b3 INFO: 172.20.0.1:56500 - "POST /node/69db4c720a04df09a44ed8b3 HTTP/1.0" 202 Accepted 2026-04-14 07:40:43,653 - lava_callback - INFO - Starting async job submit for node 69db4c720a04df09a44ed8b3 2026-04-14 07:40:43,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:40:43,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4c720a04df09a44ed8b3 HTTP/1.1" 200 None 2026-04-14 07:40:43,671 - lava_callback - DEBUG - Processing node 69db4c720a04df09a44ed8b3: baseline-arm64-clabbe 2026-04-14 07:40:43,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4c720a04df09a44ed8b3 2026-04-14 07:40:43,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:40:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4c720a04df09a44ed8b3 HTTP/1.1" 200 None 2026-04-14 07:40:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:40:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:40:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:40:43,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4c720a04df09a44ed8b3 HTTP/1.1" 200 None 2026-04-14 07:40:43,740 - lava_callback - ERROR - Error processing callback for node 69db4c720a04df09a44ed8b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:42:03,705 - lava_callback - INFO - Received callback for node 69db4cb60a04df09a44ed8f1 INFO: 172.20.0.1:36784 - "POST /node/69db4cb60a04df09a44ed8f1 HTTP/1.0" 202 Accepted 2026-04-14 07:42:03,711 - lava_callback - INFO - Starting async job submit for node 69db4cb60a04df09a44ed8f1 2026-04-14 07:42:03,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:42:03,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4cb60a04df09a44ed8f1 HTTP/1.1" 200 None 2026-04-14 07:42:03,728 - lava_callback - DEBUG - Processing node 69db4cb60a04df09a44ed8f1: baseline-arm64-clabbe 2026-04-14 07:42:03,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4cb60a04df09a44ed8f1 2026-04-14 07:42:03,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:42:03,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4cb60a04df09a44ed8f1 HTTP/1.1" 200 None 2026-04-14 07:42:03,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:42:03,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:42:03,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:42:03,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4cb60a04df09a44ed8f1 HTTP/1.1" 200 None 2026-04-14 07:42:03,794 - lava_callback - ERROR - Error processing callback for node 69db4cb60a04df09a44ed8f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56660 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:43:03,723 - lava_callback - INFO - Received callback for node 69db4cfa0a04df09a44ed93e INFO: 172.20.0.1:33294 - "POST /node/69db4cfa0a04df09a44ed93e HTTP/1.0" 202 Accepted 2026-04-14 07:43:03,733 - lava_callback - INFO - Starting async job submit for node 69db4cfa0a04df09a44ed93e 2026-04-14 07:43:03,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:43:03,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4cfa0a04df09a44ed93e HTTP/1.1" 200 None 2026-04-14 07:43:03,752 - lava_callback - DEBUG - Processing node 69db4cfa0a04df09a44ed93e: baseline-arm64-clabbe 2026-04-14 07:43:03,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4cfa0a04df09a44ed93e 2026-04-14 07:43:03,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:43:03,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4cfa0a04df09a44ed93e HTTP/1.1" 200 None 2026-04-14 07:43:03,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:43:03,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:43:03,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:43:03,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4cfa0a04df09a44ed93e HTTP/1.1" 200 None 2026-04-14 07:43:03,816 - lava_callback - ERROR - Error processing callback for node 69db4cfa0a04df09a44ed93e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:44:03,763 - lava_callback - INFO - Received callback for node 69db4d3e0a04df09a44ed992 INFO: 172.20.0.1:40314 - "POST /node/69db4d3e0a04df09a44ed992 HTTP/1.0" 202 Accepted 2026-04-14 07:44:03,769 - lava_callback - INFO - Starting async job submit for node 69db4d3e0a04df09a44ed992 2026-04-14 07:44:03,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:44:03,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4d3e0a04df09a44ed992 HTTP/1.1" 200 None 2026-04-14 07:44:03,795 - lava_callback - DEBUG - Processing node 69db4d3e0a04df09a44ed992: baseline-arm64-clabbe 2026-04-14 07:44:03,795 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4d3e0a04df09a44ed992 2026-04-14 07:44:03,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:44:03,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4d3e0a04df09a44ed992 HTTP/1.1" 200 None 2026-04-14 07:44:03,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:44:03,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:44:03,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:44:03,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4d3e0a04df09a44ed992 HTTP/1.1" 200 None 2026-04-14 07:44:03,844 - lava_callback - ERROR - Error processing callback for node 69db4d3e0a04df09a44ed992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59332 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:45:23,808 - lava_callback - INFO - Received callback for node 69db4d810a04df09a44ed9d7 INFO: 172.20.0.1:47204 - "POST /node/69db4d810a04df09a44ed9d7 HTTP/1.0" 202 Accepted 2026-04-14 07:45:23,814 - lava_callback - INFO - Starting async job submit for node 69db4d810a04df09a44ed9d7 2026-04-14 07:45:23,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:45:23,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4d810a04df09a44ed9d7 HTTP/1.1" 200 None 2026-04-14 07:45:23,832 - lava_callback - DEBUG - Processing node 69db4d810a04df09a44ed9d7: baseline-arm64-clabbe 2026-04-14 07:45:23,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4d810a04df09a44ed9d7 2026-04-14 07:45:23,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:45:23,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4d810a04df09a44ed9d7 HTTP/1.1" 200 None 2026-04-14 07:45:23,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:45:23,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:45:23,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:45:23,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4d810a04df09a44ed9d7 HTTP/1.1" 200 None 2026-04-14 07:45:23,893 - lava_callback - ERROR - Error processing callback for node 69db4d810a04df09a44ed9d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52672 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:46:23,934 - lava_callback - INFO - Received callback for node 69db4dc10a04df09a44eda2c INFO: 172.20.0.1:46992 - "POST /node/69db4dc10a04df09a44eda2c HTTP/1.0" 202 Accepted 2026-04-14 07:46:23,940 - lava_callback - INFO - Starting async job submit for node 69db4dc10a04df09a44eda2c 2026-04-14 07:46:23,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:46:23,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4dc10a04df09a44eda2c HTTP/1.1" 200 None 2026-04-14 07:46:23,965 - lava_callback - DEBUG - Processing node 69db4dc10a04df09a44eda2c: baseline-arm64-clabbe 2026-04-14 07:46:23,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4dc10a04df09a44eda2c 2026-04-14 07:46:23,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:46:23,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4dc10a04df09a44eda2c HTTP/1.1" 200 None 2026-04-14 07:46:23,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:46:23,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:46:23,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:46:24,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4dc10a04df09a44eda2c HTTP/1.1" 200 None 2026-04-14 07:46:24,018 - lava_callback - ERROR - Error processing callback for node 69db4dc10a04df09a44eda2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:47:23,953 - lava_callback - INFO - Received callback for node 69db4e080a04df09a44eda6c INFO: 172.20.0.1:58420 - "POST /node/69db4e080a04df09a44eda6c HTTP/1.0" 202 Accepted 2026-04-14 07:47:23,959 - lava_callback - INFO - Starting async job submit for node 69db4e080a04df09a44eda6c 2026-04-14 07:47:23,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:47:23,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e080a04df09a44eda6c HTTP/1.1" 200 None 2026-04-14 07:47:23,983 - lava_callback - DEBUG - Processing node 69db4e080a04df09a44eda6c: baseline-arm64-clabbe 2026-04-14 07:47:23,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4e080a04df09a44eda6c 2026-04-14 07:47:23,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:47:23,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e080a04df09a44eda6c HTTP/1.1" 200 None 2026-04-14 07:47:23,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:47:24,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:47:24,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:47:24,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4e080a04df09a44eda6c HTTP/1.1" 200 None 2026-04-14 07:47:24,034 - lava_callback - ERROR - Error processing callback for node 69db4e080a04df09a44eda6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:48:43,978 - lava_callback - INFO - Received callback for node 69db4e4f0a04df09a44edab0 INFO: 172.20.0.1:51510 - "POST /node/69db4e4f0a04df09a44edab0 HTTP/1.0" 202 Accepted 2026-04-14 07:48:43,987 - lava_callback - INFO - Starting async job submit for node 69db4e4f0a04df09a44edab0 2026-04-14 07:48:43,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:48:44,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e4f0a04df09a44edab0 HTTP/1.1" 200 None 2026-04-14 07:48:44,009 - lava_callback - DEBUG - Processing node 69db4e4f0a04df09a44edab0: baseline-arm64-clabbe 2026-04-14 07:48:44,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4e4f0a04df09a44edab0 2026-04-14 07:48:44,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:48:44,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e4f0a04df09a44edab0 HTTP/1.1" 200 None 2026-04-14 07:48:44,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:48:44,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:48:44,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:48:44,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4e4f0a04df09a44edab0 HTTP/1.1" 200 None 2026-04-14 07:48:44,069 - lava_callback - ERROR - Error processing callback for node 69db4e4f0a04df09a44edab0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40032 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:49:44,045 - lava_callback - INFO - Received callback for node 69db4e890a04df09a44edadd INFO: 172.20.0.1:39678 - "POST /node/69db4e890a04df09a44edadd HTTP/1.0" 202 Accepted 2026-04-14 07:49:44,051 - lava_callback - INFO - Starting async job submit for node 69db4e890a04df09a44edadd 2026-04-14 07:49:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:49:44,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e890a04df09a44edadd HTTP/1.1" 200 None 2026-04-14 07:49:44,069 - lava_callback - DEBUG - Processing node 69db4e890a04df09a44edadd: baseline-arm-clabbe 2026-04-14 07:49:44,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4e890a04df09a44edadd 2026-04-14 07:49:44,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:49:44,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4e890a04df09a44edadd HTTP/1.1" 200 None 2026-04-14 07:49:44,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:49:44,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:49:44,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:49:44,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4e890a04df09a44edadd HTTP/1.1" 200 None 2026-04-14 07:49:44,136 - lava_callback - ERROR - Error processing callback for node 69db4e890a04df09a44edadd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:50:23,999 - lava_callback - INFO - Received callback for node 69db4eae0a04df09a44edaee INFO: 172.20.0.1:60656 - "POST /node/69db4eae0a04df09a44edaee HTTP/1.0" 202 Accepted 2026-04-14 07:50:24,006 - lava_callback - INFO - Starting async job submit for node 69db4eae0a04df09a44edaee 2026-04-14 07:50:24,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:50:24,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4eae0a04df09a44edaee HTTP/1.1" 200 None 2026-04-14 07:50:24,023 - lava_callback - DEBUG - Processing node 69db4eae0a04df09a44edaee: baseline-arm-clabbe 2026-04-14 07:50:24,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4eae0a04df09a44edaee 2026-04-14 07:50:24,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:50:24,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4eae0a04df09a44edaee HTTP/1.1" 200 None 2026-04-14 07:50:24,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:50:24,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:50:24,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:50:24,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4eae0a04df09a44edaee HTTP/1.1" 200 None 2026-04-14 07:50:24,074 - lava_callback - ERROR - Error processing callback for node 69db4eae0a04df09a44edaee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51458 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:51:04,108 - lava_callback - INFO - Received callback for node 69db4edf0a04df09a44edb0a INFO: 172.20.0.1:50830 - "POST /node/69db4edf0a04df09a44edb0a HTTP/1.0" 202 Accepted 2026-04-14 07:51:04,114 - lava_callback - INFO - Starting async job submit for node 69db4edf0a04df09a44edb0a 2026-04-14 07:51:04,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:04,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4edf0a04df09a44edb0a HTTP/1.1" 200 None 2026-04-14 07:51:04,130 - lava_callback - DEBUG - Processing node 69db4edf0a04df09a44edb0a: baseline-arm64-clabbe 2026-04-14 07:51:04,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4edf0a04df09a44edb0a 2026-04-14 07:51:04,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4edf0a04df09a44edb0a HTTP/1.1" 200 None 2026-04-14 07:51:04,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:04,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-14 07:51:04,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4edf0a04df09a44edb0a HTTP/1.1" 200 None 2026-04-14 07:51:04,203 - lava_callback - ERROR - Error processing callback for node 69db4edf0a04df09a44edb0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:51:44,116 - lava_callback - INFO - Received callback for node 69db4f0a0a04df09a44edb76 INFO: 172.20.0.1:33844 - "POST /node/69db4f0a0a04df09a44edb76 HTTP/1.0" 202 Accepted 2026-04-14 07:51:44,121 - lava_callback - INFO - Starting async job submit for node 69db4f0a0a04df09a44edb76 2026-04-14 07:51:44,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:44,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f0a0a04df09a44edb76 HTTP/1.1" 200 None 2026-04-14 07:51:44,143 - lava_callback - DEBUG - Processing node 69db4f0a0a04df09a44edb76: baseline-arm-clabbe 2026-04-14 07:51:44,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4f0a0a04df09a44edb76 2026-04-14 07:51:44,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:44,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f0a0a04df09a44edb76 HTTP/1.1" 200 None 2026-04-14 07:51:44,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:44,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:51:44,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:51:44,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4f0a0a04df09a44edb76 HTTP/1.1" 200 None 2026-04-14 07:51:44,206 - lava_callback - ERROR - Error processing callback for node 69db4f0a0a04df09a44edb76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:52:24,152 - lava_callback - INFO - Received callback for node 69db4f2a0a04df09a44edb9e INFO: 172.20.0.1:42490 - "POST /node/69db4f2a0a04df09a44edb9e HTTP/1.0" 202 Accepted 2026-04-14 07:52:24,158 - lava_callback - INFO - Starting async job submit for node 69db4f2a0a04df09a44edb9e 2026-04-14 07:52:24,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:24,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f2a0a04df09a44edb9e HTTP/1.1" 200 None 2026-04-14 07:52:24,174 - lava_callback - DEBUG - Processing node 69db4f2a0a04df09a44edb9e: baseline-arm-clabbe 2026-04-14 07:52:24,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4f2a0a04df09a44edb9e 2026-04-14 07:52:24,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:24,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f2a0a04df09a44edb9e HTTP/1.1" 200 None 2026-04-14 07:52:24,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:24,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:52:24,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:24,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4f2a0a04df09a44edb9e HTTP/1.1" 200 None 2026-04-14 07:52:24,238 - lava_callback - ERROR - Error processing callback for node 69db4f2a0a04df09a44edb9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:52:44,147 - lava_callback - INFO - Received callback for node 69db4f480a04df09a44edbd3 INFO: 172.20.0.1:45592 - "POST /node/69db4f480a04df09a44edbd3 HTTP/1.0" 202 Accepted 2026-04-14 07:52:44,157 - lava_callback - INFO - Starting async job submit for node 69db4f480a04df09a44edbd3 2026-04-14 07:52:44,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:44,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f480a04df09a44edbd3 HTTP/1.1" 200 None 2026-04-14 07:52:44,175 - lava_callback - DEBUG - Processing node 69db4f480a04df09a44edbd3: baseline-arm-clabbe 2026-04-14 07:52:44,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4f480a04df09a44edbd3 2026-04-14 07:52:44,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:44,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f480a04df09a44edbd3 HTTP/1.1" 200 None 2026-04-14 07:52:44,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:44,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:52:44,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:52:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4f480a04df09a44edbd3 HTTP/1.1" 200 None 2026-04-14 07:52:44,238 - lava_callback - ERROR - Error processing callback for node 69db4f480a04df09a44edbd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41882 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:53:24,205 - lava_callback - INFO - Received callback for node 69db4f690a04df09a44edbfa INFO: 172.20.0.1:50330 - "POST /node/69db4f690a04df09a44edbfa HTTP/1.0" 202 Accepted 2026-04-14 07:53:24,211 - lava_callback - INFO - Starting async job submit for node 69db4f690a04df09a44edbfa 2026-04-14 07:53:24,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:53:24,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f690a04df09a44edbfa HTTP/1.1" 200 None 2026-04-14 07:53:24,227 - lava_callback - DEBUG - Processing node 69db4f690a04df09a44edbfa: baseline-arm-clabbe 2026-04-14 07:53:24,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4f690a04df09a44edbfa 2026-04-14 07:53:24,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:53:24,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f690a04df09a44edbfa HTTP/1.1" 200 None 2026-04-14 07:53:24,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:53:24,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:53:24,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:53:24,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4f690a04df09a44edbfa HTTP/1.1" 200 None 2026-04-14 07:53:24,291 - lava_callback - ERROR - Error processing callback for node 69db4f690a04df09a44edbfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:54:04,175 - lava_callback - INFO - Received callback for node 69db4f8d0a04df09a44edc0c INFO: 172.20.0.1:60762 - "POST /node/69db4f8d0a04df09a44edc0c HTTP/1.0" 202 Accepted 2026-04-14 07:54:04,181 - lava_callback - INFO - Starting async job submit for node 69db4f8d0a04df09a44edc0c 2026-04-14 07:54:04,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:04,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f8d0a04df09a44edc0c HTTP/1.1" 200 None 2026-04-14 07:54:04,200 - lava_callback - DEBUG - Processing node 69db4f8d0a04df09a44edc0c: baseline-arm-clabbe 2026-04-14 07:54:04,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4f8d0a04df09a44edc0c 2026-04-14 07:54:04,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:04,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4f8d0a04df09a44edc0c HTTP/1.1" 200 None 2026-04-14 07:54:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:04,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:54:04,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:04,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4f8d0a04df09a44edc0c HTTP/1.1" 200 None 2026-04-14 07:54:04,257 - lava_callback - ERROR - Error processing callback for node 69db4f8d0a04df09a44edc0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:54:39,490 - lava_callback - INFO - Received callback for node 69db4fab0a04df09a44edc2e INFO: 172.20.0.1:38932 - "POST /node/69db4fab0a04df09a44edc2e HTTP/1.0" 202 Accepted 2026-04-14 07:54:39,495 - lava_callback - INFO - Starting async job submit for node 69db4fab0a04df09a44edc2e 2026-04-14 07:54:39,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:39,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fab0a04df09a44edc2e HTTP/1.1" 200 None 2026-04-14 07:54:39,511 - lava_callback - DEBUG - Processing node 69db4fab0a04df09a44edc2e: baseline-arm-baylibre 2026-04-14 07:54:39,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4fab0a04df09a44edc2e 2026-04-14 07:54:39,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:39,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fab0a04df09a44edc2e HTTP/1.1" 200 None 2026-04-14 07:54:39,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:39,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:54:39,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:39,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4fab0a04df09a44edc2e HTTP/1.1" 200 None 2026-04-14 07:54:39,567 - lava_callback - ERROR - Error processing callback for node 69db4fab0a04df09a44edc2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:54:59,225 - lava_callback - INFO - Received callback for node 69db4fcc0a04df09a44edc37 INFO: 172.20.0.1:37638 - "POST /node/69db4fcc0a04df09a44edc37 HTTP/1.0" 202 Accepted 2026-04-14 07:54:59,230 - lava_callback - INFO - Starting async job submit for node 69db4fcc0a04df09a44edc37 2026-04-14 07:54:59,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:59,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fcc0a04df09a44edc37 HTTP/1.1" 200 None 2026-04-14 07:54:59,254 - lava_callback - DEBUG - Processing node 69db4fcc0a04df09a44edc37: baseline-arm-baylibre 2026-04-14 07:54:59,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4fcc0a04df09a44edc37 2026-04-14 07:54:59,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:59,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fcc0a04df09a44edc37 HTTP/1.1" 200 None 2026-04-14 07:54:59,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:59,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:54:59,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:54:59,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4fcc0a04df09a44edc37 HTTP/1.1" 200 None 2026-04-14 07:54:59,307 - lava_callback - ERROR - Error processing callback for node 69db4fcc0a04df09a44edc37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:55:39,277 - lava_callback - INFO - Received callback for node 69db4fed0a04df09a44edc58 INFO: 172.20.0.1:37468 - "POST /node/69db4fed0a04df09a44edc58 HTTP/1.0" 202 Accepted 2026-04-14 07:55:39,283 - lava_callback - INFO - Starting async job submit for node 69db4fed0a04df09a44edc58 2026-04-14 07:55:39,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:39,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fed0a04df09a44edc58 HTTP/1.1" 200 None 2026-04-14 07:55:39,298 - lava_callback - DEBUG - Processing node 69db4fed0a04df09a44edc58: baseline-arm-baylibre 2026-04-14 07:55:39,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db4fed0a04df09a44edc58 2026-04-14 07:55:39,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:39,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db4fed0a04df09a44edc58 HTTP/1.1" 200 None 2026-04-14 07:55:39,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:39,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:55:39,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:39,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db4fed0a04df09a44edc58 HTTP/1.1" 200 None 2026-04-14 07:55:39,346 - lava_callback - ERROR - Error processing callback for node 69db4fed0a04df09a44edc58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59674 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:55:59,342 - lava_callback - INFO - Received callback for node 69db50090a04df09a44edc73 INFO: 172.20.0.1:59676 - "POST /node/69db50090a04df09a44edc73 HTTP/1.0" 202 Accepted 2026-04-14 07:55:59,347 - lava_callback - INFO - Starting async job submit for node 69db50090a04df09a44edc73 2026-04-14 07:55:59,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:59,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50090a04df09a44edc73 HTTP/1.1" 200 None 2026-04-14 07:55:59,364 - lava_callback - DEBUG - Processing node 69db50090a04df09a44edc73: baseline-arm-baylibre 2026-04-14 07:55:59,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50090a04df09a44edc73 2026-04-14 07:55:59,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:59,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50090a04df09a44edc73 HTTP/1.1" 200 None 2026-04-14 07:55:59,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:59,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:55:59,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:55:59,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50090a04df09a44edc73 HTTP/1.1" 200 None 2026-04-14 07:55:59,429 - lava_callback - ERROR - Error processing callback for node 69db50090a04df09a44edc73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:56:39,331 - lava_callback - INFO - Received callback for node 69db502c0a04df09a44edcab INFO: 172.20.0.1:35994 - "POST /node/69db502c0a04df09a44edcab HTTP/1.0" 202 Accepted 2026-04-14 07:56:39,337 - lava_callback - INFO - Starting async job submit for node 69db502c0a04df09a44edcab 2026-04-14 07:56:39,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:56:39,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db502c0a04df09a44edcab HTTP/1.1" 200 None 2026-04-14 07:56:39,354 - lava_callback - DEBUG - Processing node 69db502c0a04df09a44edcab: baseline-arm-baylibre 2026-04-14 07:56:39,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db502c0a04df09a44edcab 2026-04-14 07:56:39,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:56:39,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db502c0a04df09a44edcab HTTP/1.1" 200 None 2026-04-14 07:56:39,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:56:39,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:56:39,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:56:39,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db502c0a04df09a44edcab HTTP/1.1" 200 None 2026-04-14 07:56:39,404 - lava_callback - ERROR - Error processing callback for node 69db502c0a04df09a44edcab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:57:19,436 - lava_callback - INFO - Received callback for node 69db50500a04df09a44edcc2 INFO: 172.20.0.1:46778 - "POST /node/69db50500a04df09a44edcc2 HTTP/1.0" 202 Accepted 2026-04-14 07:57:19,442 - lava_callback - INFO - Starting async job submit for node 69db50500a04df09a44edcc2 2026-04-14 07:57:19,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:19,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50500a04df09a44edcc2 HTTP/1.1" 200 None 2026-04-14 07:57:19,458 - lava_callback - DEBUG - Processing node 69db50500a04df09a44edcc2: baseline-arm-baylibre 2026-04-14 07:57:19,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50500a04df09a44edcc2 2026-04-14 07:57:19,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50500a04df09a44edcc2 HTTP/1.1" 200 None 2026-04-14 07:57:19,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:19,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:57:19,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:19,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50500a04df09a44edcc2 HTTP/1.1" 200 None 2026-04-14 07:57:19,511 - lava_callback - ERROR - Error processing callback for node 69db50500a04df09a44edcc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:57:59,439 - lava_callback - INFO - Received callback for node 69db50740a04df09a44edcd5 INFO: 172.20.0.1:57024 - "POST /node/69db50740a04df09a44edcd5 HTTP/1.0" 202 Accepted 2026-04-14 07:57:59,444 - lava_callback - INFO - Starting async job submit for node 69db50740a04df09a44edcd5 2026-04-14 07:57:59,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:59,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50740a04df09a44edcd5 HTTP/1.1" 200 None 2026-04-14 07:57:59,464 - lava_callback - DEBUG - Processing node 69db50740a04df09a44edcd5: baseline-arm-baylibre 2026-04-14 07:57:59,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50740a04df09a44edcd5 2026-04-14 07:57:59,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:59,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50740a04df09a44edcd5 HTTP/1.1" 200 None 2026-04-14 07:57:59,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:59,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:57:59,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:57:59,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50740a04df09a44edcd5 HTTP/1.1" 200 None 2026-04-14 07:57:59,511 - lava_callback - ERROR - Error processing callback for node 69db50740a04df09a44edcd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:58:19,455 - lava_callback - INFO - Received callback for node 69db50930a04df09a44edcf5 INFO: 172.20.0.1:42962 - "POST /node/69db50930a04df09a44edcf5 HTTP/1.0" 202 Accepted 2026-04-14 07:58:19,460 - lava_callback - INFO - Starting async job submit for node 69db50930a04df09a44edcf5 2026-04-14 07:58:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:19,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50930a04df09a44edcf5 HTTP/1.1" 200 None 2026-04-14 07:58:19,476 - lava_callback - DEBUG - Processing node 69db50930a04df09a44edcf5: baseline-arm-baylibre 2026-04-14 07:58:19,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50930a04df09a44edcf5 2026-04-14 07:58:19,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:19,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50930a04df09a44edcf5 HTTP/1.1" 200 None 2026-04-14 07:58:19,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:19,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:58:19,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:19,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50930a04df09a44edcf5 HTTP/1.1" 200 None 2026-04-14 07:58:19,531 - lava_callback - ERROR - Error processing callback for node 69db50930a04df09a44edcf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:58:59,540 - lava_callback - INFO - Received callback for node 69db50b20a04df09a44edd1a INFO: 172.20.0.1:60378 - "POST /node/69db50b20a04df09a44edd1a HTTP/1.0" 202 Accepted 2026-04-14 07:58:59,546 - lava_callback - INFO - Starting async job submit for node 69db50b20a04df09a44edd1a 2026-04-14 07:58:59,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:59,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50b20a04df09a44edd1a HTTP/1.1" 200 None 2026-04-14 07:58:59,561 - lava_callback - DEBUG - Processing node 69db50b20a04df09a44edd1a: baseline-arm-baylibre 2026-04-14 07:58:59,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50b20a04df09a44edd1a 2026-04-14 07:58:59,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:59,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50b20a04df09a44edd1a HTTP/1.1" 200 None 2026-04-14 07:58:59,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:59,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:58:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:58:59,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50b20a04df09a44edd1a HTTP/1.1" 200 None 2026-04-14 07:58:59,624 - lava_callback - ERROR - Error processing callback for node 69db50b20a04df09a44edd1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK 2026-04-14 07:59:19,484 - lava_callback - INFO - Received callback for node 69db50cf0a04df09a44edd45 INFO: 172.20.0.1:57802 - "POST /node/69db50cf0a04df09a44edd45 HTTP/1.0" 202 Accepted 2026-04-14 07:59:19,491 - lava_callback - INFO - Starting async job submit for node 69db50cf0a04df09a44edd45 2026-04-14 07:59:19,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:59:19,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50cf0a04df09a44edd45 HTTP/1.1" 200 None 2026-04-14 07:59:19,507 - lava_callback - DEBUG - Processing node 69db50cf0a04df09a44edd45: baseline-arm-baylibre 2026-04-14 07:59:19,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50cf0a04df09a44edd45 2026-04-14 07:59:19,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:59:19,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50cf0a04df09a44edd45 HTTP/1.1" 200 None 2026-04-14 07:59:19,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:59:19,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 07:59:19,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 07:59:19,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50cf0a04df09a44edd45 HTTP/1.1" 200 None 2026-04-14 07:59:19,579 - lava_callback - ERROR - Error processing callback for node 69db50cf0a04df09a44edd45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:00:04,606 - lava_callback - INFO - Received callback for node 69db50f00a04df09a44edd79 INFO: 172.20.0.1:52860 - "POST /node/69db50f00a04df09a44edd79 HTTP/1.0" 202 Accepted 2026-04-14 08:00:04,612 - lava_callback - INFO - Starting async job submit for node 69db50f00a04df09a44edd79 2026-04-14 08:00:04,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:04,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50f00a04df09a44edd79 HTTP/1.1" 200 None 2026-04-14 08:00:04,628 - lava_callback - DEBUG - Processing node 69db50f00a04df09a44edd79: baseline-arm-clabbe 2026-04-14 08:00:04,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db50f00a04df09a44edd79 2026-04-14 08:00:04,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:04,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db50f00a04df09a44edd79 HTTP/1.1" 200 None 2026-04-14 08:00:04,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:04,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:00:04,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:04,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db50f00a04df09a44edd79 HTTP/1.1" 200 None 2026-04-14 08:00:04,686 - lava_callback - ERROR - Error processing callback for node 69db50f00a04df09a44edd79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:00:24,446 - lava_callback - INFO - Received callback for node 69db51150a04df09a44edd8e INFO: 172.20.0.1:52744 - "POST /node/69db51150a04df09a44edd8e HTTP/1.0" 202 Accepted 2026-04-14 08:00:24,452 - lava_callback - INFO - Starting async job submit for node 69db51150a04df09a44edd8e 2026-04-14 08:00:24,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:24,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51150a04df09a44edd8e HTTP/1.1" 200 None 2026-04-14 08:00:24,474 - lava_callback - DEBUG - Processing node 69db51150a04df09a44edd8e: baseline-arm-clabbe 2026-04-14 08:00:24,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51150a04df09a44edd8e 2026-04-14 08:00:24,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:24,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51150a04df09a44edd8e HTTP/1.1" 200 None 2026-04-14 08:00:24,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:24,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:00:24,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:00:24,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51150a04df09a44edd8e HTTP/1.1" 200 None 2026-04-14 08:00:24,533 - lava_callback - ERROR - Error processing callback for node 69db51150a04df09a44edd8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:01:04,461 - lava_callback - INFO - Received callback for node 69db51390a04df09a44edd99 INFO: 172.20.0.1:48918 - "POST /node/69db51390a04df09a44edd99 HTTP/1.0" 202 Accepted 2026-04-14 08:01:04,467 - lava_callback - INFO - Starting async job submit for node 69db51390a04df09a44edd99 2026-04-14 08:01:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51390a04df09a44edd99 HTTP/1.1" 200 None 2026-04-14 08:01:04,483 - lava_callback - DEBUG - Processing node 69db51390a04df09a44edd99: baseline-arm-clabbe 2026-04-14 08:01:04,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51390a04df09a44edd99 2026-04-14 08:01:04,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:04,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51390a04df09a44edd99 HTTP/1.1" 200 None 2026-04-14 08:01:04,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:04,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:01:04,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:04,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51390a04df09a44edd99 HTTP/1.1" 200 None 2026-04-14 08:01:04,544 - lava_callback - ERROR - Error processing callback for node 69db51390a04df09a44edd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:01:44,485 - lava_callback - INFO - Received callback for node 69db515e0a04df09a44eddb4 INFO: 172.20.0.1:59140 - "POST /node/69db515e0a04df09a44eddb4 HTTP/1.0" 202 Accepted 2026-04-14 08:01:44,491 - lava_callback - INFO - Starting async job submit for node 69db515e0a04df09a44eddb4 2026-04-14 08:01:44,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:44,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db515e0a04df09a44eddb4 HTTP/1.1" 200 None 2026-04-14 08:01:44,506 - lava_callback - DEBUG - Processing node 69db515e0a04df09a44eddb4: baseline-arm-clabbe 2026-04-14 08:01:44,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db515e0a04df09a44eddb4 2026-04-14 08:01:44,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:44,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db515e0a04df09a44eddb4 HTTP/1.1" 200 None 2026-04-14 08:01:44,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:44,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:01:44,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:01:44,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db515e0a04df09a44eddb4 HTTP/1.1" 200 None 2026-04-14 08:01:44,562 - lava_callback - ERROR - Error processing callback for node 69db515e0a04df09a44eddb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39418 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:02:24,564 - lava_callback - INFO - Received callback for node 69db51830a04df09a44eddc5 INFO: 172.20.0.1:35808 - "POST /node/69db51830a04df09a44eddc5 HTTP/1.0" 202 Accepted 2026-04-14 08:02:24,569 - lava_callback - INFO - Starting async job submit for node 69db51830a04df09a44eddc5 2026-04-14 08:02:24,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:02:24,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51830a04df09a44eddc5 HTTP/1.1" 200 None 2026-04-14 08:02:24,584 - lava_callback - DEBUG - Processing node 69db51830a04df09a44eddc5: baseline-arm-clabbe 2026-04-14 08:02:24,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51830a04df09a44eddc5 2026-04-14 08:02:24,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:02:24,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51830a04df09a44eddc5 HTTP/1.1" 200 None 2026-04-14 08:02:24,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:02:24,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:02:24,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:02:24,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51830a04df09a44eddc5 HTTP/1.1" 200 None 2026-04-14 08:02:24,645 - lava_callback - ERROR - Error processing callback for node 69db51830a04df09a44eddc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:03:04,529 - lava_callback - INFO - Received callback for node 69db51a40a04df09a44edde3 INFO: 172.20.0.1:42274 - "POST /node/69db51a40a04df09a44edde3 HTTP/1.0" 202 Accepted 2026-04-14 08:03:04,535 - lava_callback - INFO - Starting async job submit for node 69db51a40a04df09a44edde3 2026-04-14 08:03:04,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:04,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51a40a04df09a44edde3 HTTP/1.1" 200 None 2026-04-14 08:03:04,564 - lava_callback - DEBUG - Processing node 69db51a40a04df09a44edde3: baseline-arm-clabbe 2026-04-14 08:03:04,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51a40a04df09a44edde3 2026-04-14 08:03:04,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:04,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51a40a04df09a44edde3 HTTP/1.1" 200 None 2026-04-14 08:03:04,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:04,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:03:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:04,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51a40a04df09a44edde3 HTTP/1.1" 200 None 2026-04-14 08:03:04,626 - lava_callback - ERROR - Error processing callback for node 69db51a40a04df09a44edde3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39428 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:03:24,584 - lava_callback - INFO - Received callback for node 69db51c60a04df09a44eddf3 INFO: 172.20.0.1:42600 - "POST /node/69db51c60a04df09a44eddf3 HTTP/1.0" 202 Accepted 2026-04-14 08:03:24,592 - lava_callback - INFO - Starting async job submit for node 69db51c60a04df09a44eddf3 2026-04-14 08:03:24,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:24,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51c60a04df09a44eddf3 HTTP/1.1" 200 None 2026-04-14 08:03:24,615 - lava_callback - DEBUG - Processing node 69db51c60a04df09a44eddf3: baseline-arm-clabbe 2026-04-14 08:03:24,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51c60a04df09a44eddf3 2026-04-14 08:03:24,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:24,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51c60a04df09a44eddf3 HTTP/1.1" 200 None 2026-04-14 08:03:24,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:24,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:03:24,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:03:24,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51c60a04df09a44eddf3 HTTP/1.1" 200 None 2026-04-14 08:03:24,681 - lava_callback - ERROR - Error processing callback for node 69db51c60a04df09a44eddf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33458 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:04:04,569 - lava_callback - INFO - Received callback for node 69db51e50a04df09a44ede18 INFO: 172.20.0.1:41440 - "POST /node/69db51e50a04df09a44ede18 HTTP/1.0" 202 Accepted 2026-04-14 08:04:04,576 - lava_callback - INFO - Starting async job submit for node 69db51e50a04df09a44ede18 2026-04-14 08:04:04,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:04,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51e50a04df09a44ede18 HTTP/1.1" 200 None 2026-04-14 08:04:04,598 - lava_callback - DEBUG - Processing node 69db51e50a04df09a44ede18: baseline-arm-clabbe 2026-04-14 08:04:04,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db51e50a04df09a44ede18 2026-04-14 08:04:04,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:04,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db51e50a04df09a44ede18 HTTP/1.1" 200 None 2026-04-14 08:04:04,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:04,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:04:04,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:04,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db51e50a04df09a44ede18 HTTP/1.1" 200 None 2026-04-14 08:04:04,654 - lava_callback - ERROR - Error processing callback for node 69db51e50a04df09a44ede18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:04:24,662 - lava_callback - INFO - Received callback for node 69db52050a04df09a44ede45 INFO: 172.20.0.1:39202 - "POST /node/69db52050a04df09a44ede45 HTTP/1.0" 202 Accepted 2026-04-14 08:04:24,668 - lava_callback - INFO - Starting async job submit for node 69db52050a04df09a44ede45 2026-04-14 08:04:24,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:24,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52050a04df09a44ede45 HTTP/1.1" 200 None 2026-04-14 08:04:24,685 - lava_callback - DEBUG - Processing node 69db52050a04df09a44ede45: baseline-arm-clabbe 2026-04-14 08:04:24,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52050a04df09a44ede45 2026-04-14 08:04:24,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:24,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52050a04df09a44ede45 HTTP/1.1" 200 None 2026-04-14 08:04:24,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:24,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:04:24,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:04:24,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52050a04df09a44ede45 HTTP/1.1" 200 None 2026-04-14 08:04:24,741 - lava_callback - ERROR - Error processing callback for node 69db52050a04df09a44ede45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36916 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:05:04,595 - lava_callback - INFO - Received callback for node 69db52230a04df09a44ede6d INFO: 172.20.0.1:53618 - "POST /node/69db52230a04df09a44ede6d HTTP/1.0" 202 Accepted 2026-04-14 08:05:04,600 - lava_callback - INFO - Starting async job submit for node 69db52230a04df09a44ede6d 2026-04-14 08:05:04,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:04,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52230a04df09a44ede6d HTTP/1.1" 200 None 2026-04-14 08:05:04,617 - lava_callback - DEBUG - Processing node 69db52230a04df09a44ede6d: baseline-arm-clabbe 2026-04-14 08:05:04,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52230a04df09a44ede6d 2026-04-14 08:05:04,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:04,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52230a04df09a44ede6d HTTP/1.1" 200 None 2026-04-14 08:05:04,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:04,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:05:04,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:04,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52230a04df09a44ede6d HTTP/1.1" 200 None 2026-04-14 08:05:04,669 - lava_callback - ERROR - Error processing callback for node 69db52230a04df09a44ede6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:05:44,661 - lava_callback - INFO - Received callback for node 69db52480a04df09a44ede9e INFO: 172.20.0.1:59060 - "POST /node/69db52480a04df09a44ede9e HTTP/1.0" 202 Accepted 2026-04-14 08:05:44,667 - lava_callback - INFO - Starting async job submit for node 69db52480a04df09a44ede9e 2026-04-14 08:05:44,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:44,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52480a04df09a44ede9e HTTP/1.1" 200 None 2026-04-14 08:05:44,683 - lava_callback - DEBUG - Processing node 69db52480a04df09a44ede9e: baseline-arm-clabbe 2026-04-14 08:05:44,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52480a04df09a44ede9e 2026-04-14 08:05:44,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:44,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52480a04df09a44ede9e HTTP/1.1" 200 None 2026-04-14 08:05:44,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:44,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:05:44,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:05:44,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52480a04df09a44ede9e HTTP/1.1" 200 None 2026-04-14 08:05:44,744 - lava_callback - ERROR - Error processing callback for node 69db52480a04df09a44ede9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:06:04,745 - lava_callback - INFO - Received callback for node 69db52670a04df09a44edec5 INFO: 172.20.0.1:38584 - "POST /node/69db52670a04df09a44edec5 HTTP/1.0" 202 Accepted 2026-04-14 08:06:04,752 - lava_callback - INFO - Starting async job submit for node 69db52670a04df09a44edec5 2026-04-14 08:06:04,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:04,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52670a04df09a44edec5 HTTP/1.1" 200 None 2026-04-14 08:06:04,772 - lava_callback - DEBUG - Processing node 69db52670a04df09a44edec5: baseline-arm-clabbe 2026-04-14 08:06:04,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52670a04df09a44edec5 2026-04-14 08:06:04,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:04,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52670a04df09a44edec5 HTTP/1.1" 200 None 2026-04-14 08:06:04,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:04,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:06:04,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:04,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52670a04df09a44edec5 HTTP/1.1" 200 None 2026-04-14 08:06:04,845 - lava_callback - ERROR - Error processing callback for node 69db52670a04df09a44edec5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38576 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:06:44,707 - lava_callback - INFO - Received callback for node 69db528b0a04df09a44ededa INFO: 172.20.0.1:39522 - "POST /node/69db528b0a04df09a44ededa HTTP/1.0" 202 Accepted 2026-04-14 08:06:44,713 - lava_callback - INFO - Starting async job submit for node 69db528b0a04df09a44ededa 2026-04-14 08:06:44,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:44,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db528b0a04df09a44ededa HTTP/1.1" 200 None 2026-04-14 08:06:44,735 - lava_callback - DEBUG - Processing node 69db528b0a04df09a44ededa: baseline-arm-clabbe 2026-04-14 08:06:44,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db528b0a04df09a44ededa 2026-04-14 08:06:44,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:44,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db528b0a04df09a44ededa HTTP/1.1" 200 None 2026-04-14 08:06:44,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:44,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:06:44,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:06:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db528b0a04df09a44ededa HTTP/1.1" 200 None 2026-04-14 08:06:44,788 - lava_callback - ERROR - Error processing callback for node 69db528b0a04df09a44ededa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33944 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:07:24,689 - lava_callback - INFO - Received callback for node 69db52af0a04df09a44edee3 INFO: 172.20.0.1:45600 - "POST /node/69db52af0a04df09a44edee3 HTTP/1.0" 202 Accepted 2026-04-14 08:07:24,695 - lava_callback - INFO - Starting async job submit for node 69db52af0a04df09a44edee3 2026-04-14 08:07:24,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:07:24,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52af0a04df09a44edee3 HTTP/1.1" 200 None 2026-04-14 08:07:24,716 - lava_callback - DEBUG - Processing node 69db52af0a04df09a44edee3: baseline-arm-clabbe 2026-04-14 08:07:24,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52af0a04df09a44edee3 2026-04-14 08:07:24,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:07:24,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52af0a04df09a44edee3 HTTP/1.1" 200 None 2026-04-14 08:07:24,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:07:24,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:07:24,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:07:24,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52af0a04df09a44edee3 HTTP/1.1" 200 None 2026-04-14 08:07:24,765 - lava_callback - ERROR - Error processing callback for node 69db52af0a04df09a44edee3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57542 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:08:04,767 - lava_callback - INFO - Received callback for node 69db52ce0a04df09a44edf0c INFO: 172.20.0.1:48522 - "POST /node/69db52ce0a04df09a44edf0c HTTP/1.0" 202 Accepted 2026-04-14 08:08:04,773 - lava_callback - INFO - Starting async job submit for node 69db52ce0a04df09a44edf0c 2026-04-14 08:08:04,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:04,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52ce0a04df09a44edf0c HTTP/1.1" 200 None 2026-04-14 08:08:04,791 - lava_callback - DEBUG - Processing node 69db52ce0a04df09a44edf0c: baseline-arm-clabbe 2026-04-14 08:08:04,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52ce0a04df09a44edf0c 2026-04-14 08:08:04,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:04,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52ce0a04df09a44edf0c HTTP/1.1" 200 None 2026-04-14 08:08:04,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:04,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:08:04,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:04,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52ce0a04df09a44edf0c HTTP/1.1" 200 None 2026-04-14 08:08:04,855 - lava_callback - ERROR - Error processing callback for node 69db52ce0a04df09a44edf0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:08:24,756 - lava_callback - INFO - Received callback for node 69db52ea0a04df09a44edf38 INFO: 172.20.0.1:44956 - "POST /node/69db52ea0a04df09a44edf38 HTTP/1.0" 202 Accepted 2026-04-14 08:08:24,762 - lava_callback - INFO - Starting async job submit for node 69db52ea0a04df09a44edf38 2026-04-14 08:08:24,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:24,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52ea0a04df09a44edf38 HTTP/1.1" 200 None 2026-04-14 08:08:24,778 - lava_callback - DEBUG - Processing node 69db52ea0a04df09a44edf38: baseline-arm-clabbe 2026-04-14 08:08:24,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db52ea0a04df09a44edf38 2026-04-14 08:08:24,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:24,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db52ea0a04df09a44edf38 HTTP/1.1" 200 None 2026-04-14 08:08:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:24,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:08:24,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:08:24,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db52ea0a04df09a44edf38 HTTP/1.1" 200 None 2026-04-14 08:08:24,832 - lava_callback - ERROR - Error processing callback for node 69db52ea0a04df09a44edf38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:09:04,838 - lava_callback - INFO - Received callback for node 69db530c0a04df09a44edf5f INFO: 172.20.0.1:50346 - "POST /node/69db530c0a04df09a44edf5f HTTP/1.0" 202 Accepted 2026-04-14 08:09:04,843 - lava_callback - INFO - Starting async job submit for node 69db530c0a04df09a44edf5f 2026-04-14 08:09:04,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:04,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db530c0a04df09a44edf5f HTTP/1.1" 200 None 2026-04-14 08:09:04,867 - lava_callback - DEBUG - Processing node 69db530c0a04df09a44edf5f: baseline-arm-clabbe 2026-04-14 08:09:04,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db530c0a04df09a44edf5f 2026-04-14 08:09:04,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:04,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db530c0a04df09a44edf5f HTTP/1.1" 200 None 2026-04-14 08:09:04,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:04,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:09:04,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:04,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db530c0a04df09a44edf5f HTTP/1.1" 200 None 2026-04-14 08:09:04,936 - lava_callback - ERROR - Error processing callback for node 69db530c0a04df09a44edf5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:09:24,787 - lava_callback - INFO - Received callback for node 69db53300a04df09a44edf6d INFO: 172.20.0.1:33506 - "POST /node/69db53300a04df09a44edf6d HTTP/1.0" 202 Accepted 2026-04-14 08:09:24,793 - lava_callback - INFO - Starting async job submit for node 69db53300a04df09a44edf6d 2026-04-14 08:09:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:24,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53300a04df09a44edf6d HTTP/1.1" 200 None 2026-04-14 08:09:24,809 - lava_callback - DEBUG - Processing node 69db53300a04df09a44edf6d: baseline-arm-clabbe 2026-04-14 08:09:24,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db53300a04df09a44edf6d 2026-04-14 08:09:24,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:24,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53300a04df09a44edf6d HTTP/1.1" 200 None 2026-04-14 08:09:24,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-14 08:09:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:09:24,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db53300a04df09a44edf6d HTTP/1.1" 200 None 2026-04-14 08:09:24,858 - lava_callback - ERROR - Error processing callback for node 69db53300a04df09a44edf6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:10:20,150 - lava_callback - INFO - Received callback for node 69db535a0a04df09a44edf7b INFO: 172.20.0.1:41758 - "POST /node/69db535a0a04df09a44edf7b HTTP/1.0" 202 Accepted 2026-04-14 08:10:20,158 - lava_callback - INFO - Starting async job submit for node 69db535a0a04df09a44edf7b 2026-04-14 08:10:20,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:10:20,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db535a0a04df09a44edf7b HTTP/1.1" 200 None 2026-04-14 08:10:20,186 - lava_callback - DEBUG - Processing node 69db535a0a04df09a44edf7b: baseline-arm64-baylibre 2026-04-14 08:10:20,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db535a0a04df09a44edf7b 2026-04-14 08:10:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:10:20,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db535a0a04df09a44edf7b HTTP/1.1" 200 None 2026-04-14 08:10:20,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:10:20,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 08:10:20,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:10:20,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db535a0a04df09a44edf7b HTTP/1.1" 200 None 2026-04-14 08:10:20,233 - lava_callback - ERROR - Error processing callback for node 69db535a0a04df09a44edf7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:11:20,178 - lava_callback - INFO - Received callback for node 69db53a30a04df09a44edfa1 INFO: 172.20.0.1:54780 - "POST /node/69db53a30a04df09a44edfa1 HTTP/1.0" 202 Accepted 2026-04-14 08:11:20,187 - lava_callback - INFO - Starting async job submit for node 69db53a30a04df09a44edfa1 2026-04-14 08:11:20,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:11:20,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53a30a04df09a44edfa1 HTTP/1.1" 200 None 2026-04-14 08:11:20,204 - lava_callback - DEBUG - Processing node 69db53a30a04df09a44edfa1: baseline-arm64-baylibre 2026-04-14 08:11:20,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db53a30a04df09a44edfa1 2026-04-14 08:11:20,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:11:20,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53a30a04df09a44edfa1 HTTP/1.1" 200 None 2026-04-14 08:11:20,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:11:20,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 08:11:20,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:11:20,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db53a30a04df09a44edfa1 HTTP/1.1" 200 None 2026-04-14 08:11:20,254 - lava_callback - ERROR - Error processing callback for node 69db53a30a04df09a44edfa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54502 - "GET / HTTP/1.0" 200 OK 2026-04-14 08:12:40,366 - lava_callback - INFO - Received callback for node 69db53e80a04df09a44edfe5 INFO: 172.20.0.1:58522 - "POST /node/69db53e80a04df09a44edfe5 HTTP/1.0" 202 Accepted 2026-04-14 08:12:40,372 - lava_callback - INFO - Starting async job submit for node 69db53e80a04df09a44edfe5 2026-04-14 08:12:40,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:12:40,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53e80a04df09a44edfe5 HTTP/1.1" 200 None 2026-04-14 08:12:40,389 - lava_callback - DEBUG - Processing node 69db53e80a04df09a44edfe5: baseline-arm64-baylibre 2026-04-14 08:12:40,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69db53e80a04df09a44edfe5 2026-04-14 08:12:40,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:12:40,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69db53e80a04df09a44edfe5 HTTP/1.1" 200 None 2026-04-14 08:12:40,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:12:40,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-14 08:12:40,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-14 08:12:40,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69db53e80a04df09a44edfe5 HTTP/1.1" 200 None 2026-04-14 08:12:40,438 - lava_callback - ERROR - Error processing callback for node 69db53e80a04df09a44edfe5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]