INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET /node/694cd556cb0ae69445cb1f51%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET /node/69937e39cebe99dd8e06ce7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:36:50,058 - lava_callback - INFO - Received callback for node 69d4c220932ecfe2320a1267 2026-04-09 08:36:50,065 - lava_callback - INFO - Starting async job submit for node 69d4c220932ecfe2320a1267 INFO: 172.21.0.1:39308 - "POST /node/69d4c220932ecfe2320a1267 HTTP/1.0" 202 Accepted 2026-04-09 08:36:50,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:36:50,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c220932ecfe2320a1267 HTTP/1.1" 200 None 2026-04-09 08:36:50,098 - lava_callback - DEBUG - Processing node 69d4c220932ecfe2320a1267: baseline-arm-baylibre 2026-04-09 08:36:50,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c220932ecfe2320a1267 2026-04-09 08:36:50,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:36:50,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c220932ecfe2320a1267 HTTP/1.1" 200 None 2026-04-09 08:36:50,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:36:50,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:36:50,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:36:50,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c220932ecfe2320a1267 HTTP/1.1" 200 None 2026-04-09 08:36:50,170 - lava_callback - ERROR - Error processing callback for node 69d4c220932ecfe2320a1267: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:37:09,920 - lava_callback - INFO - Received callback for node 69d4c222932ecfe2320a126f INFO: 172.21.0.1:45368 - "POST /node/69d4c222932ecfe2320a126f HTTP/1.0" 202 Accepted 2026-04-09 08:37:09,926 - lava_callback - INFO - Starting async job submit for node 69d4c222932ecfe2320a126f 2026-04-09 08:37:09,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:09,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c222932ecfe2320a126f HTTP/1.1" 200 None 2026-04-09 08:37:09,949 - lava_callback - DEBUG - Processing node 69d4c222932ecfe2320a126f: baseline-arm-baylibre 2026-04-09 08:37:09,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c222932ecfe2320a126f 2026-04-09 08:37:09,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:09,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c222932ecfe2320a126f HTTP/1.1" 200 None 2026-04-09 08:37:09,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:09,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:09,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:10,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c222932ecfe2320a126f HTTP/1.1" 200 None 2026-04-09 08:37:10,026 - lava_callback - ERROR - Error processing callback for node 69d4c222932ecfe2320a126f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:10,606 - lava_callback - INFO - Received callback for node 69d4c223932ecfe2320a1272 INFO: 172.21.0.1:45372 - "POST /node/69d4c223932ecfe2320a1272 HTTP/1.0" 202 Accepted 2026-04-09 08:37:10,611 - lava_callback - INFO - Starting async job submit for node 69d4c223932ecfe2320a1272 2026-04-09 08:37:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:10,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c223932ecfe2320a1272 HTTP/1.1" 200 None 2026-04-09 08:37:10,628 - lava_callback - DEBUG - Processing node 69d4c223932ecfe2320a1272: baseline-arm-baylibre 2026-04-09 08:37:10,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c223932ecfe2320a1272 2026-04-09 08:37:10,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:10,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c223932ecfe2320a1272 HTTP/1.1" 200 None 2026-04-09 08:37:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:10,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:10,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:10,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c223932ecfe2320a1272 HTTP/1.1" 200 None 2026-04-09 08:37:10,679 - lava_callback - ERROR - Error processing callback for node 69d4c223932ecfe2320a1272: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:11,282 - lava_callback - INFO - Received callback for node 69d4c226932ecfe2320a127d INFO: 172.21.0.1:45374 - "POST /node/69d4c226932ecfe2320a127d HTTP/1.0" 202 Accepted 2026-04-09 08:37:11,288 - lava_callback - INFO - Starting async job submit for node 69d4c226932ecfe2320a127d 2026-04-09 08:37:11,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c226932ecfe2320a127d HTTP/1.1" 200 None 2026-04-09 08:37:11,314 - lava_callback - DEBUG - Processing node 69d4c226932ecfe2320a127d: baseline-arm-baylibre 2026-04-09 08:37:11,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c226932ecfe2320a127d 2026-04-09 08:37:11,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c226932ecfe2320a127d HTTP/1.1" 200 None 2026-04-09 08:37:11,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:11,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c226932ecfe2320a127d HTTP/1.1" 200 None 2026-04-09 08:37:11,385 - lava_callback - ERROR - Error processing callback for node 69d4c226932ecfe2320a127d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:11,943 - lava_callback - INFO - Received callback for node 69d4c227932ecfe2320a1295 INFO: 172.21.0.1:45380 - "POST /node/69d4c227932ecfe2320a1295 HTTP/1.0" 202 Accepted 2026-04-09 08:37:11,950 - lava_callback - INFO - Starting async job submit for node 69d4c227932ecfe2320a1295 2026-04-09 08:37:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c227932ecfe2320a1295 HTTP/1.1" 200 None 2026-04-09 08:37:11,967 - lava_callback - DEBUG - Processing node 69d4c227932ecfe2320a1295: baseline-arm-baylibre 2026-04-09 08:37:11,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c227932ecfe2320a1295 2026-04-09 08:37:11,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c227932ecfe2320a1295 HTTP/1.1" 200 None 2026-04-09 08:37:11,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:11,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:12,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:12,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c227932ecfe2320a1295 HTTP/1.1" 200 None 2026-04-09 08:37:12,038 - lava_callback - ERROR - Error processing callback for node 69d4c227932ecfe2320a1295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:13,538 - lava_callback - INFO - Received callback for node 69d4c22f932ecfe2320a12ac INFO: 172.21.0.1:45396 - "POST /node/69d4c22f932ecfe2320a12ac HTTP/1.0" 202 Accepted 2026-04-09 08:37:13,544 - lava_callback - INFO - Starting async job submit for node 69d4c22f932ecfe2320a12ac 2026-04-09 08:37:13,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:13,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22f932ecfe2320a12ac HTTP/1.1" 200 None 2026-04-09 08:37:13,560 - lava_callback - DEBUG - Processing node 69d4c22f932ecfe2320a12ac: baseline-arm-clabbe 2026-04-09 08:37:13,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c22f932ecfe2320a12ac 2026-04-09 08:37:13,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:13,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c22f932ecfe2320a12ac HTTP/1.1" 200 None 2026-04-09 08:37:13,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:13,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:13,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:13,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c22f932ecfe2320a12ac HTTP/1.1" 200 None 2026-04-09 08:37:13,615 - lava_callback - ERROR - Error processing callback for node 69d4c22f932ecfe2320a12ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:14,236 - lava_callback - INFO - Received callback for node 69d4c231932ecfe2320a12b2 INFO: 172.21.0.1:45402 - "POST /node/69d4c231932ecfe2320a12b2 HTTP/1.0" 202 Accepted 2026-04-09 08:37:14,242 - lava_callback - INFO - Starting async job submit for node 69d4c231932ecfe2320a12b2 2026-04-09 08:37:14,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c231932ecfe2320a12b2 HTTP/1.1" 200 None 2026-04-09 08:37:14,259 - lava_callback - DEBUG - Processing node 69d4c231932ecfe2320a12b2: baseline-arm-clabbe 2026-04-09 08:37:14,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c231932ecfe2320a12b2 2026-04-09 08:37:14,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c231932ecfe2320a12b2 HTTP/1.1" 200 None 2026-04-09 08:37:14,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:14,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c231932ecfe2320a12b2 HTTP/1.1" 200 None 2026-04-09 08:37:14,315 - lava_callback - ERROR - Error processing callback for node 69d4c231932ecfe2320a12b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:14,917 - lava_callback - INFO - Received callback for node 69d4c232932ecfe2320a12b6 INFO: 172.21.0.1:45410 - "POST /node/69d4c232932ecfe2320a12b6 HTTP/1.0" 202 Accepted 2026-04-09 08:37:14,926 - lava_callback - INFO - Starting async job submit for node 69d4c232932ecfe2320a12b6 2026-04-09 08:37:14,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c232932ecfe2320a12b6 HTTP/1.1" 200 None 2026-04-09 08:37:14,943 - lava_callback - DEBUG - Processing node 69d4c232932ecfe2320a12b6: baseline-arm-clabbe 2026-04-09 08:37:14,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c232932ecfe2320a12b6 2026-04-09 08:37:14,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c232932ecfe2320a12b6 HTTP/1.1" 200 None 2026-04-09 08:37:14,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:14,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:14,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:15,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c232932ecfe2320a12b6 HTTP/1.1" 200 None 2026-04-09 08:37:15,013 - lava_callback - ERROR - Error processing callback for node 69d4c232932ecfe2320a12b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45426 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 08:37:15,607 - lava_callback - INFO - Received callback for node 69d4c233932ecfe2320a12b9 INFO: 172.21.0.1:45430 - "POST /node/69d4c233932ecfe2320a12b9 HTTP/1.0" 202 Accepted 2026-04-09 08:37:15,613 - lava_callback - INFO - Starting async job submit for node 69d4c233932ecfe2320a12b9 2026-04-09 08:37:15,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:15,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c233932ecfe2320a12b9 HTTP/1.1" 200 None 2026-04-09 08:37:15,642 - lava_callback - DEBUG - Processing node 69d4c233932ecfe2320a12b9: baseline-arm-clabbe 2026-04-09 08:37:15,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c233932ecfe2320a12b9 2026-04-09 08:37:15,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:15,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c233932ecfe2320a12b9 HTTP/1.1" 200 None 2026-04-09 08:37:15,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:15,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:15,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:15,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c233932ecfe2320a12b9 HTTP/1.1" 200 None 2026-04-09 08:37:15,696 - lava_callback - ERROR - Error processing callback for node 69d4c233932ecfe2320a12b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:16,296 - lava_callback - INFO - Received callback for node 69d4c234932ecfe2320a12bc INFO: 172.21.0.1:45446 - "POST /node/69d4c234932ecfe2320a12bc HTTP/1.0" 202 Accepted 2026-04-09 08:37:16,302 - lava_callback - INFO - Starting async job submit for node 69d4c234932ecfe2320a12bc 2026-04-09 08:37:16,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:16,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c234932ecfe2320a12bc HTTP/1.1" 200 None 2026-04-09 08:37:16,338 - lava_callback - DEBUG - Processing node 69d4c234932ecfe2320a12bc: baseline-arm-clabbe 2026-04-09 08:37:16,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c234932ecfe2320a12bc 2026-04-09 08:37:16,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:16,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c234932ecfe2320a12bc HTTP/1.1" 200 None 2026-04-09 08:37:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:16,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:16,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:16,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c234932ecfe2320a12bc HTTP/1.1" 200 None 2026-04-09 08:37:16,402 - lava_callback - ERROR - Error processing callback for node 69d4c234932ecfe2320a12bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:37:16,980 - lava_callback - INFO - Received callback for node 69d4c234932ecfe2320a12bf INFO: 172.21.0.1:45464 - "POST /node/69d4c234932ecfe2320a12bf HTTP/1.0" 202 Accepted 2026-04-09 08:37:16,986 - lava_callback - INFO - Starting async job submit for node 69d4c234932ecfe2320a12bf 2026-04-09 08:37:16,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c234932ecfe2320a12bf HTTP/1.1" 200 None 2026-04-09 08:37:17,003 - lava_callback - DEBUG - Processing node 69d4c234932ecfe2320a12bf: baseline-arm-clabbe 2026-04-09 08:37:17,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c234932ecfe2320a12bf 2026-04-09 08:37:17,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c234932ecfe2320a12bf HTTP/1.1" 200 None 2026-04-09 08:37:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:17,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c234932ecfe2320a12bf HTTP/1.1" 200 None 2026-04-09 08:37:17,069 - lava_callback - ERROR - Error processing callback for node 69d4c234932ecfe2320a12bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:17,667 - lava_callback - INFO - Received callback for node 69d4c235932ecfe2320a12c2 INFO: 172.21.0.1:45478 - "POST /node/69d4c235932ecfe2320a12c2 HTTP/1.0" 202 Accepted 2026-04-09 08:37:17,672 - lava_callback - INFO - Starting async job submit for node 69d4c235932ecfe2320a12c2 2026-04-09 08:37:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c235932ecfe2320a12c2 HTTP/1.1" 200 None 2026-04-09 08:37:17,689 - lava_callback - DEBUG - Processing node 69d4c235932ecfe2320a12c2: baseline-arm-clabbe 2026-04-09 08:37:17,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c235932ecfe2320a12c2 2026-04-09 08:37:17,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c235932ecfe2320a12c2 HTTP/1.1" 200 None 2026-04-09 08:37:17,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:17,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:17,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c235932ecfe2320a12c2 HTTP/1.1" 200 None 2026-04-09 08:37:17,746 - lava_callback - ERROR - Error processing callback for node 69d4c235932ecfe2320a12c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:18,361 - lava_callback - INFO - Received callback for node 69d4c236932ecfe2320a12c5 INFO: 172.21.0.1:45480 - "POST /node/69d4c236932ecfe2320a12c5 HTTP/1.0" 202 Accepted 2026-04-09 08:37:18,370 - lava_callback - INFO - Starting async job submit for node 69d4c236932ecfe2320a12c5 2026-04-09 08:37:18,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:18,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c236932ecfe2320a12c5 HTTP/1.1" 200 None 2026-04-09 08:37:18,387 - lava_callback - DEBUG - Processing node 69d4c236932ecfe2320a12c5: baseline-arm-clabbe 2026-04-09 08:37:18,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c236932ecfe2320a12c5 2026-04-09 08:37:18,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c236932ecfe2320a12c5 HTTP/1.1" 200 None 2026-04-09 08:37:18,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:18,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:18,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:18,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c236932ecfe2320a12c5 HTTP/1.1" 200 None 2026-04-09 08:37:18,466 - lava_callback - ERROR - Error processing callback for node 69d4c236932ecfe2320a12c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 08:37:19,069 - lava_callback - INFO - Received callback for node 69d4c237932ecfe2320a12c8 INFO: 172.21.0.1:45484 - "POST /node/69d4c237932ecfe2320a12c8 HTTP/1.0" 202 Accepted 2026-04-09 08:37:19,075 - lava_callback - INFO - Starting async job submit for node 69d4c237932ecfe2320a12c8 2026-04-09 08:37:19,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:19,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c237932ecfe2320a12c8 HTTP/1.1" 200 None 2026-04-09 08:37:19,092 - lava_callback - DEBUG - Processing node 69d4c237932ecfe2320a12c8: baseline-arm-clabbe 2026-04-09 08:37:19,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c237932ecfe2320a12c8 2026-04-09 08:37:19,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:19,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c237932ecfe2320a12c8 HTTP/1.1" 200 None 2026-04-09 08:37:19,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:19,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 08:37:19,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:37:19,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c237932ecfe2320a12c8 HTTP/1.1" 200 None 2026-04-09 08:37:19,156 - lava_callback - ERROR - Error processing callback for node 69d4c237932ecfe2320a12c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:45:10,530 - lava_callback - INFO - Received callback for node 69d4c410932ecfe2320a1534 INFO: 172.21.0.1:37662 - "POST /node/69d4c410932ecfe2320a1534 HTTP/1.0" 202 Accepted 2026-04-09 08:45:10,535 - lava_callback - INFO - Starting async job submit for node 69d4c410932ecfe2320a1534 2026-04-09 08:45:10,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:10,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c410932ecfe2320a1534 HTTP/1.1" 200 None 2026-04-09 08:45:10,587 - lava_callback - DEBUG - Processing node 69d4c410932ecfe2320a1534: baseline-arm-baylibre 2026-04-09 08:45:10,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c410932ecfe2320a1534 2026-04-09 08:45:10,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:10,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c410932ecfe2320a1534 HTTP/1.1" 200 None 2026-04-09 08:45:10,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:45:10,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c410932ecfe2320a1534 HTTP/1.1" 200 None 2026-04-09 08:45:10,636 - lava_callback - ERROR - Error processing callback for node 69d4c410932ecfe2320a1534: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:45:50,393 - lava_callback - INFO - Received callback for node 69d4c437932ecfe2320a154b INFO: 172.21.0.1:42528 - "POST /node/69d4c437932ecfe2320a154b HTTP/1.0" 202 Accepted 2026-04-09 08:45:50,399 - lava_callback - INFO - Starting async job submit for node 69d4c437932ecfe2320a154b 2026-04-09 08:45:50,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:50,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c437932ecfe2320a154b HTTP/1.1" 200 None 2026-04-09 08:45:50,420 - lava_callback - DEBUG - Processing node 69d4c437932ecfe2320a154b: baseline-arm-baylibre 2026-04-09 08:45:50,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c437932ecfe2320a154b 2026-04-09 08:45:50,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:50,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c437932ecfe2320a154b HTTP/1.1" 200 None 2026-04-09 08:45:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:50,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:45:50,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:45:50,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c437932ecfe2320a154b HTTP/1.1" 200 None 2026-04-09 08:45:50,468 - lava_callback - ERROR - Error processing callback for node 69d4c437932ecfe2320a154b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:46:30,470 - lava_callback - INFO - Received callback for node 69d4c45c932ecfe2320a1566 INFO: 172.21.0.1:35752 - "POST /node/69d4c45c932ecfe2320a1566 HTTP/1.0" 202 Accepted 2026-04-09 08:46:30,475 - lava_callback - INFO - Starting async job submit for node 69d4c45c932ecfe2320a1566 2026-04-09 08:46:30,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:30,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c45c932ecfe2320a1566 HTTP/1.1" 200 None 2026-04-09 08:46:30,491 - lava_callback - DEBUG - Processing node 69d4c45c932ecfe2320a1566: baseline-arm-baylibre 2026-04-09 08:46:30,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c45c932ecfe2320a1566 2026-04-09 08:46:30,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:30,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c45c932ecfe2320a1566 HTTP/1.1" 200 None 2026-04-09 08:46:30,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:30,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:46:30,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:30,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c45c932ecfe2320a1566 HTTP/1.1" 200 None 2026-04-09 08:46:30,552 - lava_callback - ERROR - Error processing callback for node 69d4c45c932ecfe2320a1566: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:46:50,457 - lava_callback - INFO - Received callback for node 69d4c479932ecfe2320a15c0 INFO: 172.21.0.1:57622 - "POST /node/69d4c479932ecfe2320a15c0 HTTP/1.0" 202 Accepted 2026-04-09 08:46:50,463 - lava_callback - INFO - Starting async job submit for node 69d4c479932ecfe2320a15c0 2026-04-09 08:46:50,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:50,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c479932ecfe2320a15c0 HTTP/1.1" 200 None 2026-04-09 08:46:50,479 - lava_callback - DEBUG - Processing node 69d4c479932ecfe2320a15c0: baseline-arm-baylibre 2026-04-09 08:46:50,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c479932ecfe2320a15c0 2026-04-09 08:46:50,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:50,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c479932ecfe2320a15c0 HTTP/1.1" 200 None 2026-04-09 08:46:50,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:50,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:46:50,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:46:50,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c479932ecfe2320a15c0 HTTP/1.1" 200 None 2026-04-09 08:46:50,529 - lava_callback - ERROR - Error processing callback for node 69d4c479932ecfe2320a15c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:47:30,491 - lava_callback - INFO - Received callback for node 69d4c49b932ecfe2320a15e3 INFO: 172.21.0.1:35184 - "POST /node/69d4c49b932ecfe2320a15e3 HTTP/1.0" 202 Accepted 2026-04-09 08:47:30,496 - lava_callback - INFO - Starting async job submit for node 69d4c49b932ecfe2320a15e3 2026-04-09 08:47:30,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:47:30,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c49b932ecfe2320a15e3 HTTP/1.1" 200 None 2026-04-09 08:47:30,517 - lava_callback - DEBUG - Processing node 69d4c49b932ecfe2320a15e3: baseline-arm-baylibre 2026-04-09 08:47:30,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c49b932ecfe2320a15e3 2026-04-09 08:47:30,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:47:30,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c49b932ecfe2320a15e3 HTTP/1.1" 200 None 2026-04-09 08:47:30,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:47:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:47:30,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:47:30,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c49b932ecfe2320a15e3 HTTP/1.1" 200 None 2026-04-09 08:47:30,564 - lava_callback - ERROR - Error processing callback for node 69d4c49b932ecfe2320a15e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:48:10,544 - lava_callback - INFO - Received callback for node 69d4c4be932ecfe2320a1621 INFO: 172.21.0.1:58682 - "POST /node/69d4c4be932ecfe2320a1621 HTTP/1.0" 202 Accepted 2026-04-09 08:48:10,549 - lava_callback - INFO - Starting async job submit for node 69d4c4be932ecfe2320a1621 2026-04-09 08:48:10,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:10,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c4be932ecfe2320a1621 HTTP/1.1" 200 None 2026-04-09 08:48:10,570 - lava_callback - DEBUG - Processing node 69d4c4be932ecfe2320a1621: baseline-arm-baylibre 2026-04-09 08:48:10,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c4be932ecfe2320a1621 2026-04-09 08:48:10,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c4be932ecfe2320a1621 HTTP/1.1" 200 None 2026-04-09 08:48:10,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:10,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:48:10,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:10,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c4be932ecfe2320a1621 HTTP/1.1" 200 None 2026-04-09 08:48:10,630 - lava_callback - ERROR - Error processing callback for node 69d4c4be932ecfe2320a1621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:48:34,041 - lava_callback - INFO - Received callback for node 69d4c4dd932ecfe2320a164e INFO: 172.21.0.1:42942 - "POST /node/69d4c4dd932ecfe2320a164e HTTP/1.0" 202 Accepted 2026-04-09 08:48:34,047 - lava_callback - INFO - Starting async job submit for node 69d4c4dd932ecfe2320a164e 2026-04-09 08:48:34,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:34,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c4dd932ecfe2320a164e HTTP/1.1" 200 None 2026-04-09 08:48:34,063 - lava_callback - DEBUG - Processing node 69d4c4dd932ecfe2320a164e: baseline-arm-clabbe 2026-04-09 08:48:34,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c4dd932ecfe2320a164e 2026-04-09 08:48:34,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:34,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c4dd932ecfe2320a164e HTTP/1.1" 200 None 2026-04-09 08:48:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:34,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:48:34,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:48:34,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c4dd932ecfe2320a164e HTTP/1.1" 200 None 2026-04-09 08:48:34,112 - lava_callback - ERROR - Error processing callback for node 69d4c4dd932ecfe2320a164e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:49:14,053 - lava_callback - INFO - Received callback for node 69d4c502932ecfe2320a1665 INFO: 172.21.0.1:52790 - "POST /node/69d4c502932ecfe2320a1665 HTTP/1.0" 202 Accepted 2026-04-09 08:49:14,059 - lava_callback - INFO - Starting async job submit for node 69d4c502932ecfe2320a1665 2026-04-09 08:49:14,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:14,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c502932ecfe2320a1665 HTTP/1.1" 200 None 2026-04-09 08:49:14,074 - lava_callback - DEBUG - Processing node 69d4c502932ecfe2320a1665: baseline-arm-clabbe 2026-04-09 08:49:14,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c502932ecfe2320a1665 2026-04-09 08:49:14,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:14,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c502932ecfe2320a1665 HTTP/1.1" 200 None 2026-04-09 08:49:14,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:14,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:49:14,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:14,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c502932ecfe2320a1665 HTTP/1.1" 200 None 2026-04-09 08:49:14,129 - lava_callback - ERROR - Error processing callback for node 69d4c502932ecfe2320a1665: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:49:54,167 - lava_callback - INFO - Received callback for node 69d4c51f932ecfe2320a1699 INFO: 172.21.0.1:60082 - "POST /node/69d4c51f932ecfe2320a1699 HTTP/1.0" 202 Accepted 2026-04-09 08:49:54,173 - lava_callback - INFO - Starting async job submit for node 69d4c51f932ecfe2320a1699 2026-04-09 08:49:54,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:54,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c51f932ecfe2320a1699 HTTP/1.1" 200 None 2026-04-09 08:49:54,189 - lava_callback - DEBUG - Processing node 69d4c51f932ecfe2320a1699: baseline-arm-clabbe 2026-04-09 08:49:54,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c51f932ecfe2320a1699 2026-04-09 08:49:54,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:54,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c51f932ecfe2320a1699 HTTP/1.1" 200 None 2026-04-09 08:49:54,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:54,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:49:54,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:49:54,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c51f932ecfe2320a1699 HTTP/1.1" 200 None 2026-04-09 08:49:54,237 - lava_callback - ERROR - Error processing callback for node 69d4c51f932ecfe2320a1699: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:50:14,111 - lava_callback - INFO - Received callback for node 69d4c53c932ecfe2320a16db INFO: 172.21.0.1:59676 - "POST /node/69d4c53c932ecfe2320a16db HTTP/1.0" 202 Accepted 2026-04-09 08:50:14,118 - lava_callback - INFO - Starting async job submit for node 69d4c53c932ecfe2320a16db 2026-04-09 08:50:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:14,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c53c932ecfe2320a16db HTTP/1.1" 200 None 2026-04-09 08:50:14,151 - lava_callback - DEBUG - Processing node 69d4c53c932ecfe2320a16db: baseline-arm-clabbe 2026-04-09 08:50:14,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c53c932ecfe2320a16db 2026-04-09 08:50:14,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:14,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c53c932ecfe2320a16db HTTP/1.1" 200 None 2026-04-09 08:50:14,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:50:14,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:14,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c53c932ecfe2320a16db HTTP/1.1" 200 None 2026-04-09 08:50:14,236 - lava_callback - ERROR - Error processing callback for node 69d4c53c932ecfe2320a16db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:50:54,200 - lava_callback - INFO - Received callback for node 69d4c55a932ecfe2320a1711 INFO: 172.21.0.1:34128 - "POST /node/69d4c55a932ecfe2320a1711 HTTP/1.0" 202 Accepted 2026-04-09 08:50:54,208 - lava_callback - INFO - Starting async job submit for node 69d4c55a932ecfe2320a1711 2026-04-09 08:50:54,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:54,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c55a932ecfe2320a1711 HTTP/1.1" 200 None 2026-04-09 08:50:54,227 - lava_callback - DEBUG - Processing node 69d4c55a932ecfe2320a1711: baseline-arm-clabbe 2026-04-09 08:50:54,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c55a932ecfe2320a1711 2026-04-09 08:50:54,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:54,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c55a932ecfe2320a1711 HTTP/1.1" 200 None 2026-04-09 08:50:54,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:54,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:50:54,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:50:54,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c55a932ecfe2320a1711 HTTP/1.1" 200 None 2026-04-09 08:50:54,281 - lava_callback - ERROR - Error processing callback for node 69d4c55a932ecfe2320a1711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:51:14,181 - lava_callback - INFO - Received callback for node 69d4c57c932ecfe2320a1732 INFO: 172.21.0.1:45248 - "POST /node/69d4c57c932ecfe2320a1732 HTTP/1.0" 202 Accepted 2026-04-09 08:51:14,191 - lava_callback - INFO - Starting async job submit for node 69d4c57c932ecfe2320a1732 2026-04-09 08:51:14,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:14,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c57c932ecfe2320a1732 HTTP/1.1" 200 None 2026-04-09 08:51:14,220 - lava_callback - DEBUG - Processing node 69d4c57c932ecfe2320a1732: baseline-arm-clabbe 2026-04-09 08:51:14,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c57c932ecfe2320a1732 2026-04-09 08:51:14,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:14,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c57c932ecfe2320a1732 HTTP/1.1" 200 None 2026-04-09 08:51:14,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:14,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:51:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c57c932ecfe2320a1732 HTTP/1.1" 200 None 2026-04-09 08:51:14,323 - lava_callback - ERROR - Error processing callback for node 69d4c57c932ecfe2320a1732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:51:54,213 - lava_callback - INFO - Received callback for node 69d4c5a1932ecfe2320a173f INFO: 172.21.0.1:52086 - "POST /node/69d4c5a1932ecfe2320a173f HTTP/1.0" 202 Accepted 2026-04-09 08:51:54,220 - lava_callback - INFO - Starting async job submit for node 69d4c5a1932ecfe2320a173f 2026-04-09 08:51:54,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:54,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5a1932ecfe2320a173f HTTP/1.1" 200 None 2026-04-09 08:51:54,236 - lava_callback - DEBUG - Processing node 69d4c5a1932ecfe2320a173f: baseline-arm-clabbe 2026-04-09 08:51:54,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c5a1932ecfe2320a173f 2026-04-09 08:51:54,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:54,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5a1932ecfe2320a173f HTTP/1.1" 200 None 2026-04-09 08:51:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:54,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:51:54,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:51:54,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c5a1932ecfe2320a173f HTTP/1.1" 200 None 2026-04-09 08:51:54,288 - lava_callback - ERROR - Error processing callback for node 69d4c5a1932ecfe2320a173f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:52:34,179 - lava_callback - INFO - Received callback for node 69d4c5c5932ecfe2320a175f INFO: 172.21.0.1:47696 - "POST /node/69d4c5c5932ecfe2320a175f HTTP/1.0" 202 Accepted 2026-04-09 08:52:34,184 - lava_callback - INFO - Starting async job submit for node 69d4c5c5932ecfe2320a175f 2026-04-09 08:52:34,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:34,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5c5932ecfe2320a175f HTTP/1.1" 200 None 2026-04-09 08:52:34,200 - lava_callback - DEBUG - Processing node 69d4c5c5932ecfe2320a175f: baseline-arm-clabbe 2026-04-09 08:52:34,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c5c5932ecfe2320a175f 2026-04-09 08:52:34,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:34,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5c5932ecfe2320a175f HTTP/1.1" 200 None 2026-04-09 08:52:34,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:34,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:52:34,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:34,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c5c5932ecfe2320a175f HTTP/1.1" 200 None 2026-04-09 08:52:34,273 - lava_callback - ERROR - Error processing callback for node 69d4c5c5932ecfe2320a175f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:52:54,260 - lava_callback - INFO - Received callback for node 69d4c5e3932ecfe2320a176a INFO: 172.21.0.1:40066 - "POST /node/69d4c5e3932ecfe2320a176a HTTP/1.0" 202 Accepted 2026-04-09 08:52:54,266 - lava_callback - INFO - Starting async job submit for node 69d4c5e3932ecfe2320a176a 2026-04-09 08:52:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:54,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5e3932ecfe2320a176a HTTP/1.1" 200 None 2026-04-09 08:52:54,281 - lava_callback - DEBUG - Processing node 69d4c5e3932ecfe2320a176a: baseline-arm-clabbe 2026-04-09 08:52:54,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c5e3932ecfe2320a176a 2026-04-09 08:52:54,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:54,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c5e3932ecfe2320a176a HTTP/1.1" 200 None 2026-04-09 08:52:54,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:54,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 08:52:54,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:52:54,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c5e3932ecfe2320a176a HTTP/1.1" 200 None 2026-04-09 08:52:54,355 - lava_callback - ERROR - Error processing callback for node 69d4c5e3932ecfe2320a176a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:56:31,432 - lava_callback - INFO - Received callback for node 69d4c6b1932ecfe2320a18d1 INFO: 172.21.0.1:45478 - "POST /node/69d4c6b1932ecfe2320a18d1 HTTP/1.0" 202 Accepted 2026-04-09 08:56:31,437 - lava_callback - INFO - Starting async job submit for node 69d4c6b1932ecfe2320a18d1 2026-04-09 08:56:31,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:56:31,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c6b1932ecfe2320a18d1 HTTP/1.1" 200 None 2026-04-09 08:56:31,456 - lava_callback - DEBUG - Processing node 69d4c6b1932ecfe2320a18d1: baseline-arm-baylibre 2026-04-09 08:56:31,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c6b1932ecfe2320a18d1 2026-04-09 08:56:31,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:56:31,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c6b1932ecfe2320a18d1 HTTP/1.1" 200 None 2026-04-09 08:56:31,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:56:31,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 08:56:31,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:56:31,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c6b1932ecfe2320a18d1 HTTP/1.1" 200 None 2026-04-09 08:56:31,505 - lava_callback - ERROR - Error processing callback for node 69d4c6b1932ecfe2320a18d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:58:11,156 - lava_callback - INFO - Received callback for node 69d4c714932ecfe2320a1925 INFO: 172.21.0.1:39826 - "POST /node/69d4c714932ecfe2320a1925 HTTP/1.0" 202 Accepted 2026-04-09 08:58:11,162 - lava_callback - INFO - Starting async job submit for node 69d4c714932ecfe2320a1925 2026-04-09 08:58:11,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:58:11,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c714932ecfe2320a1925 HTTP/1.1" 200 None 2026-04-09 08:58:11,178 - lava_callback - DEBUG - Processing node 69d4c714932ecfe2320a1925: baseline-arm-baylibre 2026-04-09 08:58:11,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c714932ecfe2320a1925 2026-04-09 08:58:11,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:58:11,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c714932ecfe2320a1925 HTTP/1.1" 200 None 2026-04-09 08:58:11,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:58:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 08:58:11,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:58:11,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c714932ecfe2320a1925 HTTP/1.1" 200 None 2026-04-09 08:58:11,264 - lava_callback - ERROR - Error processing callback for node 69d4c714932ecfe2320a1925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK 2026-04-09 08:59:56,555 - lava_callback - INFO - Received callback for node 69d6fd9435ac66e13269abe6 INFO: 172.21.0.1:44702 - "POST /node/69d6fd9435ac66e13269abe6 HTTP/1.0" 202 Accepted 2026-04-09 08:59:56,561 - lava_callback - INFO - Starting async job submit for node 69d6fd9435ac66e13269abe6 2026-04-09 08:59:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:59:56,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd9435ac66e13269abe6 HTTP/1.1" 200 None 2026-04-09 08:59:56,600 - lava_callback - DEBUG - Processing node 69d6fd9435ac66e13269abe6: baseline-arm64-broonie 2026-04-09 08:59:56,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 08:59:57,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 08:59:57,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d6fd9435ac66e13269abe6/log.txt.gz 2026-04-09 08:59:57,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 08:59:57,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 08:59:57,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d6fd9435ac66e13269abe6/lava-logs.yaml 2026-04-09 08:59:57,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 08:59:57,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 08:59:57,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d6fd9435ac66e13269abe6/lava_callback.json.gz 2026-04-09 08:59:57,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:59:57,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd9435ac66e13269abe6 HTTP/1.1" 200 None 2026-04-09 08:59:57,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:59:57,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-09 08:59:57,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 08:59:57,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d6fd9435ac66e13269abe6 HTTP/1.1" 200 None 2026-04-09 08:59:57,830 - lava_callback - INFO - Completed processing callback for node 69d6fd9435ac66e13269abe6 INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:00:11,228 - lava_callback - INFO - Received callback for node 69d4c789932ecfe2320a1947 INFO: 172.21.0.1:34520 - "POST /node/69d4c789932ecfe2320a1947 HTTP/1.0" 202 Accepted 2026-04-09 09:00:11,233 - lava_callback - INFO - Starting async job submit for node 69d4c789932ecfe2320a1947 2026-04-09 09:00:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:00:11,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c789932ecfe2320a1947 HTTP/1.1" 200 None 2026-04-09 09:00:11,250 - lava_callback - DEBUG - Processing node 69d4c789932ecfe2320a1947: baseline-arm64-baylibre 2026-04-09 09:00:11,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c789932ecfe2320a1947 2026-04-09 09:00:11,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:00:11,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c789932ecfe2320a1947 HTTP/1.1" 200 None 2026-04-09 09:00:11,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:00:11,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:00:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:00:11,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c789932ecfe2320a1947 HTTP/1.1" 200 None 2026-04-09 09:00:11,297 - lava_callback - ERROR - Error processing callback for node 69d4c789932ecfe2320a1947: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:00:20,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:00:20,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:01:11,560 - lava_callback - INFO - Received callback for node 69d7065c50e7993d3c1438c7 INFO: 172.21.0.1:59200 - "POST /node/69d7065c50e7993d3c1438c7 HTTP/1.0" 202 Accepted 2026-04-09 09:01:11,566 - lava_callback - INFO - Starting async job submit for node 69d7065c50e7993d3c1438c7 2026-04-09 09:01:11,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:11,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7065c50e7993d3c1438c7 HTTP/1.1" 200 None 2026-04-09 09:01:11,609 - lava_callback - DEBUG - Processing node 69d7065c50e7993d3c1438c7: baseline-arm64-broonie 2026-04-09 09:01:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:01:12,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:01:12,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7065c50e7993d3c1438c7/log.txt.gz 2026-04-09 09:01:12,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:01:12,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:01:12,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7065c50e7993d3c1438c7/lava-logs.yaml 2026-04-09 09:01:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:01:12,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:01:12,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7065c50e7993d3c1438c7/lava_callback.json.gz 2026-04-09 09:01:12,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:12,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7065c50e7993d3c1438c7 HTTP/1.1" 200 None 2026-04-09 09:01:12,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:12,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-09 09:01:12,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:12,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7065c50e7993d3c1438c7 HTTP/1.1" 200 None 2026-04-09 09:01:12,749 - lava_callback - INFO - Completed processing callback for node 69d7065c50e7993d3c1438c7 INFO: 172.21.0.1:59208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:01:20,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:20,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:01:31,325 - lava_callback - INFO - Received callback for node 69d4c7d5932ecfe2320a1965 INFO: 172.21.0.1:37722 - "POST /node/69d4c7d5932ecfe2320a1965 HTTP/1.0" 202 Accepted 2026-04-09 09:01:31,331 - lava_callback - INFO - Starting async job submit for node 69d4c7d5932ecfe2320a1965 2026-04-09 09:01:31,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:31,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c7d5932ecfe2320a1965 HTTP/1.1" 200 None 2026-04-09 09:01:31,347 - lava_callback - DEBUG - Processing node 69d4c7d5932ecfe2320a1965: baseline-arm64-baylibre 2026-04-09 09:01:31,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c7d5932ecfe2320a1965 2026-04-09 09:01:31,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:31,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c7d5932ecfe2320a1965 HTTP/1.1" 200 None 2026-04-09 09:01:31,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:31,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:01:31,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:01:31,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c7d5932ecfe2320a1965 HTTP/1.1" 200 None 2026-04-09 09:01:31,398 - lava_callback - ERROR - Error processing callback for node 69d4c7d5932ecfe2320a1965: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:02:31,446 - lava_callback - INFO - Received callback for node 69d4c822932ecfe2320a1998 INFO: 172.21.0.1:52790 - "POST /node/69d4c822932ecfe2320a1998 HTTP/1.0" 202 Accepted 2026-04-09 09:02:31,452 - lava_callback - INFO - Starting async job submit for node 69d4c822932ecfe2320a1998 2026-04-09 09:02:31,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:31,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c822932ecfe2320a1998 HTTP/1.1" 200 None 2026-04-09 09:02:31,469 - lava_callback - DEBUG - Processing node 69d4c822932ecfe2320a1998: baseline-arm64-baylibre 2026-04-09 09:02:31,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c822932ecfe2320a1998 2026-04-09 09:02:31,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:31,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c822932ecfe2320a1998 HTTP/1.1" 200 None 2026-04-09 09:02:31,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:31,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:02:31,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:31,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c822932ecfe2320a1998 HTTP/1.1" 200 None 2026-04-09 09:02:31,519 - lava_callback - ERROR - Error processing callback for node 69d4c822932ecfe2320a1998: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:02:31,655 - lava_callback - INFO - Received callback for node 69d7090a50e7993d3c143f08 INFO: 172.21.0.1:52796 - "POST /node/69d7090a50e7993d3c143f08 HTTP/1.0" 202 Accepted 2026-04-09 09:02:31,661 - lava_callback - INFO - Starting async job submit for node 69d7090a50e7993d3c143f08 2026-04-09 09:02:31,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:31,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7090a50e7993d3c143f08 HTTP/1.1" 200 None 2026-04-09 09:02:31,719 - lava_callback - DEBUG - Processing node 69d7090a50e7993d3c143f08: baseline-arm64-broonie 2026-04-09 09:02:31,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:02:32,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:02:32,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7090a50e7993d3c143f08/log.txt.gz 2026-04-09 09:02:32,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:02:32,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:02:32,454 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7090a50e7993d3c143f08/lava-logs.yaml 2026-04-09 09:02:32,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 09:02:32,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 09:02:32,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d7090a50e7993d3c143f08/lava_callback.json.gz 2026-04-09 09:02:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7090a50e7993d3c143f08 HTTP/1.1" 200 None 2026-04-09 09:02:32,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:32,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-09 09:02:32,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:32,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7090a50e7993d3c143f08 HTTP/1.1" 200 None 2026-04-09 09:02:32,699 - lava_callback - INFO - Completed processing callback for node 69d7090a50e7993d3c143f08 INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:02:50,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:02:50,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:03:51,480 - lava_callback - INFO - Received callback for node 69d4c867932ecfe2320a19e8 INFO: 172.21.0.1:36074 - "POST /node/69d4c867932ecfe2320a19e8 HTTP/1.0" 202 Accepted 2026-04-09 09:03:51,485 - lava_callback - INFO - Starting async job submit for node 69d4c867932ecfe2320a19e8 2026-04-09 09:03:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:03:51,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c867932ecfe2320a19e8 HTTP/1.1" 200 None 2026-04-09 09:03:51,500 - lava_callback - DEBUG - Processing node 69d4c867932ecfe2320a19e8: baseline-arm64-baylibre 2026-04-09 09:03:51,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c867932ecfe2320a19e8 2026-04-09 09:03:51,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:03:51,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c867932ecfe2320a19e8 HTTP/1.1" 200 None 2026-04-09 09:03:51,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:03:51,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:03:51,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:03:51,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c867932ecfe2320a19e8 HTTP/1.1" 200 None 2026-04-09 09:03:51,556 - lava_callback - ERROR - Error processing callback for node 69d4c867932ecfe2320a19e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:04:51,452 - lava_callback - INFO - Received callback for node 69d4c8ae932ecfe2320a1a10 INFO: 172.21.0.1:35856 - "POST /node/69d4c8ae932ecfe2320a1a10 HTTP/1.0" 202 Accepted 2026-04-09 09:04:51,458 - lava_callback - INFO - Starting async job submit for node 69d4c8ae932ecfe2320a1a10 2026-04-09 09:04:51,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:04:51,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c8ae932ecfe2320a1a10 HTTP/1.1" 200 None 2026-04-09 09:04:51,475 - lava_callback - DEBUG - Processing node 69d4c8ae932ecfe2320a1a10: baseline-arm64-baylibre 2026-04-09 09:04:51,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c8ae932ecfe2320a1a10 2026-04-09 09:04:51,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:04:51,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c8ae932ecfe2320a1a10 HTTP/1.1" 200 None 2026-04-09 09:04:51,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:04:51,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:04:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:04:51,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c8ae932ecfe2320a1a10 HTTP/1.1" 200 None 2026-04-09 09:04:51,524 - lava_callback - ERROR - Error processing callback for node 69d4c8ae932ecfe2320a1a10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:06:11,578 - lava_callback - INFO - Received callback for node 69d4c8f6932ecfe2320a1a37 INFO: 172.21.0.1:52454 - "POST /node/69d4c8f6932ecfe2320a1a37 HTTP/1.0" 202 Accepted 2026-04-09 09:06:11,583 - lava_callback - INFO - Starting async job submit for node 69d4c8f6932ecfe2320a1a37 2026-04-09 09:06:11,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:06:11,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c8f6932ecfe2320a1a37 HTTP/1.1" 200 None 2026-04-09 09:06:11,599 - lava_callback - DEBUG - Processing node 69d4c8f6932ecfe2320a1a37: baseline-arm64-baylibre 2026-04-09 09:06:11,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c8f6932ecfe2320a1a37 2026-04-09 09:06:11,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:06:11,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c8f6932ecfe2320a1a37 HTTP/1.1" 200 None 2026-04-09 09:06:11,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:06:11,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:06:11,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:06:11,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c8f6932ecfe2320a1a37 HTTP/1.1" 200 None 2026-04-09 09:06:11,646 - lava_callback - ERROR - Error processing callback for node 69d4c8f6932ecfe2320a1a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:07:14,778 - lava_callback - INFO - Received callback for node 69d4c93f932ecfe2320a1a7b INFO: 172.21.0.1:59622 - "POST /node/69d4c93f932ecfe2320a1a7b HTTP/1.0" 202 Accepted 2026-04-09 09:07:14,784 - lava_callback - INFO - Starting async job submit for node 69d4c93f932ecfe2320a1a7b 2026-04-09 09:07:14,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:07:14,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c93f932ecfe2320a1a7b HTTP/1.1" 200 None 2026-04-09 09:07:14,827 - lava_callback - DEBUG - Processing node 69d4c93f932ecfe2320a1a7b: baseline-arm64-clabbe 2026-04-09 09:07:14,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c93f932ecfe2320a1a7b 2026-04-09 09:07:14,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:07:14,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c93f932ecfe2320a1a7b HTTP/1.1" 200 None 2026-04-09 09:07:14,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:07:14,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:07:14,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:07:14,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c93f932ecfe2320a1a7b HTTP/1.1" 200 None 2026-04-09 09:07:14,875 - lava_callback - ERROR - Error processing callback for node 69d4c93f932ecfe2320a1a7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:08:34,820 - lava_callback - INFO - Received callback for node 69d4c989932ecfe2320a1acc INFO: 172.21.0.1:42866 - "POST /node/69d4c989932ecfe2320a1acc HTTP/1.0" 202 Accepted 2026-04-09 09:08:34,826 - lava_callback - INFO - Starting async job submit for node 69d4c989932ecfe2320a1acc 2026-04-09 09:08:34,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:08:34,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1acc HTTP/1.1" 200 None 2026-04-09 09:08:34,854 - lava_callback - DEBUG - Processing node 69d4c989932ecfe2320a1acc: baseline-arm64-clabbe 2026-04-09 09:08:34,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c989932ecfe2320a1acc 2026-04-09 09:08:34,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:08:34,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c989932ecfe2320a1acc HTTP/1.1" 200 None 2026-04-09 09:08:34,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:08:34,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:08:34,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:08:34,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c989932ecfe2320a1acc HTTP/1.1" 200 None 2026-04-09 09:08:34,909 - lava_callback - ERROR - Error processing callback for node 69d4c989932ecfe2320a1acc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:09:11,850 - lava_callback - INFO - Received callback for node 69d4c9ac932ecfe2320a1b5b INFO: 172.21.0.1:57530 - "POST /node/69d4c9ac932ecfe2320a1b5b HTTP/1.0" 202 Accepted 2026-04-09 09:09:11,856 - lava_callback - INFO - Starting async job submit for node 69d4c9ac932ecfe2320a1b5b 2026-04-09 09:09:11,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:11,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ac932ecfe2320a1b5b HTTP/1.1" 200 None 2026-04-09 09:09:11,872 - lava_callback - DEBUG - Processing node 69d4c9ac932ecfe2320a1b5b: baseline-arm64-baylibre 2026-04-09 09:09:11,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9ac932ecfe2320a1b5b 2026-04-09 09:09:11,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:11,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ac932ecfe2320a1b5b HTTP/1.1" 200 None 2026-04-09 09:09:11,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:11,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:11,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:11,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9ac932ecfe2320a1b5b HTTP/1.1" 200 None 2026-04-09 09:09:11,927 - lava_callback - ERROR - Error processing callback for node 69d4c9ac932ecfe2320a1b5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:12,539 - lava_callback - INFO - Received callback for node 69d4c9ae932ecfe2320a1b5e INFO: 172.21.0.1:57532 - "POST /node/69d4c9ae932ecfe2320a1b5e HTTP/1.0" 202 Accepted 2026-04-09 09:09:12,545 - lava_callback - INFO - Starting async job submit for node 69d4c9ae932ecfe2320a1b5e 2026-04-09 09:09:12,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:12,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ae932ecfe2320a1b5e HTTP/1.1" 200 None 2026-04-09 09:09:12,561 - lava_callback - DEBUG - Processing node 69d4c9ae932ecfe2320a1b5e: baseline-arm64-baylibre 2026-04-09 09:09:12,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9ae932ecfe2320a1b5e 2026-04-09 09:09:12,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:12,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ae932ecfe2320a1b5e HTTP/1.1" 200 None 2026-04-09 09:09:12,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:12,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:12,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:12,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9ae932ecfe2320a1b5e HTTP/1.1" 200 None 2026-04-09 09:09:12,623 - lava_callback - ERROR - Error processing callback for node 69d4c9ae932ecfe2320a1b5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:13,200 - lava_callback - INFO - Received callback for node 69d4c9af932ecfe2320a1b61 INFO: 172.21.0.1:57542 - "POST /node/69d4c9af932ecfe2320a1b61 HTTP/1.0" 202 Accepted 2026-04-09 09:09:13,206 - lava_callback - INFO - Starting async job submit for node 69d4c9af932ecfe2320a1b61 2026-04-09 09:09:13,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9af932ecfe2320a1b61 HTTP/1.1" 200 None 2026-04-09 09:09:13,223 - lava_callback - DEBUG - Processing node 69d4c9af932ecfe2320a1b61: baseline-arm64-baylibre 2026-04-09 09:09:13,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9af932ecfe2320a1b61 2026-04-09 09:09:13,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9af932ecfe2320a1b61 HTTP/1.1" 200 None 2026-04-09 09:09:13,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:13,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9af932ecfe2320a1b61 HTTP/1.1" 200 None 2026-04-09 09:09:13,281 - lava_callback - ERROR - Error processing callback for node 69d4c9af932ecfe2320a1b61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:13,879 - lava_callback - INFO - Received callback for node 69d4c9b2932ecfe2320a1b68 INFO: 172.21.0.1:57550 - "POST /node/69d4c9b2932ecfe2320a1b68 HTTP/1.0" 202 Accepted 2026-04-09 09:09:13,885 - lava_callback - INFO - Starting async job submit for node 69d4c9b2932ecfe2320a1b68 2026-04-09 09:09:13,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b2932ecfe2320a1b68 HTTP/1.1" 200 None 2026-04-09 09:09:13,900 - lava_callback - DEBUG - Processing node 69d4c9b2932ecfe2320a1b68: baseline-arm64-baylibre 2026-04-09 09:09:13,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9b2932ecfe2320a1b68 2026-04-09 09:09:13,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b2932ecfe2320a1b68 HTTP/1.1" 200 None 2026-04-09 09:09:13,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:13,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:13,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9b2932ecfe2320a1b68 HTTP/1.1" 200 None 2026-04-09 09:09:13,980 - lava_callback - ERROR - Error processing callback for node 69d4c9b2932ecfe2320a1b68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:14,529 - lava_callback - INFO - Received callback for node 69d4c9b3932ecfe2320a1b6b INFO: 172.21.0.1:57558 - "POST /node/69d4c9b3932ecfe2320a1b6b HTTP/1.0" 202 Accepted 2026-04-09 09:09:14,534 - lava_callback - INFO - Starting async job submit for node 69d4c9b3932ecfe2320a1b6b 2026-04-09 09:09:14,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:14,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b3932ecfe2320a1b6b HTTP/1.1" 200 None 2026-04-09 09:09:14,550 - lava_callback - DEBUG - Processing node 69d4c9b3932ecfe2320a1b6b: baseline-arm64-baylibre 2026-04-09 09:09:14,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9b3932ecfe2320a1b6b 2026-04-09 09:09:14,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:14,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b3932ecfe2320a1b6b HTTP/1.1" 200 None 2026-04-09 09:09:14,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:14,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:14,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9b3932ecfe2320a1b6b HTTP/1.1" 200 None 2026-04-09 09:09:14,599 - lava_callback - ERROR - Error processing callback for node 69d4c9b3932ecfe2320a1b6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:09:15,200 - lava_callback - INFO - Received callback for node 69d4c9b5932ecfe2320a1b6e INFO: 172.21.0.1:57576 - "POST /node/69d4c9b5932ecfe2320a1b6e HTTP/1.0" 202 Accepted 2026-04-09 09:09:15,205 - lava_callback - INFO - Starting async job submit for node 69d4c9b5932ecfe2320a1b6e 2026-04-09 09:09:15,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:15,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b5932ecfe2320a1b6e HTTP/1.1" 200 None 2026-04-09 09:09:15,225 - lava_callback - DEBUG - Processing node 69d4c9b5932ecfe2320a1b6e: baseline-arm64-baylibre 2026-04-09 09:09:15,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9b5932ecfe2320a1b6e 2026-04-09 09:09:15,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:15,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9b5932ecfe2320a1b6e HTTP/1.1" 200 None 2026-04-09 09:09:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:15,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:15,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:15,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9b5932ecfe2320a1b6e HTTP/1.1" 200 None 2026-04-09 09:09:15,276 - lava_callback - ERROR - Error processing callback for node 69d4c9b5932ecfe2320a1b6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:09:34,888 - lava_callback - INFO - Received callback for node 69d4c9c4932ecfe2320a1b9f INFO: 172.21.0.1:37344 - "POST /node/69d4c9c4932ecfe2320a1b9f HTTP/1.0" 202 Accepted 2026-04-09 09:09:34,894 - lava_callback - INFO - Starting async job submit for node 69d4c9c4932ecfe2320a1b9f 2026-04-09 09:09:34,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:34,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c4932ecfe2320a1b9f HTTP/1.1" 200 None 2026-04-09 09:09:34,910 - lava_callback - DEBUG - Processing node 69d4c9c4932ecfe2320a1b9f: baseline-arm64-clabbe 2026-04-09 09:09:34,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c4932ecfe2320a1b9f 2026-04-09 09:09:34,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:34,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c4932ecfe2320a1b9f HTTP/1.1" 200 None 2026-04-09 09:09:34,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:34,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:34,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:34,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c4932ecfe2320a1b9f HTTP/1.1" 200 None 2026-04-09 09:09:34,974 - lava_callback - ERROR - Error processing callback for node 69d4c9c4932ecfe2320a1b9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:35,579 - lava_callback - INFO - Received callback for node 69d4c9c6932ecfe2320a1ba3 INFO: 172.21.0.1:37350 - "POST /node/69d4c9c6932ecfe2320a1ba3 HTTP/1.0" 202 Accepted 2026-04-09 09:09:35,584 - lava_callback - INFO - Starting async job submit for node 69d4c9c6932ecfe2320a1ba3 2026-04-09 09:09:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:35,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c6932ecfe2320a1ba3 HTTP/1.1" 200 None 2026-04-09 09:09:35,601 - lava_callback - DEBUG - Processing node 69d4c9c6932ecfe2320a1ba3: baseline-arm64-clabbe 2026-04-09 09:09:35,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c6932ecfe2320a1ba3 2026-04-09 09:09:35,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:35,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c6932ecfe2320a1ba3 HTTP/1.1" 200 None 2026-04-09 09:09:35,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:35,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:35,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:35,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c6932ecfe2320a1ba3 HTTP/1.1" 200 None 2026-04-09 09:09:35,650 - lava_callback - ERROR - Error processing callback for node 69d4c9c6932ecfe2320a1ba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:36,269 - lava_callback - INFO - Received callback for node 69d4c9c7932ecfe2320a1bad INFO: 172.21.0.1:37362 - "POST /node/69d4c9c7932ecfe2320a1bad HTTP/1.0" 202 Accepted 2026-04-09 09:09:36,275 - lava_callback - INFO - Starting async job submit for node 69d4c9c7932ecfe2320a1bad 2026-04-09 09:09:36,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c7932ecfe2320a1bad HTTP/1.1" 200 None 2026-04-09 09:09:36,290 - lava_callback - DEBUG - Processing node 69d4c9c7932ecfe2320a1bad: baseline-arm64-clabbe 2026-04-09 09:09:36,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c7932ecfe2320a1bad 2026-04-09 09:09:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c7932ecfe2320a1bad HTTP/1.1" 200 None 2026-04-09 09:09:36,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:36,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c7932ecfe2320a1bad HTTP/1.1" 200 None 2026-04-09 09:09:36,362 - lava_callback - ERROR - Error processing callback for node 69d4c9c7932ecfe2320a1bad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:09:36,947 - lava_callback - INFO - Received callback for node 69d4c9c7932ecfe2320a1bcc INFO: 172.21.0.1:37376 - "POST /node/69d4c9c7932ecfe2320a1bcc HTTP/1.0" 202 Accepted 2026-04-09 09:09:36,952 - lava_callback - INFO - Starting async job submit for node 69d4c9c7932ecfe2320a1bcc 2026-04-09 09:09:36,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c7932ecfe2320a1bcc HTTP/1.1" 200 None 2026-04-09 09:09:36,969 - lava_callback - DEBUG - Processing node 69d4c9c7932ecfe2320a1bcc: baseline-arm64-clabbe 2026-04-09 09:09:36,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c7932ecfe2320a1bcc 2026-04-09 09:09:36,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c7932ecfe2320a1bcc HTTP/1.1" 200 None 2026-04-09 09:09:36,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:36,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:36,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:37,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c7932ecfe2320a1bcc HTTP/1.1" 200 None 2026-04-09 09:09:37,021 - lava_callback - ERROR - Error processing callback for node 69d4c9c7932ecfe2320a1bcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:37,630 - lava_callback - INFO - Received callback for node 69d4c9c8932ecfe2320a1bcf INFO: 172.21.0.1:37382 - "POST /node/69d4c9c8932ecfe2320a1bcf HTTP/1.0" 202 Accepted 2026-04-09 09:09:37,635 - lava_callback - INFO - Starting async job submit for node 69d4c9c8932ecfe2320a1bcf 2026-04-09 09:09:37,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:37,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c8932ecfe2320a1bcf HTTP/1.1" 200 None 2026-04-09 09:09:37,652 - lava_callback - DEBUG - Processing node 69d4c9c8932ecfe2320a1bcf: baseline-arm64-clabbe 2026-04-09 09:09:37,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c8932ecfe2320a1bcf 2026-04-09 09:09:37,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:37,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c8932ecfe2320a1bcf HTTP/1.1" 200 None 2026-04-09 09:09:37,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:37,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:37,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:37,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c8932ecfe2320a1bcf HTTP/1.1" 200 None 2026-04-09 09:09:37,704 - lava_callback - ERROR - Error processing callback for node 69d4c9c8932ecfe2320a1bcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:38,309 - lava_callback - INFO - Received callback for node 69d4c9ca932ecfe2320a1bd5 INFO: 172.21.0.1:37398 - "POST /node/69d4c9ca932ecfe2320a1bd5 HTTP/1.0" 202 Accepted 2026-04-09 09:09:38,314 - lava_callback - INFO - Starting async job submit for node 69d4c9ca932ecfe2320a1bd5 2026-04-09 09:09:38,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:38,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ca932ecfe2320a1bd5 HTTP/1.1" 200 None 2026-04-09 09:09:38,330 - lava_callback - DEBUG - Processing node 69d4c9ca932ecfe2320a1bd5: baseline-arm64-clabbe 2026-04-09 09:09:38,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9ca932ecfe2320a1bd5 2026-04-09 09:09:38,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:38,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9ca932ecfe2320a1bd5 HTTP/1.1" 200 None 2026-04-09 09:09:38,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:38,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:38,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:38,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9ca932ecfe2320a1bd5 HTTP/1.1" 200 None 2026-04-09 09:09:38,382 - lava_callback - ERROR - Error processing callback for node 69d4c9ca932ecfe2320a1bd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 09:09:38,994 - lava_callback - INFO - Received callback for node 69d4c9c9932ecfe2320a1bd2 INFO: 172.21.0.1:37410 - "POST /node/69d4c9c9932ecfe2320a1bd2 HTTP/1.0" 202 Accepted 2026-04-09 09:09:39,000 - lava_callback - INFO - Starting async job submit for node 69d4c9c9932ecfe2320a1bd2 2026-04-09 09:09:39,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:39,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c9932ecfe2320a1bd2 HTTP/1.1" 200 None 2026-04-09 09:09:39,020 - lava_callback - DEBUG - Processing node 69d4c9c9932ecfe2320a1bd2: baseline-arm64-clabbe 2026-04-09 09:09:39,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9c9932ecfe2320a1bd2 2026-04-09 09:09:39,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:39,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9c9932ecfe2320a1bd2 HTTP/1.1" 200 None 2026-04-09 09:09:39,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:39,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 09:09:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:39,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9c9932ecfe2320a1bd2 HTTP/1.1" 200 None 2026-04-09 09:09:39,072 - lava_callback - ERROR - Error processing callback for node 69d4c9c9932ecfe2320a1bd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:09:54,830 - lava_callback - INFO - Received callback for node 69d4c9d5932ecfe2320a1bee INFO: 172.21.0.1:56512 - "POST /node/69d4c9d5932ecfe2320a1bee HTTP/1.0" 202 Accepted 2026-04-09 09:09:54,836 - lava_callback - INFO - Starting async job submit for node 69d4c9d5932ecfe2320a1bee 2026-04-09 09:09:54,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:54,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d5932ecfe2320a1bee HTTP/1.1" 200 None 2026-04-09 09:09:54,852 - lava_callback - DEBUG - Processing node 69d4c9d5932ecfe2320a1bee: baseline-arm64-clabbe 2026-04-09 09:09:54,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4c9d5932ecfe2320a1bee 2026-04-09 09:09:54,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:54,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4c9d5932ecfe2320a1bee HTTP/1.1" 200 None 2026-04-09 09:09:54,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:54,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:09:54,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:09:54,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4c9d5932ecfe2320a1bee HTTP/1.1" 200 None 2026-04-09 09:09:54,911 - lava_callback - ERROR - Error processing callback for node 69d4c9d5932ecfe2320a1bee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:11:34,936 - lava_callback - INFO - Received callback for node 69d4ca35932ecfe2320a1cd5 INFO: 172.21.0.1:59110 - "POST /node/69d4ca35932ecfe2320a1cd5 HTTP/1.0" 202 Accepted 2026-04-09 09:11:34,942 - lava_callback - INFO - Starting async job submit for node 69d4ca35932ecfe2320a1cd5 2026-04-09 09:11:34,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:11:34,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ca35932ecfe2320a1cd5 HTTP/1.1" 200 None 2026-04-09 09:11:34,959 - lava_callback - DEBUG - Processing node 69d4ca35932ecfe2320a1cd5: baseline-arm64-clabbe 2026-04-09 09:11:34,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ca35932ecfe2320a1cd5 2026-04-09 09:11:34,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:11:34,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ca35932ecfe2320a1cd5 HTTP/1.1" 200 None 2026-04-09 09:11:34,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:11:34,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:11:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:11:35,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ca35932ecfe2320a1cd5 HTTP/1.1" 200 None 2026-04-09 09:11:35,009 - lava_callback - ERROR - Error processing callback for node 69d4ca35932ecfe2320a1cd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:13:15,017 - lava_callback - INFO - Received callback for node 69d4caa5932ecfe2320a1d3c INFO: 172.21.0.1:55498 - "POST /node/69d4caa5932ecfe2320a1d3c HTTP/1.0" 202 Accepted 2026-04-09 09:13:15,023 - lava_callback - INFO - Starting async job submit for node 69d4caa5932ecfe2320a1d3c 2026-04-09 09:13:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:13:15,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4caa5932ecfe2320a1d3c HTTP/1.1" 200 None 2026-04-09 09:13:15,039 - lava_callback - DEBUG - Processing node 69d4caa5932ecfe2320a1d3c: baseline-arm64-clabbe 2026-04-09 09:13:15,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4caa5932ecfe2320a1d3c 2026-04-09 09:13:15,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:13:15,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4caa5932ecfe2320a1d3c HTTP/1.1" 200 None 2026-04-09 09:13:15,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:13:15,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:13:15,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:13:15,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4caa5932ecfe2320a1d3c HTTP/1.1" 200 None 2026-04-09 09:13:15,112 - lava_callback - ERROR - Error processing callback for node 69d4caa5932ecfe2320a1d3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:14:35,079 - lava_callback - INFO - Received callback for node 69d4caf4932ecfe2320a1d71 INFO: 172.21.0.1:53180 - "POST /node/69d4caf4932ecfe2320a1d71 HTTP/1.0" 202 Accepted 2026-04-09 09:14:35,085 - lava_callback - INFO - Starting async job submit for node 69d4caf4932ecfe2320a1d71 2026-04-09 09:14:35,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:14:35,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4caf4932ecfe2320a1d71 HTTP/1.1" 200 None 2026-04-09 09:14:35,100 - lava_callback - DEBUG - Processing node 69d4caf4932ecfe2320a1d71: baseline-arm64-clabbe 2026-04-09 09:14:35,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4caf4932ecfe2320a1d71 2026-04-09 09:14:35,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:14:35,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4caf4932ecfe2320a1d71 HTTP/1.1" 200 None 2026-04-09 09:14:35,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:14:35,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:14:35,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:14:35,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4caf4932ecfe2320a1d71 HTTP/1.1" 200 None 2026-04-09 09:14:35,156 - lava_callback - ERROR - Error processing callback for node 69d4caf4932ecfe2320a1d71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:16:15,144 - lava_callback - INFO - Received callback for node 69d4cb4b932ecfe2320a1d7d INFO: 172.21.0.1:48248 - "POST /node/69d4cb4b932ecfe2320a1d7d HTTP/1.0" 202 Accepted 2026-04-09 09:16:15,150 - lava_callback - INFO - Starting async job submit for node 69d4cb4b932ecfe2320a1d7d 2026-04-09 09:16:15,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:15,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cb4b932ecfe2320a1d7d HTTP/1.1" 200 None 2026-04-09 09:16:15,167 - lava_callback - DEBUG - Processing node 69d4cb4b932ecfe2320a1d7d: baseline-arm64-clabbe 2026-04-09 09:16:15,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cb4b932ecfe2320a1d7d 2026-04-09 09:16:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48252 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:16:15,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cb4b932ecfe2320a1d7d HTTP/1.1" 200 None 2026-04-09 09:16:15,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:15,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 09:16:15,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:15,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cb4b932ecfe2320a1d7d HTTP/1.1" 200 None 2026-04-09 09:16:15,222 - lava_callback - ERROR - Error processing callback for node 69d4cb4b932ecfe2320a1d7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:16:52,165 - lava_callback - INFO - Received callback for node 69d4cb81932ecfe2320a1d92 INFO: 172.21.0.1:47812 - "POST /node/69d4cb81932ecfe2320a1d92 HTTP/1.0" 202 Accepted 2026-04-09 09:16:52,170 - lava_callback - INFO - Starting async job submit for node 69d4cb81932ecfe2320a1d92 2026-04-09 09:16:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:52,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cb81932ecfe2320a1d92 HTTP/1.1" 200 None 2026-04-09 09:16:52,186 - lava_callback - DEBUG - Processing node 69d4cb81932ecfe2320a1d92: baseline-arm-baylibre 2026-04-09 09:16:52,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cb81932ecfe2320a1d92 2026-04-09 09:16:52,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:52,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cb81932ecfe2320a1d92 HTTP/1.1" 200 None 2026-04-09 09:16:52,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:52,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:16:52,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:16:52,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cb81932ecfe2320a1d92 HTTP/1.1" 200 None 2026-04-09 09:16:52,236 - lava_callback - ERROR - Error processing callback for node 69d4cb81932ecfe2320a1d92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:17:35,199 - lava_callback - INFO - Received callback for node 69d4cba6932ecfe2320a1db4 INFO: 172.21.0.1:54572 - "POST /node/69d4cba6932ecfe2320a1db4 HTTP/1.0" 202 Accepted 2026-04-09 09:17:35,205 - lava_callback - INFO - Starting async job submit for node 69d4cba6932ecfe2320a1db4 2026-04-09 09:17:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:17:35,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cba6932ecfe2320a1db4 HTTP/1.1" 200 None 2026-04-09 09:17:35,234 - lava_callback - DEBUG - Processing node 69d4cba6932ecfe2320a1db4: baseline-arm-clabbe 2026-04-09 09:17:35,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cba6932ecfe2320a1db4 2026-04-09 09:17:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:17:35,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cba6932ecfe2320a1db4 HTTP/1.1" 200 None 2026-04-09 09:17:35,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:17:35,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:17:35,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:17:35,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cba6932ecfe2320a1db4 HTTP/1.1" 200 None 2026-04-09 09:17:35,297 - lava_callback - ERROR - Error processing callback for node 69d4cba6932ecfe2320a1db4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:18:15,205 - lava_callback - INFO - Received callback for node 69d4cbc6932ecfe2320a1e09 INFO: 172.21.0.1:57980 - "POST /node/69d4cbc6932ecfe2320a1e09 HTTP/1.0" 202 Accepted 2026-04-09 09:18:15,210 - lava_callback - INFO - Starting async job submit for node 69d4cbc6932ecfe2320a1e09 2026-04-09 09:18:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:18:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cbc6932ecfe2320a1e09 HTTP/1.1" 200 None 2026-04-09 09:18:15,227 - lava_callback - DEBUG - Processing node 69d4cbc6932ecfe2320a1e09: baseline-arm-clabbe 2026-04-09 09:18:15,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cbc6932ecfe2320a1e09 2026-04-09 09:18:15,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:18:15,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cbc6932ecfe2320a1e09 HTTP/1.1" 200 None 2026-04-09 09:18:15,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:18:15,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:18:15,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:18:15,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cbc6932ecfe2320a1e09 HTTP/1.1" 200 None 2026-04-09 09:18:15,281 - lava_callback - ERROR - Error processing callback for node 69d4cbc6932ecfe2320a1e09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:19:15,290 - lava_callback - INFO - Received callback for node 69d4cc0c932ecfe2320a1e34 INFO: 172.21.0.1:37326 - "POST /node/69d4cc0c932ecfe2320a1e34 HTTP/1.0" 202 Accepted 2026-04-09 09:19:15,296 - lava_callback - INFO - Starting async job submit for node 69d4cc0c932ecfe2320a1e34 2026-04-09 09:19:15,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:15,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc0c932ecfe2320a1e34 HTTP/1.1" 200 None 2026-04-09 09:19:15,313 - lava_callback - DEBUG - Processing node 69d4cc0c932ecfe2320a1e34: baseline-arm-clabbe 2026-04-09 09:19:15,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cc0c932ecfe2320a1e34 2026-04-09 09:19:15,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:15,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc0c932ecfe2320a1e34 HTTP/1.1" 200 None 2026-04-09 09:19:15,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:15,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:19:15,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:15,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cc0c932ecfe2320a1e34 HTTP/1.1" 200 None 2026-04-09 09:19:15,375 - lava_callback - ERROR - Error processing callback for node 69d4cc0c932ecfe2320a1e34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:19:55,245 - lava_callback - INFO - Received callback for node 69d4cc2c932ecfe2320a1e4f INFO: 172.21.0.1:45854 - "POST /node/69d4cc2c932ecfe2320a1e4f HTTP/1.0" 202 Accepted 2026-04-09 09:19:55,250 - lava_callback - INFO - Starting async job submit for node 69d4cc2c932ecfe2320a1e4f 2026-04-09 09:19:55,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:55,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc2c932ecfe2320a1e4f HTTP/1.1" 200 None 2026-04-09 09:19:55,265 - lava_callback - DEBUG - Processing node 69d4cc2c932ecfe2320a1e4f: baseline-arm-clabbe 2026-04-09 09:19:55,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cc2c932ecfe2320a1e4f 2026-04-09 09:19:55,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:55,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc2c932ecfe2320a1e4f HTTP/1.1" 200 None 2026-04-09 09:19:55,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:55,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:19:55,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:19:55,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cc2c932ecfe2320a1e4f HTTP/1.1" 200 None 2026-04-09 09:19:55,322 - lava_callback - ERROR - Error processing callback for node 69d4cc2c932ecfe2320a1e4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:21:35,372 - lava_callback - INFO - Received callback for node 69d4cc8e932ecfe2320a1ebd INFO: 172.21.0.1:35452 - "POST /node/69d4cc8e932ecfe2320a1ebd HTTP/1.0" 202 Accepted 2026-04-09 09:21:35,380 - lava_callback - INFO - Starting async job submit for node 69d4cc8e932ecfe2320a1ebd 2026-04-09 09:21:35,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:21:35,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc8e932ecfe2320a1ebd HTTP/1.1" 200 None 2026-04-09 09:21:35,401 - lava_callback - DEBUG - Processing node 69d4cc8e932ecfe2320a1ebd: baseline-arm-clabbe 2026-04-09 09:21:35,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cc8e932ecfe2320a1ebd 2026-04-09 09:21:35,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:21:35,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cc8e932ecfe2320a1ebd HTTP/1.1" 200 None 2026-04-09 09:21:35,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:21:35,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:21:35,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:21:35,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cc8e932ecfe2320a1ebd HTTP/1.1" 200 None 2026-04-09 09:21:35,474 - lava_callback - ERROR - Error processing callback for node 69d4cc8e932ecfe2320a1ebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:22:35,417 - lava_callback - INFO - Received callback for node 69d4ccc8932ecfe2320a1f15 INFO: 172.21.0.1:53600 - "POST /node/69d4ccc8932ecfe2320a1f15 HTTP/1.0" 202 Accepted 2026-04-09 09:22:35,422 - lava_callback - INFO - Starting async job submit for node 69d4ccc8932ecfe2320a1f15 2026-04-09 09:22:35,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:22:35,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ccc8932ecfe2320a1f15 HTTP/1.1" 200 None 2026-04-09 09:22:35,439 - lava_callback - DEBUG - Processing node 69d4ccc8932ecfe2320a1f15: baseline-arm-clabbe 2026-04-09 09:22:35,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ccc8932ecfe2320a1f15 2026-04-09 09:22:35,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:22:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ccc8932ecfe2320a1f15 HTTP/1.1" 200 None 2026-04-09 09:22:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:22:35,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-09 09:22:35,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:22:35,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ccc8932ecfe2320a1f15 HTTP/1.1" 200 None 2026-04-09 09:22:35,492 - lava_callback - ERROR - Error processing callback for node 69d4ccc8932ecfe2320a1f15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:35:13,136 - lava_callback - INFO - Received callback for node 69d4cfbb932ecfe2320a2160 INFO: 172.21.0.1:58752 - "POST /node/69d4cfbb932ecfe2320a2160 HTTP/1.0" 202 Accepted 2026-04-09 09:35:13,142 - lava_callback - INFO - Starting async job submit for node 69d4cfbb932ecfe2320a2160 2026-04-09 09:35:13,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:35:13,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cfbb932ecfe2320a2160 HTTP/1.1" 200 None 2026-04-09 09:35:13,158 - lava_callback - DEBUG - Processing node 69d4cfbb932ecfe2320a2160: baseline-arm64-baylibre 2026-04-09 09:35:13,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4cfbb932ecfe2320a2160 2026-04-09 09:35:13,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:35:13,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4cfbb932ecfe2320a2160 HTTP/1.1" 200 None 2026-04-09 09:35:13,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:35:13,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:35:13,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:35:13,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4cfbb932ecfe2320a2160 HTTP/1.1" 200 None 2026-04-09 09:35:13,221 - lava_callback - ERROR - Error processing callback for node 69d4cfbb932ecfe2320a2160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:38:33,269 - lava_callback - INFO - Received callback for node 69d4d08f932ecfe2320a21f8 INFO: 172.21.0.1:36380 - "POST /node/69d4d08f932ecfe2320a21f8 HTTP/1.0" 202 Accepted 2026-04-09 09:38:33,274 - lava_callback - INFO - Starting async job submit for node 69d4d08f932ecfe2320a21f8 2026-04-09 09:38:33,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:38:33,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d08f932ecfe2320a21f8 HTTP/1.1" 200 None 2026-04-09 09:38:33,291 - lava_callback - DEBUG - Processing node 69d4d08f932ecfe2320a21f8: baseline-arm64-baylibre 2026-04-09 09:38:33,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d08f932ecfe2320a21f8 2026-04-09 09:38:33,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:38:33,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d08f932ecfe2320a21f8 HTTP/1.1" 200 None 2026-04-09 09:38:33,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:38:33,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:38:33,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:38:33,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d08f932ecfe2320a21f8 HTTP/1.1" 200 None 2026-04-09 09:38:33,339 - lava_callback - ERROR - Error processing callback for node 69d4d08f932ecfe2320a21f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:41:53,430 - lava_callback - INFO - Received callback for node 69d4d15e932ecfe2320a22d5 INFO: 172.21.0.1:59406 - "POST /node/69d4d15e932ecfe2320a22d5 HTTP/1.0" 202 Accepted 2026-04-09 09:41:53,435 - lava_callback - INFO - Starting async job submit for node 69d4d15e932ecfe2320a22d5 2026-04-09 09:41:53,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:41:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d15e932ecfe2320a22d5 HTTP/1.1" 200 None 2026-04-09 09:41:53,492 - lava_callback - DEBUG - Processing node 69d4d15e932ecfe2320a22d5: baseline-arm64-baylibre 2026-04-09 09:41:53,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d15e932ecfe2320a22d5 2026-04-09 09:41:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:41:53,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d15e932ecfe2320a22d5 HTTP/1.1" 200 None 2026-04-09 09:41:53,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:41:53,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:41:53,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:41:53,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d15e932ecfe2320a22d5 HTTP/1.1" 200 None 2026-04-09 09:41:53,572 - lava_callback - ERROR - Error processing callback for node 69d4d15e932ecfe2320a22d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:43:16,369 - lava_callback - INFO - Received callback for node 69d4d1a1932ecfe2320a232f INFO: 172.21.0.1:53254 - "POST /node/69d4d1a1932ecfe2320a232f HTTP/1.0" 202 Accepted 2026-04-09 09:43:16,375 - lava_callback - INFO - Starting async job submit for node 69d4d1a1932ecfe2320a232f 2026-04-09 09:43:16,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:43:16,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d1a1932ecfe2320a232f HTTP/1.1" 200 None 2026-04-09 09:43:16,404 - lava_callback - DEBUG - Processing node 69d4d1a1932ecfe2320a232f: baseline-arm64-clabbe 2026-04-09 09:43:16,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d1a1932ecfe2320a232f 2026-04-09 09:43:16,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:43:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d1a1932ecfe2320a232f HTTP/1.1" 200 None 2026-04-09 09:43:16,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:43:16,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:43:16,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:43:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d1a1932ecfe2320a232f HTTP/1.1" 200 None 2026-04-09 09:43:16,453 - lava_callback - ERROR - Error processing callback for node 69d4d1a1932ecfe2320a232f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 09:44:16,373 - lava_callback - INFO - Received callback for node 69d4d1ea932ecfe2320a2354 INFO: 172.21.0.1:58958 - "POST /node/69d4d1ea932ecfe2320a2354 HTTP/1.0" 202 Accepted 2026-04-09 09:44:16,379 - lava_callback - INFO - Starting async job submit for node 69d4d1ea932ecfe2320a2354 2026-04-09 09:44:16,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:44:16,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d1ea932ecfe2320a2354 HTTP/1.1" 200 None 2026-04-09 09:44:16,414 - lava_callback - DEBUG - Processing node 69d4d1ea932ecfe2320a2354: baseline-arm64-clabbe 2026-04-09 09:44:16,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d1ea932ecfe2320a2354 2026-04-09 09:44:16,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:44:16,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d1ea932ecfe2320a2354 HTTP/1.1" 200 None 2026-04-09 09:44:16,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:44:16,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:44:16,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:44:16,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d1ea932ecfe2320a2354 HTTP/1.1" 200 None 2026-04-09 09:44:16,474 - lava_callback - ERROR - Error processing callback for node 69d4d1ea932ecfe2320a2354: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:45:36,438 - lava_callback - INFO - Received callback for node 69d4d233932ecfe2320a2390 INFO: 172.21.0.1:58624 - "POST /node/69d4d233932ecfe2320a2390 HTTP/1.0" 202 Accepted 2026-04-09 09:45:36,447 - lava_callback - INFO - Starting async job submit for node 69d4d233932ecfe2320a2390 2026-04-09 09:45:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:45:36,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d233932ecfe2320a2390 HTTP/1.1" 200 None 2026-04-09 09:45:36,467 - lava_callback - DEBUG - Processing node 69d4d233932ecfe2320a2390: baseline-arm64-clabbe 2026-04-09 09:45:36,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d233932ecfe2320a2390 2026-04-09 09:45:36,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:45:36,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d233932ecfe2320a2390 HTTP/1.1" 200 None 2026-04-09 09:45:36,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:45:36,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:45:36,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:45:36,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d233932ecfe2320a2390 HTTP/1.1" 200 None 2026-04-09 09:45:36,532 - lava_callback - ERROR - Error processing callback for node 69d4d233932ecfe2320a2390: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:46:36,489 - lava_callback - INFO - Received callback for node 69d4d279932ecfe2320a23d1 INFO: 172.21.0.1:59724 - "POST /node/69d4d279932ecfe2320a23d1 HTTP/1.0" 202 Accepted 2026-04-09 09:46:36,498 - lava_callback - INFO - Starting async job submit for node 69d4d279932ecfe2320a23d1 2026-04-09 09:46:36,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:46:36,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d279932ecfe2320a23d1 HTTP/1.1" 200 None 2026-04-09 09:46:36,521 - lava_callback - DEBUG - Processing node 69d4d279932ecfe2320a23d1: baseline-arm64-clabbe 2026-04-09 09:46:36,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d279932ecfe2320a23d1 2026-04-09 09:46:36,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:46:36,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d279932ecfe2320a23d1 HTTP/1.1" 200 None 2026-04-09 09:46:36,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:46:36,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:46:36,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:46:36,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d279932ecfe2320a23d1 HTTP/1.1" 200 None 2026-04-09 09:46:36,574 - lava_callback - ERROR - Error processing callback for node 69d4d279932ecfe2320a23d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:50:16,662 - lava_callback - INFO - Received callback for node 69d4d34b932ecfe2320a245e INFO: 172.21.0.1:50716 - "POST /node/69d4d34b932ecfe2320a245e HTTP/1.0" 202 Accepted 2026-04-09 09:50:16,670 - lava_callback - INFO - Starting async job submit for node 69d4d34b932ecfe2320a245e 2026-04-09 09:50:16,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:50:16,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d34b932ecfe2320a245e HTTP/1.1" 200 None 2026-04-09 09:50:16,687 - lava_callback - DEBUG - Processing node 69d4d34b932ecfe2320a245e: baseline-arm64-clabbe 2026-04-09 09:50:16,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d34b932ecfe2320a245e 2026-04-09 09:50:16,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:50:16,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d34b932ecfe2320a245e HTTP/1.1" 200 None 2026-04-09 09:50:16,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:50:16,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:50:16,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:50:16,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d34b932ecfe2320a245e HTTP/1.1" 200 None 2026-04-09 09:50:16,747 - lava_callback - ERROR - Error processing callback for node 69d4d34b932ecfe2320a245e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:51:36,736 - lava_callback - INFO - Received callback for node 69d4d394932ecfe2320a247a INFO: 172.21.0.1:59034 - "POST /node/69d4d394932ecfe2320a247a HTTP/1.0" 202 Accepted 2026-04-09 09:51:36,742 - lava_callback - INFO - Starting async job submit for node 69d4d394932ecfe2320a247a 2026-04-09 09:51:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:51:36,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d394932ecfe2320a247a HTTP/1.1" 200 None 2026-04-09 09:51:36,758 - lava_callback - DEBUG - Processing node 69d4d394932ecfe2320a247a: baseline-arm64-clabbe 2026-04-09 09:51:36,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d394932ecfe2320a247a 2026-04-09 09:51:36,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:51:36,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d394932ecfe2320a247a HTTP/1.1" 200 None 2026-04-09 09:51:36,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:51:36,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 09:51:36,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:51:36,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d394932ecfe2320a247a HTTP/1.1" 200 None 2026-04-09 09:51:36,805 - lava_callback - ERROR - Error processing callback for node 69d4d394932ecfe2320a247a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET /node/6953076b9912bd6bbcea6ebc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:54:34,118 - lava_callback - INFO - Received callback for node 69d4d451932ecfe2320a24ee INFO: 172.21.0.1:58050 - "POST /node/69d4d451932ecfe2320a24ee HTTP/1.0" 202 Accepted 2026-04-09 09:54:34,126 - lava_callback - INFO - Starting async job submit for node 69d4d451932ecfe2320a24ee 2026-04-09 09:54:34,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:54:34,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d451932ecfe2320a24ee HTTP/1.1" 200 None 2026-04-09 09:54:34,149 - lava_callback - DEBUG - Processing node 69d4d451932ecfe2320a24ee: baseline-arm-baylibre 2026-04-09 09:54:34,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d451932ecfe2320a24ee 2026-04-09 09:54:34,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:54:34,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d451932ecfe2320a24ee HTTP/1.1" 200 None 2026-04-09 09:54:34,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:54:34,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:54:34,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:54:34,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d451932ecfe2320a24ee HTTP/1.1" 200 None 2026-04-09 09:54:34,207 - lava_callback - ERROR - Error processing callback for node 69d4d451932ecfe2320a24ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:55:14,086 - lava_callback - INFO - Received callback for node 69d4d472932ecfe2320a2514 INFO: 172.21.0.1:49270 - "POST /node/69d4d472932ecfe2320a2514 HTTP/1.0" 202 Accepted 2026-04-09 09:55:14,091 - lava_callback - INFO - Starting async job submit for node 69d4d472932ecfe2320a2514 2026-04-09 09:55:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:14,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d472932ecfe2320a2514 HTTP/1.1" 200 None 2026-04-09 09:55:14,109 - lava_callback - DEBUG - Processing node 69d4d472932ecfe2320a2514: baseline-arm-baylibre 2026-04-09 09:55:14,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d472932ecfe2320a2514 2026-04-09 09:55:14,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:14,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d472932ecfe2320a2514 HTTP/1.1" 200 None 2026-04-09 09:55:14,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:14,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:55:14,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:14,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d472932ecfe2320a2514 HTTP/1.1" 200 None 2026-04-09 09:55:14,159 - lava_callback - ERROR - Error processing callback for node 69d4d472932ecfe2320a2514: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:55:34,118 - lava_callback - INFO - Received callback for node 69d4d48f932ecfe2320a252b INFO: 172.21.0.1:60422 - "POST /node/69d4d48f932ecfe2320a252b HTTP/1.0" 202 Accepted 2026-04-09 09:55:34,124 - lava_callback - INFO - Starting async job submit for node 69d4d48f932ecfe2320a252b 2026-04-09 09:55:34,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:34,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d48f932ecfe2320a252b HTTP/1.1" 200 None 2026-04-09 09:55:34,146 - lava_callback - DEBUG - Processing node 69d4d48f932ecfe2320a252b: baseline-arm-baylibre 2026-04-09 09:55:34,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d48f932ecfe2320a252b 2026-04-09 09:55:34,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:34,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d48f932ecfe2320a252b HTTP/1.1" 200 None 2026-04-09 09:55:34,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:34,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:55:34,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:55:34,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d48f932ecfe2320a252b HTTP/1.1" 200 None 2026-04-09 09:55:34,224 - lava_callback - ERROR - Error processing callback for node 69d4d48f932ecfe2320a252b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET /node/693f043d24745582e3997407%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54932 - "GET /node/69900cd876d4b6342e9ddb70%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:57:14,292 - lava_callback - INFO - Received callback for node 69d4d4eb932ecfe2320a259f INFO: 172.21.0.1:47068 - "POST /node/69d4d4eb932ecfe2320a259f HTTP/1.0" 202 Accepted 2026-04-09 09:57:14,297 - lava_callback - INFO - Starting async job submit for node 69d4d4eb932ecfe2320a259f 2026-04-09 09:57:14,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:14,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d4eb932ecfe2320a259f HTTP/1.1" 200 None 2026-04-09 09:57:14,313 - lava_callback - DEBUG - Processing node 69d4d4eb932ecfe2320a259f: baseline-arm-baylibre 2026-04-09 09:57:14,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d4eb932ecfe2320a259f 2026-04-09 09:57:14,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:14,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d4eb932ecfe2320a259f HTTP/1.1" 200 None 2026-04-09 09:57:14,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:14,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:57:14,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:14,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d4eb932ecfe2320a259f HTTP/1.1" 200 None 2026-04-09 09:57:14,362 - lava_callback - ERROR - Error processing callback for node 69d4d4eb932ecfe2320a259f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:57:54,257 - lava_callback - INFO - Received callback for node 69d4d514932ecfe2320a25af INFO: 172.21.0.1:41736 - "POST /node/69d4d514932ecfe2320a25af HTTP/1.0" 202 Accepted 2026-04-09 09:57:54,263 - lava_callback - INFO - Starting async job submit for node 69d4d514932ecfe2320a25af 2026-04-09 09:57:54,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:54,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d514932ecfe2320a25af HTTP/1.1" 200 None 2026-04-09 09:57:54,281 - lava_callback - DEBUG - Processing node 69d4d514932ecfe2320a25af: baseline-arm-baylibre 2026-04-09 09:57:54,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d514932ecfe2320a25af 2026-04-09 09:57:54,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:54,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d514932ecfe2320a25af HTTP/1.1" 200 None 2026-04-09 09:57:54,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:54,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:57:54,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:57:54,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d514932ecfe2320a25af HTTP/1.1" 200 None 2026-04-09 09:57:54,332 - lava_callback - ERROR - Error processing callback for node 69d4d514932ecfe2320a25af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK 2026-04-09 09:59:34,357 - lava_callback - INFO - Received callback for node 69d4d57d932ecfe2320a25de INFO: 172.21.0.1:60908 - "POST /node/69d4d57d932ecfe2320a25de HTTP/1.0" 202 Accepted 2026-04-09 09:59:34,363 - lava_callback - INFO - Starting async job submit for node 69d4d57d932ecfe2320a25de 2026-04-09 09:59:34,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:59:34,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d57d932ecfe2320a25de HTTP/1.1" 200 None 2026-04-09 09:59:34,379 - lava_callback - DEBUG - Processing node 69d4d57d932ecfe2320a25de: baseline-arm-baylibre 2026-04-09 09:59:34,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d57d932ecfe2320a25de 2026-04-09 09:59:34,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:59:34,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d57d932ecfe2320a25de HTTP/1.1" 200 None 2026-04-09 09:59:34,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:59:34,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 09:59:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 09:59:34,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d57d932ecfe2320a25de HTTP/1.1" 200 None 2026-04-09 09:59:34,426 - lava_callback - ERROR - Error processing callback for node 69d4d57d932ecfe2320a25de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:00:17,214 - lava_callback - INFO - Received callback for node 69d4d5a1932ecfe2320a25fa INFO: 172.21.0.1:32956 - "POST /node/69d4d5a1932ecfe2320a25fa HTTP/1.0" 202 Accepted 2026-04-09 10:00:17,220 - lava_callback - INFO - Starting async job submit for node 69d4d5a1932ecfe2320a25fa 2026-04-09 10:00:17,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:17,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d5a1932ecfe2320a25fa HTTP/1.1" 200 None 2026-04-09 10:00:17,236 - lava_callback - DEBUG - Processing node 69d4d5a1932ecfe2320a25fa: baseline-arm-clabbe 2026-04-09 10:00:17,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d5a1932ecfe2320a25fa 2026-04-09 10:00:17,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:17,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d5a1932ecfe2320a25fa HTTP/1.1" 200 None 2026-04-09 10:00:17,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:17,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:00:17,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d5a1932ecfe2320a25fa HTTP/1.1" 200 None 2026-04-09 10:00:17,473 - lava_callback - ERROR - Error processing callback for node 69d4d5a1932ecfe2320a25fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:00:57,172 - lava_callback - INFO - Received callback for node 69d4d5c4932ecfe2320a2611 INFO: 172.21.0.1:58094 - "POST /node/69d4d5c4932ecfe2320a2611 HTTP/1.0" 202 Accepted 2026-04-09 10:00:57,178 - lava_callback - INFO - Starting async job submit for node 69d4d5c4932ecfe2320a2611 2026-04-09 10:00:57,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:57,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d5c4932ecfe2320a2611 HTTP/1.1" 200 None 2026-04-09 10:00:57,195 - lava_callback - DEBUG - Processing node 69d4d5c4932ecfe2320a2611: baseline-arm-clabbe 2026-04-09 10:00:57,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d5c4932ecfe2320a2611 2026-04-09 10:00:57,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:57,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d5c4932ecfe2320a2611 HTTP/1.1" 200 None 2026-04-09 10:00:57,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:57,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:00:57,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:00:57,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d5c4932ecfe2320a2611 HTTP/1.1" 200 None 2026-04-09 10:00:57,256 - lava_callback - ERROR - Error processing callback for node 69d4d5c4932ecfe2320a2611: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET /node/698af78a3b3beb19e7617375%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40552 - "GET /node/6986fd4c6e077e4126a7d83f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:02:37,277 - lava_callback - INFO - Received callback for node 69d4d62b932ecfe2320a2658 INFO: 172.21.0.1:36706 - "POST /node/69d4d62b932ecfe2320a2658 HTTP/1.0" 202 Accepted 2026-04-09 10:02:37,282 - lava_callback - INFO - Starting async job submit for node 69d4d62b932ecfe2320a2658 2026-04-09 10:02:37,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:02:37,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d62b932ecfe2320a2658 HTTP/1.1" 200 None 2026-04-09 10:02:37,304 - lava_callback - DEBUG - Processing node 69d4d62b932ecfe2320a2658: baseline-arm-clabbe 2026-04-09 10:02:37,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d62b932ecfe2320a2658 2026-04-09 10:02:37,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:02:37,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d62b932ecfe2320a2658 HTTP/1.1" 200 None 2026-04-09 10:02:37,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:02:37,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:02:37,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:02:37,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d62b932ecfe2320a2658 HTTP/1.1" 200 None 2026-04-09 10:02:37,369 - lava_callback - ERROR - Error processing callback for node 69d4d62b932ecfe2320a2658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:04:17,359 - lava_callback - INFO - Received callback for node 69d4d691932ecfe2320a26b6 INFO: 172.21.0.1:41104 - "POST /node/69d4d691932ecfe2320a26b6 HTTP/1.0" 202 Accepted 2026-04-09 10:04:17,368 - lava_callback - INFO - Starting async job submit for node 69d4d691932ecfe2320a26b6 2026-04-09 10:04:17,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:17,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d691932ecfe2320a26b6 HTTP/1.1" 200 None 2026-04-09 10:04:17,384 - lava_callback - DEBUG - Processing node 69d4d691932ecfe2320a26b6: baseline-arm-clabbe 2026-04-09 10:04:17,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d691932ecfe2320a26b6 2026-04-09 10:04:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:17,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d691932ecfe2320a26b6 HTTP/1.1" 200 None 2026-04-09 10:04:17,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:17,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:04:17,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:17,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d691932ecfe2320a26b6 HTTP/1.1" 200 None 2026-04-09 10:04:17,441 - lava_callback - ERROR - Error processing callback for node 69d4d691932ecfe2320a26b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:04:57,334 - lava_callback - INFO - Received callback for node 69d4d6b3932ecfe2320a26da INFO: 172.21.0.1:33148 - "POST /node/69d4d6b3932ecfe2320a26da HTTP/1.0" 202 Accepted 2026-04-09 10:04:57,340 - lava_callback - INFO - Starting async job submit for node 69d4d6b3932ecfe2320a26da 2026-04-09 10:04:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:57,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6b3932ecfe2320a26da HTTP/1.1" 200 None 2026-04-09 10:04:57,361 - lava_callback - DEBUG - Processing node 69d4d6b3932ecfe2320a26da: baseline-arm-clabbe 2026-04-09 10:04:57,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d6b3932ecfe2320a26da 2026-04-09 10:04:57,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:57,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6b3932ecfe2320a26da HTTP/1.1" 200 None 2026-04-09 10:04:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:57,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:04:57,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:04:57,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d6b3932ecfe2320a26da HTTP/1.1" 200 None 2026-04-09 10:04:57,420 - lava_callback - ERROR - Error processing callback for node 69d4d6b3932ecfe2320a26da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:05:17,377 - lava_callback - INFO - Received callback for node 69d4d6d6932ecfe2320a26e7 INFO: 172.21.0.1:52632 - "POST /node/69d4d6d6932ecfe2320a26e7 HTTP/1.0" 202 Accepted 2026-04-09 10:05:17,383 - lava_callback - INFO - Starting async job submit for node 69d4d6d6932ecfe2320a26e7 2026-04-09 10:05:17,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:05:17,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6d6932ecfe2320a26e7 HTTP/1.1" 200 None 2026-04-09 10:05:17,398 - lava_callback - DEBUG - Processing node 69d4d6d6932ecfe2320a26e7: baseline-arm-clabbe 2026-04-09 10:05:17,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d6d6932ecfe2320a26e7 2026-04-09 10:05:17,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:05:17,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d6d6932ecfe2320a26e7 HTTP/1.1" 200 None 2026-04-09 10:05:17,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:05:17,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:05:17,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:05:17,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d6d6932ecfe2320a26e7 HTTP/1.1" 200 None 2026-04-09 10:05:17,446 - lava_callback - ERROR - Error processing callback for node 69d4d6d6932ecfe2320a26e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /node/694a58af83c67c43d1ed9d60%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32896 - "GET /node/693f80460d8ce4018da965f0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:08:17,513 - lava_callback - INFO - Received callback for node 69d4d780932ecfe2320a2787 INFO: 172.21.0.1:44032 - "POST /node/69d4d780932ecfe2320a2787 HTTP/1.0" 202 Accepted 2026-04-09 10:08:17,520 - lava_callback - INFO - Starting async job submit for node 69d4d780932ecfe2320a2787 2026-04-09 10:08:17,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:08:17,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d780932ecfe2320a2787 HTTP/1.1" 200 None 2026-04-09 10:08:17,544 - lava_callback - DEBUG - Processing node 69d4d780932ecfe2320a2787: baseline-arm-clabbe 2026-04-09 10:08:17,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d780932ecfe2320a2787 2026-04-09 10:08:17,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:08:17,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d780932ecfe2320a2787 HTTP/1.1" 200 None 2026-04-09 10:08:17,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:08:17,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 10:08:17,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:08:17,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d780932ecfe2320a2787 HTTP/1.1" 200 None 2026-04-09 10:08:17,599 - lava_callback - ERROR - Error processing callback for node 69d4d780932ecfe2320a2787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET /node/6992db5631166481c8dd4a82%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44392 - "GET /node/694777484917c2d89a1ed4bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET /node/69aa92e676ddd5d9e606d852%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 10:15:15,306 - lava_callback - INFO - Received callback for node 69d4d92c932ecfe2320a2868 INFO: 172.21.0.1:56654 - "POST /node/69d4d92c932ecfe2320a2868 HTTP/1.0" 202 Accepted 2026-04-09 10:15:15,312 - lava_callback - INFO - Starting async job submit for node 69d4d92c932ecfe2320a2868 2026-04-09 10:15:15,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:15:15,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d92c932ecfe2320a2868 HTTP/1.1" 200 None 2026-04-09 10:15:15,329 - lava_callback - DEBUG - Processing node 69d4d92c932ecfe2320a2868: baseline-arm64-baylibre 2026-04-09 10:15:15,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d92c932ecfe2320a2868 2026-04-09 10:15:15,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:15:15,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d92c932ecfe2320a2868 HTTP/1.1" 200 None 2026-04-09 10:15:15,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:15:15,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:15:15,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:15:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d92c932ecfe2320a2868 HTTP/1.1" 200 None 2026-04-09 10:15:15,387 - lava_callback - ERROR - Error processing callback for node 69d4d92c932ecfe2320a2868: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:17:35,358 - lava_callback - INFO - Received callback for node 69d4d9bb932ecfe2320a28d6 INFO: 172.21.0.1:56546 - "POST /node/69d4d9bb932ecfe2320a28d6 HTTP/1.0" 202 Accepted 2026-04-09 10:17:35,364 - lava_callback - INFO - Starting async job submit for node 69d4d9bb932ecfe2320a28d6 2026-04-09 10:17:35,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:17:35,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d9bb932ecfe2320a28d6 HTTP/1.1" 200 None 2026-04-09 10:17:35,381 - lava_callback - DEBUG - Processing node 69d4d9bb932ecfe2320a28d6: baseline-arm64-baylibre 2026-04-09 10:17:35,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4d9bb932ecfe2320a28d6 2026-04-09 10:17:35,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:17:35,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4d9bb932ecfe2320a28d6 HTTP/1.1" 200 None 2026-04-09 10:17:35,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:17:35,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:17:35,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:17:35,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4d9bb932ecfe2320a28d6 HTTP/1.1" 200 None 2026-04-09 10:17:35,432 - lava_callback - ERROR - Error processing callback for node 69d4d9bb932ecfe2320a28d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:18:55,402 - lava_callback - INFO - Received callback for node 69d4da01932ecfe2320a2903 INFO: 172.21.0.1:52644 - "POST /node/69d4da01932ecfe2320a2903 HTTP/1.0" 202 Accepted 2026-04-09 10:18:55,410 - lava_callback - INFO - Starting async job submit for node 69d4da01932ecfe2320a2903 2026-04-09 10:18:55,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:18:55,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4da01932ecfe2320a2903 HTTP/1.1" 200 None 2026-04-09 10:18:55,425 - lava_callback - DEBUG - Processing node 69d4da01932ecfe2320a2903: baseline-arm64-baylibre 2026-04-09 10:18:55,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4da01932ecfe2320a2903 2026-04-09 10:18:55,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:18:55,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4da01932ecfe2320a2903 HTTP/1.1" 200 None 2026-04-09 10:18:55,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:18:55,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:18:55,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:18:55,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4da01932ecfe2320a2903 HTTP/1.1" 200 None 2026-04-09 10:18:55,472 - lava_callback - ERROR - Error processing callback for node 69d4da01932ecfe2320a2903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:20:55,937 - lava_callback - INFO - Received callback for node 69d4da85932ecfe2320a2969 INFO: 172.21.0.1:54120 - "POST /node/69d4da85932ecfe2320a2969 HTTP/1.0" 202 Accepted 2026-04-09 10:20:55,942 - lava_callback - INFO - Starting async job submit for node 69d4da85932ecfe2320a2969 2026-04-09 10:20:55,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:20:55,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4da85932ecfe2320a2969 HTTP/1.1" 200 None 2026-04-09 10:20:55,958 - lava_callback - DEBUG - Processing node 69d4da85932ecfe2320a2969: baseline-arm64-baylibre 2026-04-09 10:20:55,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4da85932ecfe2320a2969 2026-04-09 10:20:55,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:20:55,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4da85932ecfe2320a2969 HTTP/1.1" 200 None 2026-04-09 10:20:55,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:20:55,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:20:55,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:20:56,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4da85932ecfe2320a2969 HTTP/1.1" 200 None 2026-04-09 10:20:56,007 - lava_callback - ERROR - Error processing callback for node 69d4da85932ecfe2320a2969: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 10:22:15,675 - lava_callback - INFO - Received callback for node 69d4dac5932ecfe2320a29b4 INFO: 172.21.0.1:54340 - "POST /node/69d4dac5932ecfe2320a29b4 HTTP/1.0" 202 Accepted 2026-04-09 10:22:15,681 - lava_callback - INFO - Starting async job submit for node 69d4dac5932ecfe2320a29b4 2026-04-09 10:22:15,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:22:15,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dac5932ecfe2320a29b4 HTTP/1.1" 200 None 2026-04-09 10:22:15,702 - lava_callback - DEBUG - Processing node 69d4dac5932ecfe2320a29b4: baseline-arm64-baylibre 2026-04-09 10:22:15,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dac5932ecfe2320a29b4 2026-04-09 10:22:15,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:22:15,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dac5932ecfe2320a29b4 HTTP/1.1" 200 None 2026-04-09 10:22:15,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:22:15,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:22:15,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:22:15,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dac5932ecfe2320a29b4 HTTP/1.1" 200 None 2026-04-09 10:22:15,755 - lava_callback - ERROR - Error processing callback for node 69d4dac5932ecfe2320a29b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:24:38,207 - lava_callback - INFO - Received callback for node 69d4db52932ecfe2320a2a35 INFO: 172.21.0.1:48410 - "POST /node/69d4db52932ecfe2320a2a35 HTTP/1.0" 202 Accepted 2026-04-09 10:24:38,213 - lava_callback - INFO - Starting async job submit for node 69d4db52932ecfe2320a2a35 2026-04-09 10:24:38,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:24:38,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4db52932ecfe2320a2a35 HTTP/1.1" 200 None 2026-04-09 10:24:38,230 - lava_callback - DEBUG - Processing node 69d4db52932ecfe2320a2a35: baseline-arm64-clabbe 2026-04-09 10:24:38,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4db52932ecfe2320a2a35 2026-04-09 10:24:38,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:24:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4db52932ecfe2320a2a35 HTTP/1.1" 200 None 2026-04-09 10:24:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:24:38,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:24:38,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:24:38,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4db52932ecfe2320a2a35 HTTP/1.1" 200 None 2026-04-09 10:24:38,279 - lava_callback - ERROR - Error processing callback for node 69d4db52932ecfe2320a2a35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:27:58,563 - lava_callback - INFO - Received callback for node 69d4dc20932ecfe2320a2ae2 INFO: 172.21.0.1:46896 - "POST /node/69d4dc20932ecfe2320a2ae2 HTTP/1.0" 202 Accepted 2026-04-09 10:27:58,568 - lava_callback - INFO - Starting async job submit for node 69d4dc20932ecfe2320a2ae2 2026-04-09 10:27:58,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:27:58,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dc20932ecfe2320a2ae2 HTTP/1.1" 200 None 2026-04-09 10:27:58,584 - lava_callback - DEBUG - Processing node 69d4dc20932ecfe2320a2ae2: baseline-arm64-clabbe 2026-04-09 10:27:58,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dc20932ecfe2320a2ae2 2026-04-09 10:27:58,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:27:58,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dc20932ecfe2320a2ae2 HTTP/1.1" 200 None 2026-04-09 10:27:58,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:27:58,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:27:58,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:27:58,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dc20932ecfe2320a2ae2 HTTP/1.1" 200 None 2026-04-09 10:27:58,669 - lava_callback - ERROR - Error processing callback for node 69d4dc20932ecfe2320a2ae2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:30:18,409 - lava_callback - INFO - Received callback for node 69d4dcb1932ecfe2320a2b18 INFO: 172.21.0.1:45174 - "POST /node/69d4dcb1932ecfe2320a2b18 HTTP/1.0" 202 Accepted 2026-04-09 10:30:18,415 - lava_callback - INFO - Starting async job submit for node 69d4dcb1932ecfe2320a2b18 2026-04-09 10:30:18,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:30:18,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dcb1932ecfe2320a2b18 HTTP/1.1" 200 None 2026-04-09 10:30:18,440 - lava_callback - DEBUG - Processing node 69d4dcb1932ecfe2320a2b18: baseline-arm64-clabbe 2026-04-09 10:30:18,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dcb1932ecfe2320a2b18 2026-04-09 10:30:18,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:30:18,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dcb1932ecfe2320a2b18 HTTP/1.1" 200 None 2026-04-09 10:30:18,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:30:18,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:30:18,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:30:18,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dcb1932ecfe2320a2b18 HTTP/1.1" 200 None 2026-04-09 10:30:18,494 - lava_callback - ERROR - Error processing callback for node 69d4dcb1932ecfe2320a2b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:31:38,532 - lava_callback - INFO - Received callback for node 69d4dcfb932ecfe2320a2b21 INFO: 172.21.0.1:40188 - "POST /node/69d4dcfb932ecfe2320a2b21 HTTP/1.0" 202 Accepted 2026-04-09 10:31:38,538 - lava_callback - INFO - Starting async job submit for node 69d4dcfb932ecfe2320a2b21 2026-04-09 10:31:38,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:31:38,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dcfb932ecfe2320a2b21 HTTP/1.1" 200 None 2026-04-09 10:31:38,554 - lava_callback - DEBUG - Processing node 69d4dcfb932ecfe2320a2b21: baseline-arm64-clabbe 2026-04-09 10:31:38,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dcfb932ecfe2320a2b21 2026-04-09 10:31:38,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:31:38,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dcfb932ecfe2320a2b21 HTTP/1.1" 200 None 2026-04-09 10:31:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:31:38,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:31:38,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:31:38,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dcfb932ecfe2320a2b21 HTTP/1.1" 200 None 2026-04-09 10:31:38,602 - lava_callback - ERROR - Error processing callback for node 69d4dcfb932ecfe2320a2b21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:32:38,608 - lava_callback - INFO - Received callback for node 69d4dd43932ecfe2320a2b56 INFO: 172.21.0.1:38354 - "POST /node/69d4dd43932ecfe2320a2b56 HTTP/1.0" 202 Accepted 2026-04-09 10:32:38,614 - lava_callback - INFO - Starting async job submit for node 69d4dd43932ecfe2320a2b56 2026-04-09 10:32:38,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:32:38,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dd43932ecfe2320a2b56 HTTP/1.1" 200 None 2026-04-09 10:32:38,630 - lava_callback - DEBUG - Processing node 69d4dd43932ecfe2320a2b56: baseline-arm64-clabbe 2026-04-09 10:32:38,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dd43932ecfe2320a2b56 2026-04-09 10:32:38,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:32:38,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dd43932ecfe2320a2b56 HTTP/1.1" 200 None 2026-04-09 10:32:38,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:32:38,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:32:38,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:32:38,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dd43932ecfe2320a2b56 HTTP/1.1" 200 None 2026-04-09 10:32:38,684 - lava_callback - ERROR - Error processing callback for node 69d4dd43932ecfe2320a2b56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK 2026-04-09 10:33:58,638 - lava_callback - INFO - Received callback for node 69d4dd8b932ecfe2320a2b7e INFO: 172.21.0.1:49898 - "POST /node/69d4dd8b932ecfe2320a2b7e HTTP/1.0" 202 Accepted 2026-04-09 10:33:58,643 - lava_callback - INFO - Starting async job submit for node 69d4dd8b932ecfe2320a2b7e 2026-04-09 10:33:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:33:58,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dd8b932ecfe2320a2b7e HTTP/1.1" 200 None 2026-04-09 10:33:58,659 - lava_callback - DEBUG - Processing node 69d4dd8b932ecfe2320a2b7e: baseline-arm64-clabbe 2026-04-09 10:33:58,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4dd8b932ecfe2320a2b7e 2026-04-09 10:33:58,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:33:58,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4dd8b932ecfe2320a2b7e HTTP/1.1" 200 None 2026-04-09 10:33:58,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:33:58,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-09 10:33:58,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 10:33:58,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4dd8b932ecfe2320a2b7e HTTP/1.1" 200 None 2026-04-09 10:33:58,710 - lava_callback - ERROR - Error processing callback for node 69d4dd8b932ecfe2320a2b7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET /node/6993602ccebe99dd8e063138%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET /node/698f5cd93013abef95cf8c0b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET /node/69934ed3523507f3806a63e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET /node/6983ed36969566dcb0d29a6e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51276 - "GET /node/695376f931522df6df79e196%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET /node/698bd7741e517752bab8b4bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET /node/685c280b900e844fd2ff7466%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49582 - "GET /node/6986fa876e077e4126a7d33a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET /node/69be6f3e448e074b3ffe2505%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /node/6984eb8e3ff18e47df613aca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET /node/693f04ce24745582e3997706%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET /node/69877369e31b58f834f1a994%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET /node/694bd7b6c19e09af58d4941e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:39:03,284 - lava_callback - INFO - Received callback for node 69d4fad1932ecfe2320a2de7 INFO: 172.21.0.1:58660 - "POST /node/69d4fad1932ecfe2320a2de7 HTTP/1.0" 202 Accepted 2026-04-09 12:39:03,290 - lava_callback - INFO - Starting async job submit for node 69d4fad1932ecfe2320a2de7 2026-04-09 12:39:03,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:39:03,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fad1932ecfe2320a2de7 HTTP/1.1" 200 None 2026-04-09 12:39:03,305 - lava_callback - DEBUG - Processing node 69d4fad1932ecfe2320a2de7: baseline-arm-baylibre 2026-04-09 12:39:03,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fad1932ecfe2320a2de7 2026-04-09 12:39:03,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:39:03,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fad1932ecfe2320a2de7 HTTP/1.1" 200 None 2026-04-09 12:39:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:39:03,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:39:03,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:39:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fad1932ecfe2320a2de7 HTTP/1.1" 200 None 2026-04-09 12:39:03,356 - lava_callback - ERROR - Error processing callback for node 69d4fad1932ecfe2320a2de7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:40:03,193 - lava_callback - INFO - Received callback for node 69d4fb1f932ecfe2320a2e06 INFO: 172.21.0.1:53504 - "POST /node/69d4fb1f932ecfe2320a2e06 HTTP/1.0" 202 Accepted 2026-04-09 12:40:03,198 - lava_callback - INFO - Starting async job submit for node 69d4fb1f932ecfe2320a2e06 2026-04-09 12:40:03,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:03,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb1f932ecfe2320a2e06 HTTP/1.1" 200 None 2026-04-09 12:40:03,214 - lava_callback - DEBUG - Processing node 69d4fb1f932ecfe2320a2e06: baseline-arm-baylibre 2026-04-09 12:40:03,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fb1f932ecfe2320a2e06 2026-04-09 12:40:03,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:03,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb1f932ecfe2320a2e06 HTTP/1.1" 200 None 2026-04-09 12:40:03,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:03,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:40:03,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:03,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fb1f932ecfe2320a2e06 HTTP/1.1" 200 None 2026-04-09 12:40:03,263 - lava_callback - ERROR - Error processing callback for node 69d4fb1f932ecfe2320a2e06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:40:43,292 - lava_callback - INFO - Received callback for node 69d4fb46932ecfe2320a2e37 INFO: 172.21.0.1:46892 - "POST /node/69d4fb46932ecfe2320a2e37 HTTP/1.0" 202 Accepted 2026-04-09 12:40:43,297 - lava_callback - INFO - Starting async job submit for node 69d4fb46932ecfe2320a2e37 2026-04-09 12:40:43,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:43,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb46932ecfe2320a2e37 HTTP/1.1" 200 None 2026-04-09 12:40:43,313 - lava_callback - DEBUG - Processing node 69d4fb46932ecfe2320a2e37: baseline-arm-baylibre 2026-04-09 12:40:43,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fb46932ecfe2320a2e37 2026-04-09 12:40:43,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:43,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb46932ecfe2320a2e37 HTTP/1.1" 200 None 2026-04-09 12:40:43,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:43,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:40:43,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:40:43,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fb46932ecfe2320a2e37 HTTP/1.1" 200 None 2026-04-09 12:40:43,370 - lava_callback - ERROR - Error processing callback for node 69d4fb46932ecfe2320a2e37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:41:23,263 - lava_callback - INFO - Received callback for node 69d4fb68932ecfe2320a2e61 INFO: 172.21.0.1:39356 - "POST /node/69d4fb68932ecfe2320a2e61 HTTP/1.0" 202 Accepted 2026-04-09 12:41:23,269 - lava_callback - INFO - Starting async job submit for node 69d4fb68932ecfe2320a2e61 2026-04-09 12:41:23,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:41:23,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb68932ecfe2320a2e61 HTTP/1.1" 200 None 2026-04-09 12:41:23,285 - lava_callback - DEBUG - Processing node 69d4fb68932ecfe2320a2e61: baseline-arm-baylibre 2026-04-09 12:41:23,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fb68932ecfe2320a2e61 2026-04-09 12:41:23,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:41:23,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb68932ecfe2320a2e61 HTTP/1.1" 200 None 2026-04-09 12:41:23,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:41:23,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:41:23,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:41:23,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fb68932ecfe2320a2e61 HTTP/1.1" 200 None 2026-04-09 12:41:23,336 - lava_callback - ERROR - Error processing callback for node 69d4fb68932ecfe2320a2e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:42:03,404 - lava_callback - INFO - Received callback for node 69d4fb8d932ecfe2320a2e79 INFO: 172.21.0.1:49976 - "POST /node/69d4fb8d932ecfe2320a2e79 HTTP/1.0" 202 Accepted 2026-04-09 12:42:03,410 - lava_callback - INFO - Starting async job submit for node 69d4fb8d932ecfe2320a2e79 2026-04-09 12:42:03,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:42:03,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb8d932ecfe2320a2e79 HTTP/1.1" 200 None 2026-04-09 12:42:03,439 - lava_callback - DEBUG - Processing node 69d4fb8d932ecfe2320a2e79: baseline-arm-baylibre 2026-04-09 12:42:03,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fb8d932ecfe2320a2e79 2026-04-09 12:42:03,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:42:03,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fb8d932ecfe2320a2e79 HTTP/1.1" 200 None 2026-04-09 12:42:03,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:42:03,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:42:03,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:42:03,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fb8d932ecfe2320a2e79 HTTP/1.1" 200 None 2026-04-09 12:42:03,487 - lava_callback - ERROR - Error processing callback for node 69d4fb8d932ecfe2320a2e79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:43:44,379 - lava_callback - INFO - Received callback for node 69d4fbfa932ecfe2320a2eef INFO: 172.21.0.1:48470 - "POST /node/69d4fbfa932ecfe2320a2eef HTTP/1.0" 202 Accepted 2026-04-09 12:43:44,385 - lava_callback - INFO - Starting async job submit for node 69d4fbfa932ecfe2320a2eef 2026-04-09 12:43:44,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:43:44,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fbfa932ecfe2320a2eef HTTP/1.1" 200 None 2026-04-09 12:43:44,405 - lava_callback - DEBUG - Processing node 69d4fbfa932ecfe2320a2eef: baseline-arm-clabbe 2026-04-09 12:43:44,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fbfa932ecfe2320a2eef 2026-04-09 12:43:44,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:43:44,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fbfa932ecfe2320a2eef HTTP/1.1" 200 None 2026-04-09 12:43:44,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:43:44,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:43:44,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:43:44,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fbfa932ecfe2320a2eef HTTP/1.1" 200 None 2026-04-09 12:43:44,458 - lava_callback - ERROR - Error processing callback for node 69d4fbfa932ecfe2320a2eef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:44:24,316 - lava_callback - INFO - Received callback for node 69d4fc1f932ecfe2320a2f0a INFO: 172.21.0.1:39654 - "POST /node/69d4fc1f932ecfe2320a2f0a HTTP/1.0" 202 Accepted 2026-04-09 12:44:24,321 - lava_callback - INFO - Starting async job submit for node 69d4fc1f932ecfe2320a2f0a 2026-04-09 12:44:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:44:24,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc1f932ecfe2320a2f0a HTTP/1.1" 200 None 2026-04-09 12:44:24,337 - lava_callback - DEBUG - Processing node 69d4fc1f932ecfe2320a2f0a: baseline-arm-clabbe 2026-04-09 12:44:24,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fc1f932ecfe2320a2f0a 2026-04-09 12:44:24,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:44:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc1f932ecfe2320a2f0a HTTP/1.1" 200 None 2026-04-09 12:44:24,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:44:24,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:44:24,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:44:24,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fc1f932ecfe2320a2f0a HTTP/1.1" 200 None 2026-04-09 12:44:24,397 - lava_callback - ERROR - Error processing callback for node 69d4fc1f932ecfe2320a2f0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:45:04,324 - lava_callback - INFO - Received callback for node 69d4fc44932ecfe2320a2f24 INFO: 172.21.0.1:47652 - "POST /node/69d4fc44932ecfe2320a2f24 HTTP/1.0" 202 Accepted 2026-04-09 12:45:04,329 - lava_callback - INFO - Starting async job submit for node 69d4fc44932ecfe2320a2f24 2026-04-09 12:45:04,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:04,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc44932ecfe2320a2f24 HTTP/1.1" 200 None 2026-04-09 12:45:04,353 - lava_callback - DEBUG - Processing node 69d4fc44932ecfe2320a2f24: baseline-arm-clabbe 2026-04-09 12:45:04,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fc44932ecfe2320a2f24 2026-04-09 12:45:04,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:04,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc44932ecfe2320a2f24 HTTP/1.1" 200 None 2026-04-09 12:45:04,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:04,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:45:04,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:04,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fc44932ecfe2320a2f24 HTTP/1.1" 200 None 2026-04-09 12:45:04,410 - lava_callback - ERROR - Error processing callback for node 69d4fc44932ecfe2320a2f24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:45:44,369 - lava_callback - INFO - Received callback for node 69d4fc69932ecfe2320a2f45 INFO: 172.21.0.1:36846 - "POST /node/69d4fc69932ecfe2320a2f45 HTTP/1.0" 202 Accepted 2026-04-09 12:45:44,374 - lava_callback - INFO - Starting async job submit for node 69d4fc69932ecfe2320a2f45 2026-04-09 12:45:44,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:44,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc69932ecfe2320a2f45 HTTP/1.1" 200 None 2026-04-09 12:45:44,393 - lava_callback - DEBUG - Processing node 69d4fc69932ecfe2320a2f45: baseline-arm-clabbe 2026-04-09 12:45:44,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fc69932ecfe2320a2f45 2026-04-09 12:45:44,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:44,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc69932ecfe2320a2f45 HTTP/1.1" 200 None 2026-04-09 12:45:44,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:44,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:45:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:45:44,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fc69932ecfe2320a2f45 HTTP/1.1" 200 None 2026-04-09 12:45:44,452 - lava_callback - ERROR - Error processing callback for node 69d4fc69932ecfe2320a2f45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:46:24,439 - lava_callback - INFO - Received callback for node 69d4fc8d932ecfe2320a2f7f INFO: 172.21.0.1:51154 - "POST /node/69d4fc8d932ecfe2320a2f7f HTTP/1.0" 202 Accepted 2026-04-09 12:46:24,445 - lava_callback - INFO - Starting async job submit for node 69d4fc8d932ecfe2320a2f7f 2026-04-09 12:46:24,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:46:24,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc8d932ecfe2320a2f7f HTTP/1.1" 200 None 2026-04-09 12:46:24,477 - lava_callback - DEBUG - Processing node 69d4fc8d932ecfe2320a2f7f: baseline-arm-clabbe 2026-04-09 12:46:24,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fc8d932ecfe2320a2f7f 2026-04-09 12:46:24,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:46:24,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fc8d932ecfe2320a2f7f HTTP/1.1" 200 None 2026-04-09 12:46:24,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:46:24,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:46:24,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:46:24,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fc8d932ecfe2320a2f7f HTTP/1.1" 200 None 2026-04-09 12:46:24,547 - lava_callback - ERROR - Error processing callback for node 69d4fc8d932ecfe2320a2f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:47:04,371 - lava_callback - INFO - Received callback for node 69d4fcb4932ecfe2320a2f92 INFO: 172.21.0.1:56480 - "POST /node/69d4fcb4932ecfe2320a2f92 HTTP/1.0" 202 Accepted 2026-04-09 12:47:04,376 - lava_callback - INFO - Starting async job submit for node 69d4fcb4932ecfe2320a2f92 2026-04-09 12:47:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:04,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcb4932ecfe2320a2f92 HTTP/1.1" 200 None 2026-04-09 12:47:04,397 - lava_callback - DEBUG - Processing node 69d4fcb4932ecfe2320a2f92: baseline-arm-clabbe 2026-04-09 12:47:04,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fcb4932ecfe2320a2f92 2026-04-09 12:47:04,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcb4932ecfe2320a2f92 HTTP/1.1" 200 None 2026-04-09 12:47:04,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:04,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:47:04,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:04,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fcb4932ecfe2320a2f92 HTTP/1.1" 200 None 2026-04-09 12:47:04,453 - lava_callback - ERROR - Error processing callback for node 69d4fcb4932ecfe2320a2f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:47:44,478 - lava_callback - INFO - Received callback for node 69d4fcdc932ecfe2320a2fa4 INFO: 172.21.0.1:41468 - "POST /node/69d4fcdc932ecfe2320a2fa4 HTTP/1.0" 202 Accepted 2026-04-09 12:47:44,484 - lava_callback - INFO - Starting async job submit for node 69d4fcdc932ecfe2320a2fa4 2026-04-09 12:47:44,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:44,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcdc932ecfe2320a2fa4 HTTP/1.1" 200 None 2026-04-09 12:47:44,504 - lava_callback - DEBUG - Processing node 69d4fcdc932ecfe2320a2fa4: baseline-arm-clabbe 2026-04-09 12:47:44,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fcdc932ecfe2320a2fa4 2026-04-09 12:47:44,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:44,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcdc932ecfe2320a2fa4 HTTP/1.1" 200 None 2026-04-09 12:47:44,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:44,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:47:44,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:47:44,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fcdc932ecfe2320a2fa4 HTTP/1.1" 200 None 2026-04-09 12:47:44,554 - lava_callback - ERROR - Error processing callback for node 69d4fcdc932ecfe2320a2fa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39016 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:48:03,714 - lava_callback - INFO - Received callback for node 69d4fcfb932ecfe2320a2fb8 INFO: 172.21.0.1:50620 - "POST /node/69d4fcfb932ecfe2320a2fb8 HTTP/1.0" 202 Accepted 2026-04-09 12:48:03,719 - lava_callback - INFO - Starting async job submit for node 69d4fcfb932ecfe2320a2fb8 2026-04-09 12:48:03,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcfb932ecfe2320a2fb8 HTTP/1.1" 200 None 2026-04-09 12:48:03,750 - lava_callback - DEBUG - Processing node 69d4fcfb932ecfe2320a2fb8: baseline-arm-baylibre 2026-04-09 12:48:03,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fcfb932ecfe2320a2fb8 2026-04-09 12:48:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:03,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fcfb932ecfe2320a2fb8 HTTP/1.1" 200 None 2026-04-09 12:48:03,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:03,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:48:03,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:03,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fcfb932ecfe2320a2fb8 HTTP/1.1" 200 None 2026-04-09 12:48:03,802 - lava_callback - ERROR - Error processing callback for node 69d4fcfb932ecfe2320a2fb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:48:44,509 - lava_callback - INFO - Received callback for node 69d4fd21932ecfe2320a2fff INFO: 172.21.0.1:33032 - "POST /node/69d4fd21932ecfe2320a2fff HTTP/1.0" 202 Accepted 2026-04-09 12:48:44,514 - lava_callback - INFO - Starting async job submit for node 69d4fd21932ecfe2320a2fff 2026-04-09 12:48:44,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:44,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd21932ecfe2320a2fff HTTP/1.1" 200 None 2026-04-09 12:48:44,530 - lava_callback - DEBUG - Processing node 69d4fd21932ecfe2320a2fff: baseline-arm-clabbe 2026-04-09 12:48:44,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fd21932ecfe2320a2fff 2026-04-09 12:48:44,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:44,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd21932ecfe2320a2fff HTTP/1.1" 200 None 2026-04-09 12:48:44,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:44,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:48:44,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:48:44,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fd21932ecfe2320a2fff HTTP/1.1" 200 None 2026-04-09 12:48:44,582 - lava_callback - ERROR - Error processing callback for node 69d4fd21932ecfe2320a2fff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:49:24,473 - lava_callback - INFO - Received callback for node 69d4fd4a932ecfe2320a300b INFO: 172.21.0.1:42278 - "POST /node/69d4fd4a932ecfe2320a300b HTTP/1.0" 202 Accepted 2026-04-09 12:49:24,482 - lava_callback - INFO - Starting async job submit for node 69d4fd4a932ecfe2320a300b 2026-04-09 12:49:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:49:24,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd4a932ecfe2320a300b HTTP/1.1" 200 None 2026-04-09 12:49:24,499 - lava_callback - DEBUG - Processing node 69d4fd4a932ecfe2320a300b: baseline-arm-clabbe 2026-04-09 12:49:24,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fd4a932ecfe2320a300b 2026-04-09 12:49:24,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:49:24,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd4a932ecfe2320a300b HTTP/1.1" 200 None 2026-04-09 12:49:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:49:24,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-09 12:49:24,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:49:24,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fd4a932ecfe2320a300b HTTP/1.1" 200 None 2026-04-09 12:49:24,554 - lava_callback - ERROR - Error processing callback for node 69d4fd4a932ecfe2320a300b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:50:03,834 - lava_callback - INFO - Received callback for node 69d4fd6d932ecfe2320a301b INFO: 172.21.0.1:53920 - "POST /node/69d4fd6d932ecfe2320a301b HTTP/1.0" 202 Accepted 2026-04-09 12:50:03,843 - lava_callback - INFO - Starting async job submit for node 69d4fd6d932ecfe2320a301b 2026-04-09 12:50:03,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:03,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd6d932ecfe2320a301b HTTP/1.1" 200 None 2026-04-09 12:50:03,866 - lava_callback - DEBUG - Processing node 69d4fd6d932ecfe2320a301b: baseline-arm-baylibre 2026-04-09 12:50:03,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fd6d932ecfe2320a301b 2026-04-09 12:50:03,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:03,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd6d932ecfe2320a301b HTTP/1.1" 200 None 2026-04-09 12:50:03,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:03,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:50:03,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fd6d932ecfe2320a301b HTTP/1.1" 200 None 2026-04-09 12:50:03,926 - lava_callback - ERROR - Error processing callback for node 69d4fd6d932ecfe2320a301b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:50:43,767 - lava_callback - INFO - Received callback for node 69d4fd92932ecfe2320a302f INFO: 172.21.0.1:42708 - "POST /node/69d4fd92932ecfe2320a302f HTTP/1.0" 202 Accepted 2026-04-09 12:50:43,773 - lava_callback - INFO - Starting async job submit for node 69d4fd92932ecfe2320a302f 2026-04-09 12:50:43,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:43,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd92932ecfe2320a302f HTTP/1.1" 200 None 2026-04-09 12:50:43,793 - lava_callback - DEBUG - Processing node 69d4fd92932ecfe2320a302f: baseline-arm-baylibre 2026-04-09 12:50:43,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fd92932ecfe2320a302f 2026-04-09 12:50:43,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:43,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fd92932ecfe2320a302f HTTP/1.1" 200 None 2026-04-09 12:50:43,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:43,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:50:43,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:50:43,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fd92932ecfe2320a302f HTTP/1.1" 200 None 2026-04-09 12:50:43,843 - lava_callback - ERROR - Error processing callback for node 69d4fd92932ecfe2320a302f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:52:23,915 - lava_callback - INFO - Received callback for node 69d4fdfa932ecfe2320a3067 INFO: 172.21.0.1:60338 - "POST /node/69d4fdfa932ecfe2320a3067 HTTP/1.0" 202 Accepted 2026-04-09 12:52:23,920 - lava_callback - INFO - Starting async job submit for node 69d4fdfa932ecfe2320a3067 2026-04-09 12:52:23,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:52:23,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fdfa932ecfe2320a3067 HTTP/1.1" 200 None 2026-04-09 12:52:23,936 - lava_callback - DEBUG - Processing node 69d4fdfa932ecfe2320a3067: baseline-arm-baylibre 2026-04-09 12:52:23,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fdfa932ecfe2320a3067 2026-04-09 12:52:23,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:52:23,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fdfa932ecfe2320a3067 HTTP/1.1" 200 None 2026-04-09 12:52:23,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:52:23,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:52:23,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:52:23,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fdfa932ecfe2320a3067 HTTP/1.1" 200 None 2026-04-09 12:52:23,998 - lava_callback - ERROR - Error processing callback for node 69d4fdfa932ecfe2320a3067: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:53:03,869 - lava_callback - INFO - Received callback for node 69d4fe1f932ecfe2320a308a INFO: 172.21.0.1:44718 - "POST /node/69d4fe1f932ecfe2320a308a HTTP/1.0" 202 Accepted 2026-04-09 12:53:03,875 - lava_callback - INFO - Starting async job submit for node 69d4fe1f932ecfe2320a308a 2026-04-09 12:53:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:03,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe1f932ecfe2320a308a HTTP/1.1" 200 None 2026-04-09 12:53:03,891 - lava_callback - DEBUG - Processing node 69d4fe1f932ecfe2320a308a: baseline-arm-baylibre 2026-04-09 12:53:03,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fe1f932ecfe2320a308a 2026-04-09 12:53:03,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:03,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe1f932ecfe2320a308a HTTP/1.1" 200 None 2026-04-09 12:53:03,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:03,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:53:03,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:03,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fe1f932ecfe2320a308a HTTP/1.1" 200 None 2026-04-09 12:53:03,938 - lava_callback - ERROR - Error processing callback for node 69d4fe1f932ecfe2320a308a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:53:23,916 - lava_callback - INFO - Received callback for node 69d4fe3f932ecfe2320a30ad INFO: 172.21.0.1:60886 - "POST /node/69d4fe3f932ecfe2320a30ad HTTP/1.0" 202 Accepted 2026-04-09 12:53:23,922 - lava_callback - INFO - Starting async job submit for node 69d4fe3f932ecfe2320a30ad 2026-04-09 12:53:23,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:23,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe3f932ecfe2320a30ad HTTP/1.1" 200 None 2026-04-09 12:53:23,938 - lava_callback - DEBUG - Processing node 69d4fe3f932ecfe2320a30ad: baseline-arm-baylibre 2026-04-09 12:53:23,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fe3f932ecfe2320a30ad 2026-04-09 12:53:23,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:23,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe3f932ecfe2320a30ad HTTP/1.1" 200 None 2026-04-09 12:53:23,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:23,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:53:23,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:53:23,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fe3f932ecfe2320a30ad HTTP/1.1" 200 None 2026-04-09 12:53:23,995 - lava_callback - ERROR - Error processing callback for node 69d4fe3f932ecfe2320a30ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:54:04,033 - lava_callback - INFO - Received callback for node 69d4fe66932ecfe2320a30c8 INFO: 172.21.0.1:51846 - "POST /node/69d4fe66932ecfe2320a30c8 HTTP/1.0" 202 Accepted 2026-04-09 12:54:04,041 - lava_callback - INFO - Starting async job submit for node 69d4fe66932ecfe2320a30c8 2026-04-09 12:54:04,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:54:04,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe66932ecfe2320a30c8 HTTP/1.1" 200 None 2026-04-09 12:54:04,063 - lava_callback - DEBUG - Processing node 69d4fe66932ecfe2320a30c8: baseline-arm-baylibre 2026-04-09 12:54:04,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fe66932ecfe2320a30c8 2026-04-09 12:54:04,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:54:04,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fe66932ecfe2320a30c8 HTTP/1.1" 200 None 2026-04-09 12:54:04,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:54:04,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:54:04,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:54:04,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fe66932ecfe2320a30c8 HTTP/1.1" 200 None 2026-04-09 12:54:04,112 - lava_callback - ERROR - Error processing callback for node 69d4fe66932ecfe2320a30c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:55:24,048 - lava_callback - INFO - Received callback for node 69d4fea9932ecfe2320a312b INFO: 172.21.0.1:35316 - "POST /node/69d4fea9932ecfe2320a312b HTTP/1.0" 202 Accepted 2026-04-09 12:55:24,054 - lava_callback - INFO - Starting async job submit for node 69d4fea9932ecfe2320a312b 2026-04-09 12:55:24,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:24,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fea9932ecfe2320a312b HTTP/1.1" 200 None 2026-04-09 12:55:24,070 - lava_callback - DEBUG - Processing node 69d4fea9932ecfe2320a312b: baseline-arm-baylibre 2026-04-09 12:55:24,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fea9932ecfe2320a312b 2026-04-09 12:55:24,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:24,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fea9932ecfe2320a312b HTTP/1.1" 200 None 2026-04-09 12:55:24,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:24,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:55:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:24,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fea9932ecfe2320a312b HTTP/1.1" 200 None 2026-04-09 12:55:24,125 - lava_callback - ERROR - Error processing callback for node 69d4fea9932ecfe2320a312b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:55:44,045 - lava_callback - INFO - Received callback for node 69d4fec5932ecfe2320a3163 INFO: 172.21.0.1:51368 - "POST /node/69d4fec5932ecfe2320a3163 HTTP/1.0" 202 Accepted 2026-04-09 12:55:44,051 - lava_callback - INFO - Starting async job submit for node 69d4fec5932ecfe2320a3163 2026-04-09 12:55:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:44,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fec5932ecfe2320a3163 HTTP/1.1" 200 None 2026-04-09 12:55:44,068 - lava_callback - DEBUG - Processing node 69d4fec5932ecfe2320a3163: baseline-arm-baylibre 2026-04-09 12:55:44,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4fec5932ecfe2320a3163 2026-04-09 12:55:44,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:44,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4fec5932ecfe2320a3163 HTTP/1.1" 200 None 2026-04-09 12:55:44,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:44,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:55:44,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:55:44,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4fec5932ecfe2320a3163 HTTP/1.1" 200 None 2026-04-09 12:55:44,121 - lava_callback - ERROR - Error processing callback for node 69d4fec5932ecfe2320a3163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:56:24,104 - lava_callback - INFO - Received callback for node 69d4feee932ecfe2320a3175 INFO: 172.21.0.1:53216 - "POST /node/69d4feee932ecfe2320a3175 HTTP/1.0" 202 Accepted 2026-04-09 12:56:24,109 - lava_callback - INFO - Starting async job submit for node 69d4feee932ecfe2320a3175 2026-04-09 12:56:24,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:56:24,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4feee932ecfe2320a3175 HTTP/1.1" 200 None 2026-04-09 12:56:24,126 - lava_callback - DEBUG - Processing node 69d4feee932ecfe2320a3175: baseline-arm-baylibre 2026-04-09 12:56:24,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4feee932ecfe2320a3175 2026-04-09 12:56:24,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:56:24,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4feee932ecfe2320a3175 HTTP/1.1" 200 None 2026-04-09 12:56:24,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:56:24,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:56:24,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:56:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4feee932ecfe2320a3175 HTTP/1.1" 200 None 2026-04-09 12:56:24,185 - lava_callback - ERROR - Error processing callback for node 69d4feee932ecfe2320a3175: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:57:01,645 - lava_callback - INFO - Received callback for node 69d689022cda61b443d5bee9 INFO: 172.21.0.1:44852 - "POST /node/69d689022cda61b443d5bee9 HTTP/1.0" 202 Accepted 2026-04-09 12:57:01,652 - lava_callback - INFO - Starting async job submit for node 69d689022cda61b443d5bee9 2026-04-09 12:57:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:01,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d689022cda61b443d5bee9 HTTP/1.1" 200 None 2026-04-09 12:57:01,691 - lava_callback - DEBUG - Processing node 69d689022cda61b443d5bee9: baseline-arm64 2026-04-09 12:57:02,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:57:02,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:57:02,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d689022cda61b443d5bee9/log.txt.gz 2026-04-09 12:57:02,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:57:03,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:57:03,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d689022cda61b443d5bee9/lava-logs.yaml 2026-04-09 12:57:03,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:57:03,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:57:03,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d689022cda61b443d5bee9/lava_callback.json.gz 2026-04-09 12:57:03,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:03,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d689022cda61b443d5bee9 HTTP/1.1" 200 None 2026-04-09 12:57:03,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:03,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 12:57:03,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:03,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d689022cda61b443d5bee9 HTTP/1.1" 200 None 2026-04-09 12:57:03,624 - lava_callback - INFO - Completed processing callback for node 69d689022cda61b443d5bee9 INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:57:04,902 - lava_callback - INFO - Received callback for node 69d4ff12932ecfe2320a3188 INFO: 172.21.0.1:44874 - "POST /node/69d4ff12932ecfe2320a3188 HTTP/1.0" 202 Accepted 2026-04-09 12:57:04,907 - lava_callback - INFO - Starting async job submit for node 69d4ff12932ecfe2320a3188 2026-04-09 12:57:04,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:04,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff12932ecfe2320a3188 HTTP/1.1" 200 None 2026-04-09 12:57:04,924 - lava_callback - DEBUG - Processing node 69d4ff12932ecfe2320a3188: baseline-arm-clabbe 2026-04-09 12:57:04,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ff12932ecfe2320a3188 2026-04-09 12:57:04,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:04,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff12932ecfe2320a3188 HTTP/1.1" 200 None 2026-04-09 12:57:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:04,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:57:04,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:04,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ff12932ecfe2320a3188 HTTP/1.1" 200 None 2026-04-09 12:57:04,978 - lava_callback - ERROR - Error processing callback for node 69d4ff12932ecfe2320a3188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:57:20,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:20,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:57:44,885 - lava_callback - INFO - Received callback for node 69d4ff37932ecfe2320a31ad INFO: 172.21.0.1:53120 - "POST /node/69d4ff37932ecfe2320a31ad HTTP/1.0" 202 Accepted 2026-04-09 12:57:44,891 - lava_callback - INFO - Starting async job submit for node 69d4ff37932ecfe2320a31ad 2026-04-09 12:57:44,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:44,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff37932ecfe2320a31ad HTTP/1.1" 200 None 2026-04-09 12:57:44,907 - lava_callback - DEBUG - Processing node 69d4ff37932ecfe2320a31ad: baseline-arm-clabbe 2026-04-09 12:57:44,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ff37932ecfe2320a31ad 2026-04-09 12:57:44,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:44,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff37932ecfe2320a31ad HTTP/1.1" 200 None 2026-04-09 12:57:44,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:44,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:57:44,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:57:44,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ff37932ecfe2320a31ad HTTP/1.1" 200 None 2026-04-09 12:57:44,999 - lava_callback - ERROR - Error processing callback for node 69d4ff37932ecfe2320a31ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:58:04,231 - lava_callback - INFO - Received callback for node 69d4ff59932ecfe2320a31cc INFO: 172.21.0.1:42460 - "POST /node/69d4ff59932ecfe2320a31cc HTTP/1.0" 202 Accepted 2026-04-09 12:58:04,237 - lava_callback - INFO - Starting async job submit for node 69d4ff59932ecfe2320a31cc 2026-04-09 12:58:04,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:04,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff59932ecfe2320a31cc HTTP/1.1" 200 None 2026-04-09 12:58:04,261 - lava_callback - DEBUG - Processing node 69d4ff59932ecfe2320a31cc: baseline-arm-baylibre 2026-04-09 12:58:04,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ff59932ecfe2320a31cc 2026-04-09 12:58:04,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:04,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ff59932ecfe2320a31cc HTTP/1.1" 200 None 2026-04-09 12:58:04,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:04,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 12:58:04,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:04,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ff59932ecfe2320a31cc HTTP/1.1" 200 None 2026-04-09 12:58:04,328 - lava_callback - ERROR - Error processing callback for node 69d4ff59932ecfe2320a31cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:58:52,386 - lava_callback - INFO - Received callback for node 69d689132cda61b443d5bf30 INFO: 172.21.0.1:44938 - "POST /node/69d689132cda61b443d5bf30 HTTP/1.0" 202 Accepted 2026-04-09 12:58:52,393 - lava_callback - INFO - Starting async job submit for node 69d689132cda61b443d5bf30 2026-04-09 12:58:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:52,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d689132cda61b443d5bf30 HTTP/1.1" 200 None 2026-04-09 12:58:52,435 - lava_callback - DEBUG - Processing node 69d689132cda61b443d5bf30: baseline-nfs-arm64 2026-04-09 12:58:52,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:58:53,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:58:53,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d689132cda61b443d5bf30/log.txt.gz 2026-04-09 12:58:53,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:58:53,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:58:53,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d689132cda61b443d5bf30/lava-logs.yaml 2026-04-09 12:58:53,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 12:58:53,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 12:58:53,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d689132cda61b443d5bf30/lava_callback.json.gz 2026-04-09 12:58:53,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:53,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d689132cda61b443d5bf30 HTTP/1.1" 200 None 2026-04-09 12:58:53,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:53,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 12:58:53,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:58:53,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d689132cda61b443d5bf30 HTTP/1.1" 200 None 2026-04-09 12:58:54,003 - lava_callback - INFO - Completed processing callback for node 69d689132cda61b443d5bf30 INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK 2026-04-09 12:59:20,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 12:59:20,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:00:05,161 - lava_callback - INFO - Received callback for node 69d4ffc1932ecfe2320a3259 INFO: 172.21.0.1:35416 - "POST /node/69d4ffc1932ecfe2320a3259 HTTP/1.0" 202 Accepted 2026-04-09 13:00:05,167 - lava_callback - INFO - Starting async job submit for node 69d4ffc1932ecfe2320a3259 2026-04-09 13:00:05,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:00:05,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ffc1932ecfe2320a3259 HTTP/1.1" 200 None 2026-04-09 13:00:05,186 - lava_callback - DEBUG - Processing node 69d4ffc1932ecfe2320a3259: baseline-arm-clabbe 2026-04-09 13:00:05,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d4ffc1932ecfe2320a3259 2026-04-09 13:00:05,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:00:05,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4ffc1932ecfe2320a3259 HTTP/1.1" 200 None 2026-04-09 13:00:05,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:00:05,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:00:05,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:00:05,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4ffc1932ecfe2320a3259 HTTP/1.1" 200 None 2026-04-09 13:00:05,237 - lava_callback - ERROR - Error processing callback for node 69d4ffc1932ecfe2320a3259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:01:45,148 - lava_callback - INFO - Received callback for node 69d50031932ecfe2320a32ac INFO: 172.21.0.1:36660 - "POST /node/69d50031932ecfe2320a32ac HTTP/1.0" 202 Accepted 2026-04-09 13:01:45,154 - lava_callback - INFO - Starting async job submit for node 69d50031932ecfe2320a32ac 2026-04-09 13:01:45,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:01:45,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50031932ecfe2320a32ac HTTP/1.1" 200 None 2026-04-09 13:01:45,169 - lava_callback - DEBUG - Processing node 69d50031932ecfe2320a32ac: baseline-arm-clabbe 2026-04-09 13:01:45,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50031932ecfe2320a32ac 2026-04-09 13:01:45,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:01:45,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50031932ecfe2320a32ac HTTP/1.1" 200 None 2026-04-09 13:01:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:01:45,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:01:45,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:01:45,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50031932ecfe2320a32ac HTTP/1.1" 200 None 2026-04-09 13:01:45,238 - lava_callback - ERROR - Error processing callback for node 69d50031932ecfe2320a32ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:02:25,116 - lava_callback - INFO - Received callback for node 69d50059932ecfe2320a32c8 INFO: 172.21.0.1:49340 - "POST /node/69d50059932ecfe2320a32c8 HTTP/1.0" 202 Accepted 2026-04-09 13:02:25,121 - lava_callback - INFO - Starting async job submit for node 69d50059932ecfe2320a32c8 2026-04-09 13:02:25,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:02:25,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50059932ecfe2320a32c8 HTTP/1.1" 200 None 2026-04-09 13:02:25,158 - lava_callback - DEBUG - Processing node 69d50059932ecfe2320a32c8: baseline-arm-clabbe 2026-04-09 13:02:25,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50059932ecfe2320a32c8 2026-04-09 13:02:25,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:02:25,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50059932ecfe2320a32c8 HTTP/1.1" 200 None 2026-04-09 13:02:25,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:02:25,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:02:25,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:02:25,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50059932ecfe2320a32c8 HTTP/1.1" 200 None 2026-04-09 13:02:25,204 - lava_callback - ERROR - Error processing callback for node 69d50059932ecfe2320a32c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:04:25,202 - lava_callback - INFO - Received callback for node 69d500c9932ecfe2320a331d INFO: 172.21.0.1:35226 - "POST /node/69d500c9932ecfe2320a331d HTTP/1.0" 202 Accepted 2026-04-09 13:04:25,208 - lava_callback - INFO - Starting async job submit for node 69d500c9932ecfe2320a331d 2026-04-09 13:04:25,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:04:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d500c9932ecfe2320a331d HTTP/1.1" 200 None 2026-04-09 13:04:25,224 - lava_callback - DEBUG - Processing node 69d500c9932ecfe2320a331d: baseline-arm-clabbe 2026-04-09 13:04:25,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d500c9932ecfe2320a331d 2026-04-09 13:04:25,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:04:25,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d500c9932ecfe2320a331d HTTP/1.1" 200 None 2026-04-09 13:04:25,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:04:25,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:04:25,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:04:25,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d500c9932ecfe2320a331d HTTP/1.1" 200 None 2026-04-09 13:04:25,273 - lava_callback - ERROR - Error processing callback for node 69d500c9932ecfe2320a331d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:05:05,252 - lava_callback - INFO - Received callback for node 69d500ee932ecfe2320a332d INFO: 172.21.0.1:49430 - "POST /node/69d500ee932ecfe2320a332d HTTP/1.0" 202 Accepted 2026-04-09 13:05:05,258 - lava_callback - INFO - Starting async job submit for node 69d500ee932ecfe2320a332d 2026-04-09 13:05:05,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:05:05,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d500ee932ecfe2320a332d HTTP/1.1" 200 None 2026-04-09 13:05:05,280 - lava_callback - DEBUG - Processing node 69d500ee932ecfe2320a332d: baseline-arm-clabbe 2026-04-09 13:05:05,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d500ee932ecfe2320a332d 2026-04-09 13:05:05,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:05:05,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d500ee932ecfe2320a332d HTTP/1.1" 200 None 2026-04-09 13:05:05,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:05:05,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:05:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:05:05,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d500ee932ecfe2320a332d HTTP/1.1" 200 None 2026-04-09 13:05:05,343 - lava_callback - ERROR - Error processing callback for node 69d500ee932ecfe2320a332d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:06:45,303 - lava_callback - INFO - Received callback for node 69d50160932ecfe2320a3378 INFO: 172.21.0.1:48390 - "POST /node/69d50160932ecfe2320a3378 HTTP/1.0" 202 Accepted 2026-04-09 13:06:45,309 - lava_callback - INFO - Starting async job submit for node 69d50160932ecfe2320a3378 2026-04-09 13:06:45,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:06:45,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50160932ecfe2320a3378 HTTP/1.1" 200 None 2026-04-09 13:06:45,326 - lava_callback - DEBUG - Processing node 69d50160932ecfe2320a3378: baseline-arm-clabbe 2026-04-09 13:06:45,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50160932ecfe2320a3378 2026-04-09 13:06:45,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:06:45,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50160932ecfe2320a3378 HTTP/1.1" 200 None 2026-04-09 13:06:45,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:06:45,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:06:45,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:06:45,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50160932ecfe2320a3378 HTTP/1.1" 200 None 2026-04-09 13:06:45,383 - lava_callback - ERROR - Error processing callback for node 69d50160932ecfe2320a3378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:07:24,781 - lava_callback - INFO - Received callback for node 69d50187932ecfe2320a33a2 INFO: 172.21.0.1:44216 - "POST /node/69d50187932ecfe2320a33a2 HTTP/1.0" 202 Accepted 2026-04-09 13:07:24,787 - lava_callback - INFO - Starting async job submit for node 69d50187932ecfe2320a33a2 2026-04-09 13:07:24,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:07:24,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50187932ecfe2320a33a2 HTTP/1.1" 200 None 2026-04-09 13:07:24,812 - lava_callback - DEBUG - Processing node 69d50187932ecfe2320a33a2: baseline-arm64-baylibre 2026-04-09 13:07:24,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50187932ecfe2320a33a2 2026-04-09 13:07:24,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:07:24,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50187932ecfe2320a33a2 HTTP/1.1" 200 None 2026-04-09 13:07:24,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:07:24,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:07:24,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:07:24,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50187932ecfe2320a33a2 HTTP/1.1" 200 None 2026-04-09 13:07:24,861 - lava_callback - ERROR - Error processing callback for node 69d50187932ecfe2320a33a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:08:45,048 - lava_callback - INFO - Received callback for node 69d501d4932ecfe2320a33dd INFO: 172.21.0.1:47696 - "POST /node/69d501d4932ecfe2320a33dd HTTP/1.0" 202 Accepted 2026-04-09 13:08:45,053 - lava_callback - INFO - Starting async job submit for node 69d501d4932ecfe2320a33dd 2026-04-09 13:08:45,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:08:45,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d501d4932ecfe2320a33dd HTTP/1.1" 200 None 2026-04-09 13:08:45,069 - lava_callback - DEBUG - Processing node 69d501d4932ecfe2320a33dd: baseline-arm64-baylibre 2026-04-09 13:08:45,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d501d4932ecfe2320a33dd 2026-04-09 13:08:45,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:08:45,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d501d4932ecfe2320a33dd HTTP/1.1" 200 None 2026-04-09 13:08:45,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:08:45,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:08:45,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:08:45,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d501d4932ecfe2320a33dd HTTP/1.1" 200 None 2026-04-09 13:08:45,117 - lava_callback - ERROR - Error processing callback for node 69d501d4932ecfe2320a33dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:10:04,961 - lava_callback - INFO - Received callback for node 69d50220932ecfe2320a3412 INFO: 172.21.0.1:50830 - "POST /node/69d50220932ecfe2320a3412 HTTP/1.0" 202 Accepted 2026-04-09 13:10:04,966 - lava_callback - INFO - Starting async job submit for node 69d50220932ecfe2320a3412 2026-04-09 13:10:04,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:10:04,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50220932ecfe2320a3412 HTTP/1.1" 200 None 2026-04-09 13:10:04,983 - lava_callback - DEBUG - Processing node 69d50220932ecfe2320a3412: baseline-arm64-baylibre 2026-04-09 13:10:04,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50220932ecfe2320a3412 2026-04-09 13:10:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:10:05,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50220932ecfe2320a3412 HTTP/1.1" 200 None 2026-04-09 13:10:05,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:10:05,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:10:05,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:10:05,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50220932ecfe2320a3412 HTTP/1.1" 200 None 2026-04-09 13:10:05,038 - lava_callback - ERROR - Error processing callback for node 69d50220932ecfe2320a3412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:11:25,099 - lava_callback - INFO - Received callback for node 69d50271932ecfe2320a3445 INFO: 172.21.0.1:53612 - "POST /node/69d50271932ecfe2320a3445 HTTP/1.0" 202 Accepted 2026-04-09 13:11:25,104 - lava_callback - INFO - Starting async job submit for node 69d50271932ecfe2320a3445 2026-04-09 13:11:25,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:11:25,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50271932ecfe2320a3445 HTTP/1.1" 200 None 2026-04-09 13:11:25,120 - lava_callback - DEBUG - Processing node 69d50271932ecfe2320a3445: baseline-arm64-baylibre 2026-04-09 13:11:25,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50271932ecfe2320a3445 2026-04-09 13:11:25,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:11:25,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50271932ecfe2320a3445 HTTP/1.1" 200 None 2026-04-09 13:11:25,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:11:25,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:11:25,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:11:25,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50271932ecfe2320a3445 HTTP/1.1" 200 None 2026-04-09 13:11:25,168 - lava_callback - ERROR - Error processing callback for node 69d50271932ecfe2320a3445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:12:45,072 - lava_callback - INFO - Received callback for node 69d502c1932ecfe2320a3470 INFO: 172.21.0.1:53860 - "POST /node/69d502c1932ecfe2320a3470 HTTP/1.0" 202 Accepted 2026-04-09 13:12:45,078 - lava_callback - INFO - Starting async job submit for node 69d502c1932ecfe2320a3470 2026-04-09 13:12:45,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:12:45,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d502c1932ecfe2320a3470 HTTP/1.1" 200 None 2026-04-09 13:12:45,094 - lava_callback - DEBUG - Processing node 69d502c1932ecfe2320a3470: baseline-arm64-baylibre 2026-04-09 13:12:45,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d502c1932ecfe2320a3470 2026-04-09 13:12:45,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:12:45,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d502c1932ecfe2320a3470 HTTP/1.1" 200 None 2026-04-09 13:12:45,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:12:45,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:12:45,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:12:45,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d502c1932ecfe2320a3470 HTTP/1.1" 200 None 2026-04-09 13:12:45,154 - lava_callback - ERROR - Error processing callback for node 69d502c1932ecfe2320a3470: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:14:05,199 - lava_callback - INFO - Received callback for node 69d50310932ecfe2320a349e INFO: 172.21.0.1:45084 - "POST /node/69d50310932ecfe2320a349e HTTP/1.0" 202 Accepted 2026-04-09 13:14:05,208 - lava_callback - INFO - Starting async job submit for node 69d50310932ecfe2320a349e 2026-04-09 13:14:05,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:14:05,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50310932ecfe2320a349e HTTP/1.1" 200 None 2026-04-09 13:14:05,233 - lava_callback - DEBUG - Processing node 69d50310932ecfe2320a349e: baseline-arm64-baylibre 2026-04-09 13:14:05,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50310932ecfe2320a349e 2026-04-09 13:14:05,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:14:05,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50310932ecfe2320a349e HTTP/1.1" 200 None 2026-04-09 13:14:05,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:14:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:14:05,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:14:05,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50310932ecfe2320a349e HTTP/1.1" 200 None 2026-04-09 13:14:05,295 - lava_callback - ERROR - Error processing callback for node 69d50310932ecfe2320a349e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:15:05,762 - lava_callback - INFO - Received callback for node 69d50352932ecfe2320a34df INFO: 172.21.0.1:51538 - "POST /node/69d50352932ecfe2320a34df HTTP/1.0" 202 Accepted 2026-04-09 13:15:05,768 - lava_callback - INFO - Starting async job submit for node 69d50352932ecfe2320a34df 2026-04-09 13:15:05,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:05,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50352932ecfe2320a34df HTTP/1.1" 200 None 2026-04-09 13:15:05,784 - lava_callback - DEBUG - Processing node 69d50352932ecfe2320a34df: baseline-arm-clabbe 2026-04-09 13:15:05,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50352932ecfe2320a34df 2026-04-09 13:15:05,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:05,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50352932ecfe2320a34df HTTP/1.1" 200 None 2026-04-09 13:15:05,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:15:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:05,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50352932ecfe2320a34df HTTP/1.1" 200 None 2026-04-09 13:15:05,833 - lava_callback - ERROR - Error processing callback for node 69d50352932ecfe2320a34df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:15:45,698 - lava_callback - INFO - Received callback for node 69d50377932ecfe2320a350f INFO: 172.21.0.1:50132 - "POST /node/69d50377932ecfe2320a350f HTTP/1.0" 202 Accepted 2026-04-09 13:15:45,705 - lava_callback - INFO - Starting async job submit for node 69d50377932ecfe2320a350f 2026-04-09 13:15:45,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50377932ecfe2320a350f HTTP/1.1" 200 None 2026-04-09 13:15:45,722 - lava_callback - DEBUG - Processing node 69d50377932ecfe2320a350f: baseline-arm-clabbe 2026-04-09 13:15:45,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50377932ecfe2320a350f 2026-04-09 13:15:45,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:45,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50377932ecfe2320a350f HTTP/1.1" 200 None 2026-04-09 13:15:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:45,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:15:45,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:15:45,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50377932ecfe2320a350f HTTP/1.1" 200 None 2026-04-09 13:15:45,784 - lava_callback - ERROR - Error processing callback for node 69d50377932ecfe2320a350f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:16:25,794 - lava_callback - INFO - Received callback for node 69d503a7932ecfe2320a353e INFO: 172.21.0.1:36412 - "POST /node/69d503a7932ecfe2320a353e HTTP/1.0" 202 Accepted 2026-04-09 13:16:25,800 - lava_callback - INFO - Starting async job submit for node 69d503a7932ecfe2320a353e 2026-04-09 13:16:25,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:16:25,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d503a7932ecfe2320a353e HTTP/1.1" 200 None 2026-04-09 13:16:25,820 - lava_callback - DEBUG - Processing node 69d503a7932ecfe2320a353e: baseline-arm64-clabbe 2026-04-09 13:16:25,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d503a7932ecfe2320a353e 2026-04-09 13:16:25,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:16:25,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d503a7932ecfe2320a353e HTTP/1.1" 200 None 2026-04-09 13:16:25,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:16:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:16:25,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:16:25,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d503a7932ecfe2320a353e HTTP/1.1" 200 None 2026-04-09 13:16:25,868 - lava_callback - ERROR - Error processing callback for node 69d503a7932ecfe2320a353e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:17:45,910 - lava_callback - INFO - Received callback for node 69d503f1932ecfe2320a358a INFO: 172.21.0.1:50432 - "POST /node/69d503f1932ecfe2320a358a HTTP/1.0" 202 Accepted 2026-04-09 13:17:45,916 - lava_callback - INFO - Starting async job submit for node 69d503f1932ecfe2320a358a 2026-04-09 13:17:45,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:17:45,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d503f1932ecfe2320a358a HTTP/1.1" 200 None 2026-04-09 13:17:45,931 - lava_callback - DEBUG - Processing node 69d503f1932ecfe2320a358a: baseline-arm64-clabbe 2026-04-09 13:17:45,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d503f1932ecfe2320a358a 2026-04-09 13:17:45,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:17:45,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d503f1932ecfe2320a358a HTTP/1.1" 200 None 2026-04-09 13:17:45,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:17:45,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:17:45,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:17:45,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d503f1932ecfe2320a358a HTTP/1.1" 200 None 2026-04-09 13:17:45,987 - lava_callback - ERROR - Error processing callback for node 69d503f1932ecfe2320a358a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:19:05,886 - lava_callback - INFO - Received callback for node 69d5043c932ecfe2320a35cb INFO: 172.21.0.1:43700 - "POST /node/69d5043c932ecfe2320a35cb HTTP/1.0" 202 Accepted 2026-04-09 13:19:05,892 - lava_callback - INFO - Starting async job submit for node 69d5043c932ecfe2320a35cb 2026-04-09 13:19:05,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:19:05,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5043c932ecfe2320a35cb HTTP/1.1" 200 None 2026-04-09 13:19:05,908 - lava_callback - DEBUG - Processing node 69d5043c932ecfe2320a35cb: baseline-arm64-clabbe 2026-04-09 13:19:05,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5043c932ecfe2320a35cb 2026-04-09 13:19:05,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:19:05,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5043c932ecfe2320a35cb HTTP/1.1" 200 None 2026-04-09 13:19:05,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:19:05,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:19:05,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:19:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5043c932ecfe2320a35cb HTTP/1.1" 200 None 2026-04-09 13:19:05,960 - lava_callback - ERROR - Error processing callback for node 69d5043c932ecfe2320a35cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:20:25,932 - lava_callback - INFO - Received callback for node 69d5048c932ecfe2320a3606 INFO: 172.21.0.1:40084 - "POST /node/69d5048c932ecfe2320a3606 HTTP/1.0" 202 Accepted 2026-04-09 13:20:25,937 - lava_callback - INFO - Starting async job submit for node 69d5048c932ecfe2320a3606 2026-04-09 13:20:25,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:20:25,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5048c932ecfe2320a3606 HTTP/1.1" 200 None 2026-04-09 13:20:25,953 - lava_callback - DEBUG - Processing node 69d5048c932ecfe2320a3606: baseline-arm64-clabbe 2026-04-09 13:20:25,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5048c932ecfe2320a3606 2026-04-09 13:20:25,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:20:25,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5048c932ecfe2320a3606 HTTP/1.1" 200 None 2026-04-09 13:20:25,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:20:25,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:20:25,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:20:26,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5048c932ecfe2320a3606 HTTP/1.1" 200 None 2026-04-09 13:20:26,002 - lava_callback - ERROR - Error processing callback for node 69d5048c932ecfe2320a3606: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:21:46,016 - lava_callback - INFO - Received callback for node 69d504d5932ecfe2320a3655 INFO: 172.21.0.1:49252 - "POST /node/69d504d5932ecfe2320a3655 HTTP/1.0" 202 Accepted 2026-04-09 13:21:46,021 - lava_callback - INFO - Starting async job submit for node 69d504d5932ecfe2320a3655 2026-04-09 13:21:46,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:21:46,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d504d5932ecfe2320a3655 HTTP/1.1" 200 None 2026-04-09 13:21:46,037 - lava_callback - DEBUG - Processing node 69d504d5932ecfe2320a3655: baseline-arm64-clabbe 2026-04-09 13:21:46,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d504d5932ecfe2320a3655 2026-04-09 13:21:46,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:21:46,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d504d5932ecfe2320a3655 HTTP/1.1" 200 None 2026-04-09 13:21:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:21:46,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:21:46,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:21:46,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d504d5932ecfe2320a3655 HTTP/1.1" 200 None 2026-04-09 13:21:46,093 - lava_callback - ERROR - Error processing callback for node 69d504d5932ecfe2320a3655: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:22:45,579 - lava_callback - INFO - Received callback for node 69d50517932ecfe2320a3693 INFO: 172.21.0.1:53108 - "POST /node/69d50517932ecfe2320a3693 HTTP/1.0" 202 Accepted 2026-04-09 13:22:45,586 - lava_callback - INFO - Starting async job submit for node 69d50517932ecfe2320a3693 2026-04-09 13:22:45,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:22:45,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50517932ecfe2320a3693 HTTP/1.1" 200 None 2026-04-09 13:22:45,601 - lava_callback - DEBUG - Processing node 69d50517932ecfe2320a3693: baseline-arm64-baylibre 2026-04-09 13:22:45,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50517932ecfe2320a3693 2026-04-09 13:22:45,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:22:45,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50517932ecfe2320a3693 HTTP/1.1" 200 None 2026-04-09 13:22:45,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:22:45,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:22:45,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:22:45,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50517932ecfe2320a3693 HTTP/1.1" 200 None 2026-04-09 13:22:45,659 - lava_callback - ERROR - Error processing callback for node 69d50517932ecfe2320a3693: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:24:06,170 - lava_callback - INFO - Received callback for node 69d5056a932ecfe2320a36da INFO: 172.21.0.1:50216 - "POST /node/69d5056a932ecfe2320a36da HTTP/1.0" 202 Accepted 2026-04-09 13:24:06,175 - lava_callback - INFO - Starting async job submit for node 69d5056a932ecfe2320a36da 2026-04-09 13:24:06,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:24:06,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5056a932ecfe2320a36da HTTP/1.1" 200 None 2026-04-09 13:24:06,191 - lava_callback - DEBUG - Processing node 69d5056a932ecfe2320a36da: baseline-arm64-clabbe 2026-04-09 13:24:06,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5056a932ecfe2320a36da 2026-04-09 13:24:06,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:24:06,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5056a932ecfe2320a36da HTTP/1.1" 200 None 2026-04-09 13:24:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:24:06,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:24:06,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:24:06,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5056a932ecfe2320a36da HTTP/1.1" 200 None 2026-04-09 13:24:06,240 - lava_callback - ERROR - Error processing callback for node 69d5056a932ecfe2320a36da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:25:26,267 - lava_callback - INFO - Received callback for node 69d505b8932ecfe2320a370a INFO: 172.21.0.1:43788 - "POST /node/69d505b8932ecfe2320a370a HTTP/1.0" 202 Accepted 2026-04-09 13:25:26,274 - lava_callback - INFO - Starting async job submit for node 69d505b8932ecfe2320a370a 2026-04-09 13:25:26,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:25:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d505b8932ecfe2320a370a HTTP/1.1" 200 None 2026-04-09 13:25:26,290 - lava_callback - DEBUG - Processing node 69d505b8932ecfe2320a370a: baseline-arm64-clabbe 2026-04-09 13:25:26,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d505b8932ecfe2320a370a 2026-04-09 13:25:26,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:25:26,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d505b8932ecfe2320a370a HTTP/1.1" 200 None 2026-04-09 13:25:26,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:25:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-09 13:25:26,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:25:26,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d505b8932ecfe2320a370a HTTP/1.1" 200 None 2026-04-09 13:25:26,342 - lava_callback - ERROR - Error processing callback for node 69d505b8932ecfe2320a370a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:26:26,044 - lava_callback - INFO - Received callback for node 69d505fb932ecfe2320a373a INFO: 172.21.0.1:45382 - "POST /node/69d505fb932ecfe2320a373a HTTP/1.0" 202 Accepted 2026-04-09 13:26:26,050 - lava_callback - INFO - Starting async job submit for node 69d505fb932ecfe2320a373a 2026-04-09 13:26:26,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:26:26,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d505fb932ecfe2320a373a HTTP/1.1" 200 None 2026-04-09 13:26:26,066 - lava_callback - DEBUG - Processing node 69d505fb932ecfe2320a373a: baseline-arm64-baylibre 2026-04-09 13:26:26,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d505fb932ecfe2320a373a 2026-04-09 13:26:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:26:26,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d505fb932ecfe2320a373a HTTP/1.1" 200 None 2026-04-09 13:26:26,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:26:26,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:26:26,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:26:26,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d505fb932ecfe2320a373a HTTP/1.1" 200 None 2026-04-09 13:26:26,113 - lava_callback - ERROR - Error processing callback for node 69d505fb932ecfe2320a373a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:27:46,268 - lava_callback - INFO - Received callback for node 69d5063f932ecfe2320a3764 INFO: 172.21.0.1:59322 - "POST /node/69d5063f932ecfe2320a3764 HTTP/1.0" 202 Accepted 2026-04-09 13:27:46,273 - lava_callback - INFO - Starting async job submit for node 69d5063f932ecfe2320a3764 2026-04-09 13:27:46,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:27:46,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5063f932ecfe2320a3764 HTTP/1.1" 200 None 2026-04-09 13:27:46,293 - lava_callback - DEBUG - Processing node 69d5063f932ecfe2320a3764: baseline-arm-clabbe 2026-04-09 13:27:46,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5063f932ecfe2320a3764 2026-04-09 13:27:46,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:27:46,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5063f932ecfe2320a3764 HTTP/1.1" 200 None 2026-04-09 13:27:46,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:27:46,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:27:46,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:27:46,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5063f932ecfe2320a3764 HTTP/1.1" 200 None 2026-04-09 13:27:46,343 - lava_callback - ERROR - Error processing callback for node 69d5063f932ecfe2320a3764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:28:25,830 - lava_callback - INFO - Received callback for node 69d50668932ecfe2320a37aa INFO: 172.21.0.1:59910 - "POST /node/69d50668932ecfe2320a37aa HTTP/1.0" 202 Accepted 2026-04-09 13:28:25,839 - lava_callback - INFO - Starting async job submit for node 69d50668932ecfe2320a37aa 2026-04-09 13:28:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:28:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50668932ecfe2320a37aa HTTP/1.1" 200 None 2026-04-09 13:28:25,855 - lava_callback - DEBUG - Processing node 69d50668932ecfe2320a37aa: baseline-arm64-baylibre 2026-04-09 13:28:25,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50668932ecfe2320a37aa 2026-04-09 13:28:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:28:25,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50668932ecfe2320a37aa HTTP/1.1" 200 None 2026-04-09 13:28:25,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:28:25,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:28:25,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:28:25,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50668932ecfe2320a37aa HTTP/1.1" 200 None 2026-04-09 13:28:25,912 - lava_callback - ERROR - Error processing callback for node 69d50668932ecfe2320a37aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:29:26,305 - lava_callback - INFO - Received callback for node 69d506ad932ecfe2320a37dd INFO: 172.21.0.1:53656 - "POST /node/69d506ad932ecfe2320a37dd HTTP/1.0" 202 Accepted 2026-04-09 13:29:26,311 - lava_callback - INFO - Starting async job submit for node 69d506ad932ecfe2320a37dd 2026-04-09 13:29:26,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:29:26,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d506ad932ecfe2320a37dd HTTP/1.1" 200 None 2026-04-09 13:29:26,342 - lava_callback - DEBUG - Processing node 69d506ad932ecfe2320a37dd: baseline-arm-clabbe 2026-04-09 13:29:26,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d506ad932ecfe2320a37dd 2026-04-09 13:29:26,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:29:26,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d506ad932ecfe2320a37dd HTTP/1.1" 200 None 2026-04-09 13:29:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:29:26,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:29:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:29:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d506ad932ecfe2320a37dd HTTP/1.1" 200 None 2026-04-09 13:29:26,394 - lava_callback - ERROR - Error processing callback for node 69d506ad932ecfe2320a37dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:30:05,934 - lava_callback - INFO - Received callback for node 69d506d7932ecfe2320a37f8 INFO: 172.21.0.1:37252 - "POST /node/69d506d7932ecfe2320a37f8 HTTP/1.0" 202 Accepted 2026-04-09 13:30:05,940 - lava_callback - INFO - Starting async job submit for node 69d506d7932ecfe2320a37f8 2026-04-09 13:30:05,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:30:05,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d506d7932ecfe2320a37f8 HTTP/1.1" 200 None 2026-04-09 13:30:05,958 - lava_callback - DEBUG - Processing node 69d506d7932ecfe2320a37f8: baseline-arm64-baylibre 2026-04-09 13:30:05,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d506d7932ecfe2320a37f8 2026-04-09 13:30:05,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:30:05,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d506d7932ecfe2320a37f8 HTTP/1.1" 200 None 2026-04-09 13:30:05,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:30:05,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:30:05,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:30:06,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d506d7932ecfe2320a37f8 HTTP/1.1" 200 None 2026-04-09 13:30:06,005 - lava_callback - ERROR - Error processing callback for node 69d506d7932ecfe2320a37f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:31:26,451 - lava_callback - INFO - Received callback for node 69d5071a932ecfe2320a3841 INFO: 172.21.0.1:52674 - "POST /node/69d5071a932ecfe2320a3841 HTTP/1.0" 202 Accepted 2026-04-09 13:31:26,457 - lava_callback - INFO - Starting async job submit for node 69d5071a932ecfe2320a3841 2026-04-09 13:31:26,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:31:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5071a932ecfe2320a3841 HTTP/1.1" 200 None 2026-04-09 13:31:26,484 - lava_callback - DEBUG - Processing node 69d5071a932ecfe2320a3841: baseline-arm-clabbe 2026-04-09 13:31:26,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5071a932ecfe2320a3841 2026-04-09 13:31:26,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:31:26,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5071a932ecfe2320a3841 HTTP/1.1" 200 None 2026-04-09 13:31:26,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52690 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:31:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:31:26,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:31:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5071a932ecfe2320a3841 HTTP/1.1" 200 None 2026-04-09 13:31:26,552 - lava_callback - ERROR - Error processing callback for node 69d5071a932ecfe2320a3841: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:32:06,418 - lava_callback - INFO - Received callback for node 69d50740932ecfe2320a3854 INFO: 172.21.0.1:36038 - "POST /node/69d50740932ecfe2320a3854 HTTP/1.0" 202 Accepted 2026-04-09 13:32:06,427 - lava_callback - INFO - Starting async job submit for node 69d50740932ecfe2320a3854 2026-04-09 13:32:06,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:06,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50740932ecfe2320a3854 HTTP/1.1" 200 None 2026-04-09 13:32:06,449 - lava_callback - DEBUG - Processing node 69d50740932ecfe2320a3854: baseline-arm-clabbe 2026-04-09 13:32:06,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50740932ecfe2320a3854 2026-04-09 13:32:06,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:06,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50740932ecfe2320a3854 HTTP/1.1" 200 None 2026-04-09 13:32:06,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:06,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:32:06,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:06,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50740932ecfe2320a3854 HTTP/1.1" 200 None 2026-04-09 13:32:06,502 - lava_callback - ERROR - Error processing callback for node 69d50740932ecfe2320a3854: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:32:46,097 - lava_callback - INFO - Received callback for node 69d5076b932ecfe2320a3877 INFO: 172.21.0.1:42420 - "POST /node/69d5076b932ecfe2320a3877 HTTP/1.0" 202 Accepted 2026-04-09 13:32:46,103 - lava_callback - INFO - Starting async job submit for node 69d5076b932ecfe2320a3877 2026-04-09 13:32:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5076b932ecfe2320a3877 HTTP/1.1" 200 None 2026-04-09 13:32:46,119 - lava_callback - DEBUG - Processing node 69d5076b932ecfe2320a3877: baseline-arm64-baylibre 2026-04-09 13:32:46,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5076b932ecfe2320a3877 2026-04-09 13:32:46,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:46,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5076b932ecfe2320a3877 HTTP/1.1" 200 None 2026-04-09 13:32:46,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:46,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:32:46,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:32:46,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5076b932ecfe2320a3877 HTTP/1.1" 200 None 2026-04-09 13:32:46,180 - lava_callback - ERROR - Error processing callback for node 69d5076b932ecfe2320a3877: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:33:46,264 - lava_callback - INFO - Received callback for node 69d507a6932ecfe2320a38a2 INFO: 172.21.0.1:57194 - "POST /node/69d507a6932ecfe2320a38a2 HTTP/1.0" 202 Accepted 2026-04-09 13:33:46,270 - lava_callback - INFO - Starting async job submit for node 69d507a6932ecfe2320a38a2 2026-04-09 13:33:46,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:33:46,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507a6932ecfe2320a38a2 HTTP/1.1" 200 None 2026-04-09 13:33:46,285 - lava_callback - DEBUG - Processing node 69d507a6932ecfe2320a38a2: baseline-arm-baylibre 2026-04-09 13:33:46,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d507a6932ecfe2320a38a2 2026-04-09 13:33:46,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:33:46,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507a6932ecfe2320a38a2 HTTP/1.1" 200 None 2026-04-09 13:33:46,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:33:46,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:33:46,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:33:46,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d507a6932ecfe2320a38a2 HTTP/1.1" 200 None 2026-04-09 13:33:46,341 - lava_callback - ERROR - Error processing callback for node 69d507a6932ecfe2320a38a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:34:26,548 - lava_callback - INFO - Received callback for node 69d507d2932ecfe2320a38d6 INFO: 172.21.0.1:58944 - "POST /node/69d507d2932ecfe2320a38d6 HTTP/1.0" 202 Accepted 2026-04-09 13:34:26,553 - lava_callback - INFO - Starting async job submit for node 69d507d2932ecfe2320a38d6 2026-04-09 13:34:26,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:34:26,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507d2932ecfe2320a38d6 HTTP/1.1" 200 None 2026-04-09 13:34:26,569 - lava_callback - DEBUG - Processing node 69d507d2932ecfe2320a38d6: baseline-arm-clabbe 2026-04-09 13:34:26,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d507d2932ecfe2320a38d6 2026-04-09 13:34:26,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:34:26,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507d2932ecfe2320a38d6 HTTP/1.1" 200 None 2026-04-09 13:34:26,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:34:26,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:34:26,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:34:26,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d507d2932ecfe2320a38d6 HTTP/1.1" 200 None 2026-04-09 13:34:26,619 - lava_callback - ERROR - Error processing callback for node 69d507d2932ecfe2320a38d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:35:06,633 - lava_callback - INFO - Received callback for node 69d507f6932ecfe2320a38ec INFO: 172.21.0.1:49484 - "POST /node/69d507f6932ecfe2320a38ec HTTP/1.0" 202 Accepted 2026-04-09 13:35:06,639 - lava_callback - INFO - Starting async job submit for node 69d507f6932ecfe2320a38ec 2026-04-09 13:35:06,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:06,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507f6932ecfe2320a38ec HTTP/1.1" 200 None 2026-04-09 13:35:06,655 - lava_callback - DEBUG - Processing node 69d507f6932ecfe2320a38ec: baseline-arm-clabbe 2026-04-09 13:35:06,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d507f6932ecfe2320a38ec 2026-04-09 13:35:06,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:06,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d507f6932ecfe2320a38ec HTTP/1.1" 200 None 2026-04-09 13:35:06,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:06,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:35:06,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:06,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d507f6932ecfe2320a38ec HTTP/1.1" 200 None 2026-04-09 13:35:06,712 - lava_callback - ERROR - Error processing callback for node 69d507f6932ecfe2320a38ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:35:26,214 - lava_callback - INFO - Received callback for node 69d50817932ecfe2320a3908 INFO: 172.21.0.1:53256 - "POST /node/69d50817932ecfe2320a3908 HTTP/1.0" 202 Accepted 2026-04-09 13:35:26,220 - lava_callback - INFO - Starting async job submit for node 69d50817932ecfe2320a3908 2026-04-09 13:35:26,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:26,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50817932ecfe2320a3908 HTTP/1.1" 200 None 2026-04-09 13:35:26,246 - lava_callback - DEBUG - Processing node 69d50817932ecfe2320a3908: baseline-arm-baylibre 2026-04-09 13:35:26,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50817932ecfe2320a3908 2026-04-09 13:35:26,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:26,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50817932ecfe2320a3908 HTTP/1.1" 200 None 2026-04-09 13:35:26,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:26,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:35:26,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:35:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50817932ecfe2320a3908 HTTP/1.1" 200 None 2026-04-09 13:35:26,483 - lava_callback - ERROR - Error processing callback for node 69d50817932ecfe2320a3908: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:36:26,282 - lava_callback - INFO - Received callback for node 69d5084d932ecfe2320a394d INFO: 172.21.0.1:49366 - "POST /node/69d5084d932ecfe2320a394d HTTP/1.0" 202 Accepted 2026-04-09 13:36:26,288 - lava_callback - INFO - Starting async job submit for node 69d5084d932ecfe2320a394d 2026-04-09 13:36:26,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:36:26,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5084d932ecfe2320a394d HTTP/1.1" 200 None 2026-04-09 13:36:26,304 - lava_callback - DEBUG - Processing node 69d5084d932ecfe2320a394d: baseline-arm64-baylibre 2026-04-09 13:36:26,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5084d932ecfe2320a394d 2026-04-09 13:36:26,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:36:26,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5084d932ecfe2320a394d HTTP/1.1" 200 None 2026-04-09 13:36:26,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:36:26,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:36:26,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:36:26,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5084d932ecfe2320a394d HTTP/1.1" 200 None 2026-04-09 13:36:26,356 - lava_callback - ERROR - Error processing callback for node 69d5084d932ecfe2320a394d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:37:26,706 - lava_callback - INFO - Received callback for node 69d50884932ecfe2320a39b1 INFO: 172.21.0.1:60162 - "POST /node/69d50884932ecfe2320a39b1 HTTP/1.0" 202 Accepted 2026-04-09 13:37:26,712 - lava_callback - INFO - Starting async job submit for node 69d50884932ecfe2320a39b1 2026-04-09 13:37:26,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:26,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50884932ecfe2320a39b1 HTTP/1.1" 200 None 2026-04-09 13:37:26,728 - lava_callback - DEBUG - Processing node 69d50884932ecfe2320a39b1: baseline-arm-clabbe 2026-04-09 13:37:26,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50884932ecfe2320a39b1 2026-04-09 13:37:26,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50884932ecfe2320a39b1 HTTP/1.1" 200 None 2026-04-09 13:37:26,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:26,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:37:26,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:26,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50884932ecfe2320a39b1 HTTP/1.1" 200 None 2026-04-09 13:37:26,784 - lava_callback - ERROR - Error processing callback for node 69d50884932ecfe2320a39b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:37:46,372 - lava_callback - INFO - Received callback for node 69d508a3932ecfe2320a39cf INFO: 172.21.0.1:33492 - "POST /node/69d508a3932ecfe2320a39cf HTTP/1.0" 202 Accepted 2026-04-09 13:37:46,378 - lava_callback - INFO - Starting async job submit for node 69d508a3932ecfe2320a39cf 2026-04-09 13:37:46,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:46,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508a3932ecfe2320a39cf HTTP/1.1" 200 None 2026-04-09 13:37:46,419 - lava_callback - DEBUG - Processing node 69d508a3932ecfe2320a39cf: baseline-arm-baylibre 2026-04-09 13:37:46,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d508a3932ecfe2320a39cf 2026-04-09 13:37:46,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:46,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508a3932ecfe2320a39cf HTTP/1.1" 200 None 2026-04-09 13:37:46,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:46,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:37:46,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:37:46,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d508a3932ecfe2320a39cf HTTP/1.1" 200 None 2026-04-09 13:37:46,482 - lava_callback - ERROR - Error processing callback for node 69d508a3932ecfe2320a39cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:38:26,365 - lava_callback - INFO - Received callback for node 69d508ca932ecfe2320a39d9 INFO: 172.21.0.1:53904 - "POST /node/69d508ca932ecfe2320a39d9 HTTP/1.0" 202 Accepted 2026-04-09 13:38:26,370 - lava_callback - INFO - Starting async job submit for node 69d508ca932ecfe2320a39d9 2026-04-09 13:38:26,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:38:26,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508ca932ecfe2320a39d9 HTTP/1.1" 200 None 2026-04-09 13:38:26,386 - lava_callback - DEBUG - Processing node 69d508ca932ecfe2320a39d9: baseline-arm-baylibre 2026-04-09 13:38:26,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d508ca932ecfe2320a39d9 2026-04-09 13:38:26,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:38:26,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508ca932ecfe2320a39d9 HTTP/1.1" 200 None 2026-04-09 13:38:26,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:38:26,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:38:26,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:38:26,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d508ca932ecfe2320a39d9 HTTP/1.1" 200 None 2026-04-09 13:38:26,449 - lava_callback - ERROR - Error processing callback for node 69d508ca932ecfe2320a39d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:39:06,491 - lava_callback - INFO - Received callback for node 69d508e9932ecfe2320a39fb INFO: 172.21.0.1:56216 - "POST /node/69d508e9932ecfe2320a39fb HTTP/1.0" 202 Accepted 2026-04-09 13:39:06,496 - lava_callback - INFO - Starting async job submit for node 69d508e9932ecfe2320a39fb 2026-04-09 13:39:06,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:06,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508e9932ecfe2320a39fb HTTP/1.1" 200 None 2026-04-09 13:39:06,513 - lava_callback - DEBUG - Processing node 69d508e9932ecfe2320a39fb: baseline-arm-baylibre 2026-04-09 13:39:06,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d508e9932ecfe2320a39fb 2026-04-09 13:39:06,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:39:06,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d508e9932ecfe2320a39fb HTTP/1.1" 200 None 2026-04-09 13:39:06,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:06,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:39:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d508e9932ecfe2320a39fb HTTP/1.1" 200 None 2026-04-09 13:39:06,577 - lava_callback - ERROR - Error processing callback for node 69d508e9932ecfe2320a39fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:39:46,475 - lava_callback - INFO - Received callback for node 69d5090f932ecfe2320a3a37 INFO: 172.21.0.1:49758 - "POST /node/69d5090f932ecfe2320a3a37 HTTP/1.0" 202 Accepted 2026-04-09 13:39:46,481 - lava_callback - INFO - Starting async job submit for node 69d5090f932ecfe2320a3a37 2026-04-09 13:39:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:46,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5090f932ecfe2320a3a37 HTTP/1.1" 200 None 2026-04-09 13:39:46,497 - lava_callback - DEBUG - Processing node 69d5090f932ecfe2320a3a37: baseline-arm-baylibre 2026-04-09 13:39:46,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5090f932ecfe2320a3a37 2026-04-09 13:39:46,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:46,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5090f932ecfe2320a3a37 HTTP/1.1" 200 None 2026-04-09 13:39:46,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:39:46,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:39:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:39:46,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5090f932ecfe2320a3a37 HTTP/1.1" 200 None 2026-04-09 13:39:46,546 - lava_callback - ERROR - Error processing callback for node 69d5090f932ecfe2320a3a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:40:26,817 - lava_callback - INFO - Received callback for node 69d50940932ecfe2320a3a78 INFO: 172.21.0.1:56506 - "POST /node/69d50940932ecfe2320a3a78 HTTP/1.0" 202 Accepted 2026-04-09 13:40:26,823 - lava_callback - INFO - Starting async job submit for node 69d50940932ecfe2320a3a78 2026-04-09 13:40:26,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:40:26,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50940932ecfe2320a3a78 HTTP/1.1" 200 None 2026-04-09 13:40:26,839 - lava_callback - DEBUG - Processing node 69d50940932ecfe2320a3a78: baseline-arm64-clabbe 2026-04-09 13:40:26,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50940932ecfe2320a3a78 2026-04-09 13:40:26,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:40:26,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50940932ecfe2320a3a78 HTTP/1.1" 200 None 2026-04-09 13:40:26,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:40:26,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:40:26,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:40:26,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50940932ecfe2320a3a78 HTTP/1.1" 200 None 2026-04-09 13:40:26,900 - lava_callback - ERROR - Error processing callback for node 69d50940932ecfe2320a3a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39396 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:41:26,832 - lava_callback - INFO - Received callback for node 69d50974932ecfe2320a3ac7 INFO: 172.21.0.1:39406 - "POST /node/69d50974932ecfe2320a3ac7 HTTP/1.0" 202 Accepted 2026-04-09 13:41:26,838 - lava_callback - INFO - Starting async job submit for node 69d50974932ecfe2320a3ac7 2026-04-09 13:41:26,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:26,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50974932ecfe2320a3ac7 HTTP/1.1" 200 None 2026-04-09 13:41:26,856 - lava_callback - DEBUG - Processing node 69d50974932ecfe2320a3ac7: baseline-arm-clabbe 2026-04-09 13:41:26,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50974932ecfe2320a3ac7 2026-04-09 13:41:26,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:26,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50974932ecfe2320a3ac7 HTTP/1.1" 200 None 2026-04-09 13:41:26,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:26,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:41:26,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:26,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50974932ecfe2320a3ac7 HTTP/1.1" 200 None 2026-04-09 13:41:26,913 - lava_callback - ERROR - Error processing callback for node 69d50974932ecfe2320a3ac7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:41:46,824 - lava_callback - INFO - Received callback for node 69d50997932ecfe2320a3ae8 INFO: 172.21.0.1:52454 - "POST /node/69d50997932ecfe2320a3ae8 HTTP/1.0" 202 Accepted 2026-04-09 13:41:46,829 - lava_callback - INFO - Starting async job submit for node 69d50997932ecfe2320a3ae8 2026-04-09 13:41:46,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:46,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50997932ecfe2320a3ae8 HTTP/1.1" 200 None 2026-04-09 13:41:46,850 - lava_callback - DEBUG - Processing node 69d50997932ecfe2320a3ae8: baseline-arm-clabbe 2026-04-09 13:41:46,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50997932ecfe2320a3ae8 2026-04-09 13:41:46,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:46,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50997932ecfe2320a3ae8 HTTP/1.1" 200 None 2026-04-09 13:41:46,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:46,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:41:46,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:41:46,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50997932ecfe2320a3ae8 HTTP/1.1" 200 None 2026-04-09 13:41:46,897 - lava_callback - ERROR - Error processing callback for node 69d50997932ecfe2320a3ae8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:42:26,883 - lava_callback - INFO - Received callback for node 69d509be932ecfe2320a3af3 INFO: 172.21.0.1:37292 - "POST /node/69d509be932ecfe2320a3af3 HTTP/1.0" 202 Accepted 2026-04-09 13:42:26,889 - lava_callback - INFO - Starting async job submit for node 69d509be932ecfe2320a3af3 2026-04-09 13:42:26,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:42:26,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d509be932ecfe2320a3af3 HTTP/1.1" 200 None 2026-04-09 13:42:26,916 - lava_callback - DEBUG - Processing node 69d509be932ecfe2320a3af3: baseline-arm-clabbe 2026-04-09 13:42:26,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d509be932ecfe2320a3af3 2026-04-09 13:42:26,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:42:26,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d509be932ecfe2320a3af3 HTTP/1.1" 200 None 2026-04-09 13:42:26,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:42:26,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:42:26,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:42:26,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d509be932ecfe2320a3af3 HTTP/1.1" 200 None 2026-04-09 13:42:26,966 - lava_callback - ERROR - Error processing callback for node 69d509be932ecfe2320a3af3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:43:06,883 - lava_callback - INFO - Received callback for node 69d509e5932ecfe2320a3b07 INFO: 172.21.0.1:38320 - "POST /node/69d509e5932ecfe2320a3b07 HTTP/1.0" 202 Accepted 2026-04-09 13:43:06,889 - lava_callback - INFO - Starting async job submit for node 69d509e5932ecfe2320a3b07 2026-04-09 13:43:06,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:43:06,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d509e5932ecfe2320a3b07 HTTP/1.1" 200 None 2026-04-09 13:43:06,911 - lava_callback - DEBUG - Processing node 69d509e5932ecfe2320a3b07: baseline-arm-clabbe 2026-04-09 13:43:06,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d509e5932ecfe2320a3b07 2026-04-09 13:43:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:43:06,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d509e5932ecfe2320a3b07 HTTP/1.1" 200 None 2026-04-09 13:43:06,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:43:06,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:43:06,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:43:06,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d509e5932ecfe2320a3b07 HTTP/1.1" 200 None 2026-04-09 13:43:06,963 - lava_callback - ERROR - Error processing callback for node 69d509e5932ecfe2320a3b07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:44:06,961 - lava_callback - INFO - Received callback for node 69d50a16932ecfe2320a3b33 INFO: 172.21.0.1:49824 - "POST /node/69d50a16932ecfe2320a3b33 HTTP/1.0" 202 Accepted 2026-04-09 13:44:06,966 - lava_callback - INFO - Starting async job submit for node 69d50a16932ecfe2320a3b33 2026-04-09 13:44:06,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:06,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a16932ecfe2320a3b33 HTTP/1.1" 200 None 2026-04-09 13:44:06,982 - lava_callback - DEBUG - Processing node 69d50a16932ecfe2320a3b33: baseline-arm64-clabbe 2026-04-09 13:44:06,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50a16932ecfe2320a3b33 2026-04-09 13:44:06,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:06,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a16932ecfe2320a3b33 HTTP/1.1" 200 None 2026-04-09 13:44:06,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:07,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:44:07,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:07,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50a16932ecfe2320a3b33 HTTP/1.1" 200 None 2026-04-09 13:44:07,041 - lava_callback - ERROR - Error processing callback for node 69d50a16932ecfe2320a3b33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:44:46,946 - lava_callback - INFO - Received callback for node 69d50a4c932ecfe2320a3b7f INFO: 172.21.0.1:41016 - "POST /node/69d50a4c932ecfe2320a3b7f HTTP/1.0" 202 Accepted 2026-04-09 13:44:46,952 - lava_callback - INFO - Starting async job submit for node 69d50a4c932ecfe2320a3b7f 2026-04-09 13:44:46,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:46,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a4c932ecfe2320a3b7f HTTP/1.1" 200 None 2026-04-09 13:44:46,972 - lava_callback - DEBUG - Processing node 69d50a4c932ecfe2320a3b7f: baseline-arm-clabbe 2026-04-09 13:44:46,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50a4c932ecfe2320a3b7f 2026-04-09 13:44:46,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:46,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a4c932ecfe2320a3b7f HTTP/1.1" 200 None 2026-04-09 13:44:46,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:47,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:44:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:44:47,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50a4c932ecfe2320a3b7f HTTP/1.1" 200 None 2026-04-09 13:44:47,036 - lava_callback - ERROR - Error processing callback for node 69d50a4c932ecfe2320a3b7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:45:27,029 - lava_callback - INFO - Received callback for node 69d50a6f932ecfe2320a3baa INFO: 172.21.0.1:36500 - "POST /node/69d50a6f932ecfe2320a3baa HTTP/1.0" 202 Accepted 2026-04-09 13:45:27,035 - lava_callback - INFO - Starting async job submit for node 69d50a6f932ecfe2320a3baa 2026-04-09 13:45:27,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:45:27,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a6f932ecfe2320a3baa HTTP/1.1" 200 None 2026-04-09 13:45:27,051 - lava_callback - DEBUG - Processing node 69d50a6f932ecfe2320a3baa: baseline-arm-clabbe 2026-04-09 13:45:27,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50a6f932ecfe2320a3baa 2026-04-09 13:45:27,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:45:27,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50a6f932ecfe2320a3baa HTTP/1.1" 200 None 2026-04-09 13:45:27,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:45:27,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:45:27,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:45:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50a6f932ecfe2320a3baa HTTP/1.1" 200 None 2026-04-09 13:45:27,099 - lava_callback - ERROR - Error processing callback for node 69d50a6f932ecfe2320a3baa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:46:27,025 - lava_callback - INFO - Received callback for node 69d50aa1932ecfe2320a3bd9 INFO: 172.21.0.1:41102 - "POST /node/69d50aa1932ecfe2320a3bd9 HTTP/1.0" 202 Accepted 2026-04-09 13:46:27,031 - lava_callback - INFO - Starting async job submit for node 69d50aa1932ecfe2320a3bd9 2026-04-09 13:46:27,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:46:27,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50aa1932ecfe2320a3bd9 HTTP/1.1" 200 None 2026-04-09 13:46:27,047 - lava_callback - DEBUG - Processing node 69d50aa1932ecfe2320a3bd9: baseline-arm64-clabbe 2026-04-09 13:46:27,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50aa1932ecfe2320a3bd9 2026-04-09 13:46:27,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:46:27,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50aa1932ecfe2320a3bd9 HTTP/1.1" 200 None 2026-04-09 13:46:27,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:46:27,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:46:27,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:46:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50aa1932ecfe2320a3bd9 HTTP/1.1" 200 None 2026-04-09 13:46:27,099 - lava_callback - ERROR - Error processing callback for node 69d50aa1932ecfe2320a3bd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:47:07,028 - lava_callback - INFO - Received callback for node 69d50ad7932ecfe2320a3bfb INFO: 172.21.0.1:37406 - "POST /node/69d50ad7932ecfe2320a3bfb HTTP/1.0" 202 Accepted 2026-04-09 13:47:07,033 - lava_callback - INFO - Starting async job submit for node 69d50ad7932ecfe2320a3bfb 2026-04-09 13:47:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ad7932ecfe2320a3bfb HTTP/1.1" 200 None 2026-04-09 13:47:07,049 - lava_callback - DEBUG - Processing node 69d50ad7932ecfe2320a3bfb: baseline-arm-clabbe 2026-04-09 13:47:07,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50ad7932ecfe2320a3bfb 2026-04-09 13:47:07,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:07,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ad7932ecfe2320a3bfb HTTP/1.1" 200 None 2026-04-09 13:47:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:07,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-09 13:47:07,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50ad7932ecfe2320a3bfb HTTP/1.1" 200 None 2026-04-09 13:47:07,109 - lava_callback - ERROR - Error processing callback for node 69d50ad7932ecfe2320a3bfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:47:47,066 - lava_callback - INFO - Received callback for node 69d50afb932ecfe2320a3c54 INFO: 172.21.0.1:55310 - "POST /node/69d50afb932ecfe2320a3c54 HTTP/1.0" 202 Accepted 2026-04-09 13:47:47,074 - lava_callback - INFO - Starting async job submit for node 69d50afb932ecfe2320a3c54 2026-04-09 13:47:47,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:47,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50afb932ecfe2320a3c54 HTTP/1.1" 200 None 2026-04-09 13:47:47,090 - lava_callback - DEBUG - Processing node 69d50afb932ecfe2320a3c54: baseline-arm64-baylibre 2026-04-09 13:47:47,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50afb932ecfe2320a3c54 2026-04-09 13:47:47,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:47,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50afb932ecfe2320a3c54 HTTP/1.1" 200 None 2026-04-09 13:47:47,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:47,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:47:47,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:47:47,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50afb932ecfe2320a3c54 HTTP/1.1" 200 None 2026-04-09 13:47:47,159 - lava_callback - ERROR - Error processing callback for node 69d50afb932ecfe2320a3c54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:49:27,198 - lava_callback - INFO - Received callback for node 69d50b52932ecfe2320a3c95 INFO: 172.21.0.1:44934 - "POST /node/69d50b52932ecfe2320a3c95 HTTP/1.0" 202 Accepted 2026-04-09 13:49:27,205 - lava_callback - INFO - Starting async job submit for node 69d50b52932ecfe2320a3c95 2026-04-09 13:49:27,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:49:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50b52932ecfe2320a3c95 HTTP/1.1" 200 None 2026-04-09 13:49:27,225 - lava_callback - DEBUG - Processing node 69d50b52932ecfe2320a3c95: baseline-arm64-clabbe 2026-04-09 13:49:27,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50b52932ecfe2320a3c95 2026-04-09 13:49:27,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:49:27,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50b52932ecfe2320a3c95 HTTP/1.1" 200 None 2026-04-09 13:49:27,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:49:27,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:49:27,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:49:27,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50b52932ecfe2320a3c95 HTTP/1.1" 200 None 2026-04-09 13:49:27,287 - lava_callback - ERROR - Error processing callback for node 69d50b52932ecfe2320a3c95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:50:27,135 - lava_callback - INFO - Received callback for node 69d50b90932ecfe2320a3ced INFO: 172.21.0.1:58378 - "POST /node/69d50b90932ecfe2320a3ced HTTP/1.0" 202 Accepted 2026-04-09 13:50:27,140 - lava_callback - INFO - Starting async job submit for node 69d50b90932ecfe2320a3ced 2026-04-09 13:50:27,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:50:27,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50b90932ecfe2320a3ced HTTP/1.1" 200 None 2026-04-09 13:50:27,156 - lava_callback - DEBUG - Processing node 69d50b90932ecfe2320a3ced: baseline-arm64-baylibre 2026-04-09 13:50:27,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50b90932ecfe2320a3ced 2026-04-09 13:50:27,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:50:27,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50b90932ecfe2320a3ced HTTP/1.1" 200 None 2026-04-09 13:50:27,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:50:27,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:50:27,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:50:27,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50b90932ecfe2320a3ced HTTP/1.1" 200 None 2026-04-09 13:50:27,219 - lava_callback - ERROR - Error processing callback for node 69d50b90932ecfe2320a3ced: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:51:27,093 - lava_callback - INFO - Received callback for node 69d50bda932ecfe2320a3d26 INFO: 172.21.0.1:40992 - "POST /node/69d50bda932ecfe2320a3d26 HTTP/1.0" 202 Accepted 2026-04-09 13:51:27,099 - lava_callback - INFO - Starting async job submit for node 69d50bda932ecfe2320a3d26 2026-04-09 13:51:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:51:27,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50bda932ecfe2320a3d26 HTTP/1.1" 200 None 2026-04-09 13:51:27,115 - lava_callback - DEBUG - Processing node 69d50bda932ecfe2320a3d26: baseline-arm64-baylibre 2026-04-09 13:51:27,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50bda932ecfe2320a3d26 2026-04-09 13:51:27,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:51:27,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50bda932ecfe2320a3d26 HTTP/1.1" 200 None 2026-04-09 13:51:27,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:51:27,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:51:27,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:51:27,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50bda932ecfe2320a3d26 HTTP/1.1" 200 None 2026-04-09 13:51:27,175 - lava_callback - ERROR - Error processing callback for node 69d50bda932ecfe2320a3d26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:53:07,346 - lava_callback - INFO - Received callback for node 69d50c30932ecfe2320a3d3e INFO: 172.21.0.1:45560 - "POST /node/69d50c30932ecfe2320a3d3e HTTP/1.0" 202 Accepted 2026-04-09 13:53:07,352 - lava_callback - INFO - Starting async job submit for node 69d50c30932ecfe2320a3d3e 2026-04-09 13:53:07,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:53:07,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50c30932ecfe2320a3d3e HTTP/1.1" 200 None 2026-04-09 13:53:07,368 - lava_callback - DEBUG - Processing node 69d50c30932ecfe2320a3d3e: baseline-arm64-clabbe 2026-04-09 13:53:07,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50c30932ecfe2320a3d3e 2026-04-09 13:53:07,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:53:07,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50c30932ecfe2320a3d3e HTTP/1.1" 200 None 2026-04-09 13:53:07,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:53:07,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:53:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:53:07,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50c30932ecfe2320a3d3e HTTP/1.1" 200 None 2026-04-09 13:53:07,427 - lava_callback - ERROR - Error processing callback for node 69d50c30932ecfe2320a3d3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45566 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:54:07,357 - lava_callback - INFO - Received callback for node 69d50c72932ecfe2320a3d7f INFO: 172.21.0.1:40894 - "POST /node/69d50c72932ecfe2320a3d7f HTTP/1.0" 202 Accepted 2026-04-09 13:54:07,362 - lava_callback - INFO - Starting async job submit for node 69d50c72932ecfe2320a3d7f 2026-04-09 13:54:07,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:54:07,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50c72932ecfe2320a3d7f HTTP/1.1" 200 None 2026-04-09 13:54:07,378 - lava_callback - DEBUG - Processing node 69d50c72932ecfe2320a3d7f: baseline-arm64-baylibre 2026-04-09 13:54:07,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50c72932ecfe2320a3d7f 2026-04-09 13:54:07,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:54:07,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50c72932ecfe2320a3d7f HTTP/1.1" 200 None 2026-04-09 13:54:07,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:54:07,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:54:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:54:07,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50c72932ecfe2320a3d7f HTTP/1.1" 200 None 2026-04-09 13:54:07,426 - lava_callback - ERROR - Error processing callback for node 69d50c72932ecfe2320a3d7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:55:27,323 - lava_callback - INFO - Received callback for node 69d50cba932ecfe2320a3dbb INFO: 172.21.0.1:42754 - "POST /node/69d50cba932ecfe2320a3dbb HTTP/1.0" 202 Accepted 2026-04-09 13:55:27,329 - lava_callback - INFO - Starting async job submit for node 69d50cba932ecfe2320a3dbb 2026-04-09 13:55:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:55:27,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50cba932ecfe2320a3dbb HTTP/1.1" 200 None 2026-04-09 13:55:27,345 - lava_callback - DEBUG - Processing node 69d50cba932ecfe2320a3dbb: baseline-arm64-baylibre 2026-04-09 13:55:27,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50cba932ecfe2320a3dbb 2026-04-09 13:55:27,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:55:27,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50cba932ecfe2320a3dbb HTTP/1.1" 200 None 2026-04-09 13:55:27,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:55:27,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:55:27,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:55:27,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50cba932ecfe2320a3dbb HTTP/1.1" 200 None 2026-04-09 13:55:27,405 - lava_callback - ERROR - Error processing callback for node 69d50cba932ecfe2320a3dbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:56:27,585 - lava_callback - INFO - Received callback for node 69d50d02932ecfe2320a3e02 INFO: 172.21.0.1:34764 - "POST /node/69d50d02932ecfe2320a3e02 HTTP/1.0" 202 Accepted 2026-04-09 13:56:27,590 - lava_callback - INFO - Starting async job submit for node 69d50d02932ecfe2320a3e02 2026-04-09 13:56:27,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:56:27,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d02932ecfe2320a3e02 HTTP/1.1" 200 None 2026-04-09 13:56:27,606 - lava_callback - DEBUG - Processing node 69d50d02932ecfe2320a3e02: baseline-arm64-clabbe 2026-04-09 13:56:27,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50d02932ecfe2320a3e02 2026-04-09 13:56:27,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:56:27,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d02932ecfe2320a3e02 HTTP/1.1" 200 None 2026-04-09 13:56:27,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:56:27,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:56:27,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:56:27,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50d02932ecfe2320a3e02 HTTP/1.1" 200 None 2026-04-09 13:56:27,659 - lava_callback - ERROR - Error processing callback for node 69d50d02932ecfe2320a3e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:57:47,470 - lava_callback - INFO - Received callback for node 69d50d48932ecfe2320a3e0d INFO: 172.21.0.1:57804 - "POST /node/69d50d48932ecfe2320a3e0d HTTP/1.0" 202 Accepted 2026-04-09 13:57:47,476 - lava_callback - INFO - Starting async job submit for node 69d50d48932ecfe2320a3e0d 2026-04-09 13:57:47,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:57:47,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d48932ecfe2320a3e0d HTTP/1.1" 200 None 2026-04-09 13:57:47,492 - lava_callback - DEBUG - Processing node 69d50d48932ecfe2320a3e0d: baseline-arm64-baylibre 2026-04-09 13:57:47,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50d48932ecfe2320a3e0d 2026-04-09 13:57:47,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:57:47,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d48932ecfe2320a3e0d HTTP/1.1" 200 None 2026-04-09 13:57:47,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:57:47,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:57:47,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:57:47,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50d48932ecfe2320a3e0d HTTP/1.1" 200 None 2026-04-09 13:57:47,543 - lava_callback - ERROR - Error processing callback for node 69d50d48932ecfe2320a3e0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK 2026-04-09 13:58:47,659 - lava_callback - INFO - Received callback for node 69d50d93932ecfe2320a3e49 INFO: 172.21.0.1:41706 - "POST /node/69d50d93932ecfe2320a3e49 HTTP/1.0" 202 Accepted 2026-04-09 13:58:47,665 - lava_callback - INFO - Starting async job submit for node 69d50d93932ecfe2320a3e49 2026-04-09 13:58:47,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:58:47,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d93932ecfe2320a3e49 HTTP/1.1" 200 None 2026-04-09 13:58:47,682 - lava_callback - DEBUG - Processing node 69d50d93932ecfe2320a3e49: baseline-arm64-clabbe 2026-04-09 13:58:47,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50d93932ecfe2320a3e49 2026-04-09 13:58:47,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:58:47,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50d93932ecfe2320a3e49 HTTP/1.1" 200 None 2026-04-09 13:58:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:58:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 13:58:47,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 13:58:47,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50d93932ecfe2320a3e49 HTTP/1.1" 200 None 2026-04-09 13:58:47,730 - lava_callback - ERROR - Error processing callback for node 69d50d93932ecfe2320a3e49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:00:07,933 - lava_callback - INFO - Received callback for node 69d50ddc932ecfe2320a3e7f INFO: 172.21.0.1:55176 - "POST /node/69d50ddc932ecfe2320a3e7f HTTP/1.0" 202 Accepted 2026-04-09 14:00:07,939 - lava_callback - INFO - Starting async job submit for node 69d50ddc932ecfe2320a3e7f 2026-04-09 14:00:07,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:00:07,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ddc932ecfe2320a3e7f HTTP/1.1" 200 None 2026-04-09 14:00:07,954 - lava_callback - DEBUG - Processing node 69d50ddc932ecfe2320a3e7f: baseline-arm64-clabbe 2026-04-09 14:00:07,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50ddc932ecfe2320a3e7f 2026-04-09 14:00:07,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:00:07,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ddc932ecfe2320a3e7f HTTP/1.1" 200 None 2026-04-09 14:00:07,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:00:07,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:00:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:00:08,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50ddc932ecfe2320a3e7f HTTP/1.1" 200 None 2026-04-09 14:00:08,003 - lava_callback - ERROR - Error processing callback for node 69d50ddc932ecfe2320a3e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:01:27,796 - lava_callback - INFO - Received callback for node 69d50e2c932ecfe2320a3ea8 INFO: 172.21.0.1:57932 - "POST /node/69d50e2c932ecfe2320a3ea8 HTTP/1.0" 202 Accepted 2026-04-09 14:01:27,804 - lava_callback - INFO - Starting async job submit for node 69d50e2c932ecfe2320a3ea8 2026-04-09 14:01:27,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:01:27,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50e2c932ecfe2320a3ea8 HTTP/1.1" 200 None 2026-04-09 14:01:27,827 - lava_callback - DEBUG - Processing node 69d50e2c932ecfe2320a3ea8: baseline-arm64-clabbe 2026-04-09 14:01:27,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50e2c932ecfe2320a3ea8 2026-04-09 14:01:27,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:01:27,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50e2c932ecfe2320a3ea8 HTTP/1.1" 200 None 2026-04-09 14:01:27,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:01:27,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:01:27,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:01:27,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50e2c932ecfe2320a3ea8 HTTP/1.1" 200 None 2026-04-09 14:01:27,899 - lava_callback - ERROR - Error processing callback for node 69d50e2c932ecfe2320a3ea8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:02:47,900 - lava_callback - INFO - Received callback for node 69d50e75932ecfe2320a3eda INFO: 172.21.0.1:48638 - "POST /node/69d50e75932ecfe2320a3eda HTTP/1.0" 202 Accepted 2026-04-09 14:02:47,906 - lava_callback - INFO - Starting async job submit for node 69d50e75932ecfe2320a3eda 2026-04-09 14:02:47,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:02:47,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50e75932ecfe2320a3eda HTTP/1.1" 200 None 2026-04-09 14:02:47,928 - lava_callback - DEBUG - Processing node 69d50e75932ecfe2320a3eda: baseline-arm64-clabbe 2026-04-09 14:02:47,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50e75932ecfe2320a3eda 2026-04-09 14:02:47,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:02:47,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50e75932ecfe2320a3eda HTTP/1.1" 200 None 2026-04-09 14:02:47,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:02:47,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:02:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:02:47,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50e75932ecfe2320a3eda HTTP/1.1" 200 None 2026-04-09 14:02:47,977 - lava_callback - ERROR - Error processing callback for node 69d50e75932ecfe2320a3eda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:03:51,544 - lava_callback - INFO - Received callback for node 69d6de782cda61b443d5e576 INFO: 172.21.0.1:59316 - "POST /node/69d6de782cda61b443d5e576 HTTP/1.0" 202 Accepted 2026-04-09 14:03:51,551 - lava_callback - INFO - Starting async job submit for node 69d6de782cda61b443d5e576 2026-04-09 14:03:51,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:03:51,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6de782cda61b443d5e576 HTTP/1.1" 200 None 2026-04-09 14:03:51,615 - lava_callback - DEBUG - Processing node 69d6de782cda61b443d5e576: baseline-arm64 2026-04-09 14:03:52,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:03:52,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:03:52,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6de782cda61b443d5e576/log.txt.gz 2026-04-09 14:03:52,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:03:52,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:03:52,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6de782cda61b443d5e576/lava-logs.yaml 2026-04-09 14:03:52,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:03:52,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:03:52,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6de782cda61b443d5e576/lava_callback.json.gz 2026-04-09 14:03:52,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:03:53,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6de782cda61b443d5e576 HTTP/1.1" 200 None 2026-04-09 14:03:53,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:03:53,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 14:03:53,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:03:53,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d6de782cda61b443d5e576 HTTP/1.1" 200 None 2026-04-09 14:03:53,102 - lava_callback - INFO - Completed processing callback for node 69d6de782cda61b443d5e576 INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:04:07,920 - lava_callback - INFO - Received callback for node 69d50ecb932ecfe2320a3f08 INFO: 172.21.0.1:50460 - "POST /node/69d50ecb932ecfe2320a3f08 HTTP/1.0" 202 Accepted 2026-04-09 14:04:07,926 - lava_callback - INFO - Starting async job submit for node 69d50ecb932ecfe2320a3f08 2026-04-09 14:04:07,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:04:07,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ecb932ecfe2320a3f08 HTTP/1.1" 200 None 2026-04-09 14:04:07,943 - lava_callback - DEBUG - Processing node 69d50ecb932ecfe2320a3f08: baseline-arm64-clabbe 2026-04-09 14:04:07,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50ecb932ecfe2320a3f08 2026-04-09 14:04:07,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:04:07,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50ecb932ecfe2320a3f08 HTTP/1.1" 200 None 2026-04-09 14:04:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:04:07,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:04:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:04:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50ecb932ecfe2320a3f08 HTTP/1.1" 200 None 2026-04-09 14:04:07,991 - lava_callback - ERROR - Error processing callback for node 69d50ecb932ecfe2320a3f08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:04:20,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:04:20,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:05:28,036 - lava_callback - INFO - Received callback for node 69d50f13932ecfe2320a3f30 INFO: 172.21.0.1:47560 - "POST /node/69d50f13932ecfe2320a3f30 HTTP/1.0" 202 Accepted 2026-04-09 14:05:28,042 - lava_callback - INFO - Starting async job submit for node 69d50f13932ecfe2320a3f30 2026-04-09 14:05:28,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:05:28,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50f13932ecfe2320a3f30 HTTP/1.1" 200 None 2026-04-09 14:05:28,058 - lava_callback - DEBUG - Processing node 69d50f13932ecfe2320a3f30: baseline-arm64-clabbe 2026-04-09 14:05:28,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50f13932ecfe2320a3f30 2026-04-09 14:05:28,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:05:28,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50f13932ecfe2320a3f30 HTTP/1.1" 200 None 2026-04-09 14:05:28,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:05:28,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:05:28,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:05:28,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50f13932ecfe2320a3f30 HTTP/1.1" 200 None 2026-04-09 14:05:28,146 - lava_callback - ERROR - Error processing callback for node 69d50f13932ecfe2320a3f30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:06:27,977 - lava_callback - INFO - Received callback for node 69d50f56932ecfe2320a3f6b INFO: 172.21.0.1:53488 - "POST /node/69d50f56932ecfe2320a3f6b HTTP/1.0" 202 Accepted 2026-04-09 14:06:27,983 - lava_callback - INFO - Starting async job submit for node 69d50f56932ecfe2320a3f6b 2026-04-09 14:06:27,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:06:27,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50f56932ecfe2320a3f6b HTTP/1.1" 200 None 2026-04-09 14:06:27,998 - lava_callback - DEBUG - Processing node 69d50f56932ecfe2320a3f6b: baseline-arm64-baylibre 2026-04-09 14:06:27,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50f56932ecfe2320a3f6b 2026-04-09 14:06:27,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:06:28,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50f56932ecfe2320a3f6b HTTP/1.1" 200 None 2026-04-09 14:06:28,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:06:28,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:06:28,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:06:28,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50f56932ecfe2320a3f6b HTTP/1.1" 200 None 2026-04-09 14:06:28,046 - lava_callback - ERROR - Error processing callback for node 69d50f56932ecfe2320a3f6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:07:48,009 - lava_callback - INFO - Received callback for node 69d50fa2932ecfe2320a3f87 INFO: 172.21.0.1:50084 - "POST /node/69d50fa2932ecfe2320a3f87 HTTP/1.0" 202 Accepted 2026-04-09 14:07:48,015 - lava_callback - INFO - Starting async job submit for node 69d50fa2932ecfe2320a3f87 2026-04-09 14:07:48,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:07:48,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50fa2932ecfe2320a3f87 HTTP/1.1" 200 None 2026-04-09 14:07:48,032 - lava_callback - DEBUG - Processing node 69d50fa2932ecfe2320a3f87: baseline-arm64-baylibre 2026-04-09 14:07:48,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50fa2932ecfe2320a3f87 2026-04-09 14:07:48,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:07:48,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50fa2932ecfe2320a3f87 HTTP/1.1" 200 None 2026-04-09 14:07:48,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:07:48,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:07:48,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:07:48,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50fa2932ecfe2320a3f87 HTTP/1.1" 200 None 2026-04-09 14:07:48,124 - lava_callback - ERROR - Error processing callback for node 69d50fa2932ecfe2320a3f87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:08:20,996 - lava_callback - INFO - Received callback for node 69d6dec32cda61b443d5e5d0 INFO: 172.21.0.1:36916 - "POST /node/69d6dec32cda61b443d5e5d0 HTTP/1.0" 202 Accepted 2026-04-09 14:08:21,004 - lava_callback - INFO - Starting async job submit for node 69d6dec32cda61b443d5e5d0 2026-04-09 14:08:21,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:21,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6dec32cda61b443d5e5d0 HTTP/1.1" 200 None 2026-04-09 14:08:21,070 - lava_callback - DEBUG - Processing node 69d6dec32cda61b443d5e5d0: baseline-nfs-arm64 2026-04-09 14:08:21,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:08:21,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:08:21,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6dec32cda61b443d5e5d0/log.txt.gz 2026-04-09 14:08:21,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:08:22,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:08:22,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6dec32cda61b443d5e5d0/lava-logs.yaml 2026-04-09 14:08:22,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:08:22,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:08:22,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6dec32cda61b443d5e5d0/lava_callback.json.gz 2026-04-09 14:08:22,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:22,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6dec32cda61b443d5e5d0 HTTP/1.1" 200 None 2026-04-09 14:08:22,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:22,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 14:08:22,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:22,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d6dec32cda61b443d5e5d0 HTTP/1.1" 200 None 2026-04-09 14:08:22,318 - lava_callback - INFO - Completed processing callback for node 69d6dec32cda61b443d5e5d0 INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:08:48,054 - lava_callback - INFO - Received callback for node 69d50fed932ecfe2320a3fbb INFO: 172.21.0.1:43624 - "POST /node/69d50fed932ecfe2320a3fbb HTTP/1.0" 202 Accepted 2026-04-09 14:08:48,059 - lava_callback - INFO - Starting async job submit for node 69d50fed932ecfe2320a3fbb 2026-04-09 14:08:48,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:48,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50fed932ecfe2320a3fbb HTTP/1.1" 200 None 2026-04-09 14:08:48,077 - lava_callback - DEBUG - Processing node 69d50fed932ecfe2320a3fbb: baseline-arm64-baylibre 2026-04-09 14:08:48,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d50fed932ecfe2320a3fbb 2026-04-09 14:08:48,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:48,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d50fed932ecfe2320a3fbb HTTP/1.1" 200 None 2026-04-09 14:08:48,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:48,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:08:48,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:48,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d50fed932ecfe2320a3fbb HTTP/1.1" 200 None 2026-04-09 14:08:48,127 - lava_callback - ERROR - Error processing callback for node 69d50fed932ecfe2320a3fbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 14:08:50,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:08:50,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:10:08,170 - lava_callback - INFO - Received callback for node 69d51038932ecfe2320a3ff7 INFO: 172.21.0.1:59024 - "POST /node/69d51038932ecfe2320a3ff7 HTTP/1.0" 202 Accepted 2026-04-09 14:10:08,176 - lava_callback - INFO - Starting async job submit for node 69d51038932ecfe2320a3ff7 2026-04-09 14:10:08,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:10:08,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51038932ecfe2320a3ff7 HTTP/1.1" 200 None 2026-04-09 14:10:08,192 - lava_callback - DEBUG - Processing node 69d51038932ecfe2320a3ff7: baseline-arm64-baylibre 2026-04-09 14:10:08,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51038932ecfe2320a3ff7 2026-04-09 14:10:08,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:10:08,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51038932ecfe2320a3ff7 HTTP/1.1" 200 None 2026-04-09 14:10:08,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:10:08,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:10:08,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:10:08,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51038932ecfe2320a3ff7 HTTP/1.1" 200 None 2026-04-09 14:10:08,264 - lava_callback - ERROR - Error processing callback for node 69d51038932ecfe2320a3ff7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:11:28,206 - lava_callback - INFO - Received callback for node 69d51084932ecfe2320a4038 INFO: 172.21.0.1:32800 - "POST /node/69d51084932ecfe2320a4038 HTTP/1.0" 202 Accepted 2026-04-09 14:11:28,212 - lava_callback - INFO - Starting async job submit for node 69d51084932ecfe2320a4038 2026-04-09 14:11:28,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:11:28,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51084932ecfe2320a4038 HTTP/1.1" 200 None 2026-04-09 14:11:28,229 - lava_callback - DEBUG - Processing node 69d51084932ecfe2320a4038: baseline-arm64-baylibre 2026-04-09 14:11:28,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51084932ecfe2320a4038 2026-04-09 14:11:28,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:11:28,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51084932ecfe2320a4038 HTTP/1.1" 200 None 2026-04-09 14:11:28,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:11:28,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:11:28,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:11:28,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51084932ecfe2320a4038 HTTP/1.1" 200 None 2026-04-09 14:11:28,280 - lava_callback - ERROR - Error processing callback for node 69d51084932ecfe2320a4038: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:12:48,251 - lava_callback - INFO - Received callback for node 69d510cb932ecfe2320a406f INFO: 172.21.0.1:44042 - "POST /node/69d510cb932ecfe2320a406f HTTP/1.0" 202 Accepted 2026-04-09 14:12:48,257 - lava_callback - INFO - Starting async job submit for node 69d510cb932ecfe2320a406f 2026-04-09 14:12:48,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:12:48,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d510cb932ecfe2320a406f HTTP/1.1" 200 None 2026-04-09 14:12:48,273 - lava_callback - DEBUG - Processing node 69d510cb932ecfe2320a406f: baseline-arm64-baylibre 2026-04-09 14:12:48,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d510cb932ecfe2320a406f 2026-04-09 14:12:48,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:12:48,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d510cb932ecfe2320a406f HTTP/1.1" 200 None 2026-04-09 14:12:48,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:12:48,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:12:48,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:12:48,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d510cb932ecfe2320a406f HTTP/1.1" 200 None 2026-04-09 14:12:48,322 - lava_callback - ERROR - Error processing callback for node 69d510cb932ecfe2320a406f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:14:48,383 - lava_callback - INFO - Received callback for node 69d51154932ecfe2320a4087 INFO: 172.21.0.1:54932 - "POST /node/69d51154932ecfe2320a4087 HTTP/1.0" 202 Accepted 2026-04-09 14:14:48,388 - lava_callback - INFO - Starting async job submit for node 69d51154932ecfe2320a4087 2026-04-09 14:14:48,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:14:48,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51154932ecfe2320a4087 HTTP/1.1" 200 None 2026-04-09 14:14:48,405 - lava_callback - DEBUG - Processing node 69d51154932ecfe2320a4087: baseline-arm64-clabbe 2026-04-09 14:14:48,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51154932ecfe2320a4087 2026-04-09 14:14:48,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:14:48,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51154932ecfe2320a4087 HTTP/1.1" 200 None 2026-04-09 14:14:48,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:14:48,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:14:48,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:14:48,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51154932ecfe2320a4087 HTTP/1.1" 200 None 2026-04-09 14:14:48,458 - lava_callback - ERROR - Error processing callback for node 69d51154932ecfe2320a4087: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:16:48,450 - lava_callback - INFO - Received callback for node 69d511be932ecfe2320a40d5 INFO: 172.21.0.1:58328 - "POST /node/69d511be932ecfe2320a40d5 HTTP/1.0" 202 Accepted 2026-04-09 14:16:48,456 - lava_callback - INFO - Starting async job submit for node 69d511be932ecfe2320a40d5 2026-04-09 14:16:48,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:16:48,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d511be932ecfe2320a40d5 HTTP/1.1" 200 None 2026-04-09 14:16:48,471 - lava_callback - DEBUG - Processing node 69d511be932ecfe2320a40d5: baseline-arm64-clabbe 2026-04-09 14:16:48,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d511be932ecfe2320a40d5 2026-04-09 14:16:48,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:16:48,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d511be932ecfe2320a40d5 HTTP/1.1" 200 None 2026-04-09 14:16:48,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:16:48,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:16:48,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:16:48,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d511be932ecfe2320a40d5 HTTP/1.1" 200 None 2026-04-09 14:16:48,542 - lava_callback - ERROR - Error processing callback for node 69d511be932ecfe2320a40d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:18:08,489 - lava_callback - INFO - Received callback for node 69d5120e932ecfe2320a4106 INFO: 172.21.0.1:57082 - "POST /node/69d5120e932ecfe2320a4106 HTTP/1.0" 202 Accepted 2026-04-09 14:18:08,494 - lava_callback - INFO - Starting async job submit for node 69d5120e932ecfe2320a4106 2026-04-09 14:18:08,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:18:08,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5120e932ecfe2320a4106 HTTP/1.1" 200 None 2026-04-09 14:18:08,519 - lava_callback - DEBUG - Processing node 69d5120e932ecfe2320a4106: baseline-arm64-clabbe 2026-04-09 14:18:08,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5120e932ecfe2320a4106 2026-04-09 14:18:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:18:08,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5120e932ecfe2320a4106 HTTP/1.1" 200 None 2026-04-09 14:18:08,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:18:08,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:18:08,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:18:08,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5120e932ecfe2320a4106 HTTP/1.1" 200 None 2026-04-09 14:18:08,603 - lava_callback - ERROR - Error processing callback for node 69d5120e932ecfe2320a4106: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:19:28,583 - lava_callback - INFO - Received callback for node 69d51261932ecfe2320a4133 INFO: 172.21.0.1:52020 - "POST /node/69d51261932ecfe2320a4133 HTTP/1.0" 202 Accepted 2026-04-09 14:19:28,589 - lava_callback - INFO - Starting async job submit for node 69d51261932ecfe2320a4133 2026-04-09 14:19:28,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:19:28,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51261932ecfe2320a4133 HTTP/1.1" 200 None 2026-04-09 14:19:28,609 - lava_callback - DEBUG - Processing node 69d51261932ecfe2320a4133: baseline-arm64-clabbe 2026-04-09 14:19:28,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51261932ecfe2320a4133 2026-04-09 14:19:28,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:19:28,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51261932ecfe2320a4133 HTTP/1.1" 200 None 2026-04-09 14:19:28,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:19:28,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:19:28,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:19:28,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51261932ecfe2320a4133 HTTP/1.1" 200 None 2026-04-09 14:19:28,672 - lava_callback - ERROR - Error processing callback for node 69d51261932ecfe2320a4133: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:20:48,619 - lava_callback - INFO - Received callback for node 69d512ad932ecfe2320a4155 INFO: 172.21.0.1:44938 - "POST /node/69d512ad932ecfe2320a4155 HTTP/1.0" 202 Accepted 2026-04-09 14:20:48,625 - lava_callback - INFO - Starting async job submit for node 69d512ad932ecfe2320a4155 2026-04-09 14:20:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:20:48,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d512ad932ecfe2320a4155 HTTP/1.1" 200 None 2026-04-09 14:20:48,641 - lava_callback - DEBUG - Processing node 69d512ad932ecfe2320a4155: baseline-arm64-clabbe 2026-04-09 14:20:48,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d512ad932ecfe2320a4155 2026-04-09 14:20:48,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:20:48,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d512ad932ecfe2320a4155 HTTP/1.1" 200 None 2026-04-09 14:20:48,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:20:48,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:20:48,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:20:48,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d512ad932ecfe2320a4155 HTTP/1.1" 200 None 2026-04-09 14:20:48,688 - lava_callback - ERROR - Error processing callback for node 69d512ad932ecfe2320a4155: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:21:48,691 - lava_callback - INFO - Received callback for node 69d512f8932ecfe2320a4170 INFO: 172.21.0.1:57718 - "POST /node/69d512f8932ecfe2320a4170 HTTP/1.0" 202 Accepted 2026-04-09 14:21:48,697 - lava_callback - INFO - Starting async job submit for node 69d512f8932ecfe2320a4170 2026-04-09 14:21:48,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:21:48,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d512f8932ecfe2320a4170 HTTP/1.1" 200 None 2026-04-09 14:21:48,713 - lava_callback - DEBUG - Processing node 69d512f8932ecfe2320a4170: baseline-arm64-clabbe 2026-04-09 14:21:48,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d512f8932ecfe2320a4170 2026-04-09 14:21:48,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:21:48,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d512f8932ecfe2320a4170 HTTP/1.1" 200 None 2026-04-09 14:21:48,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:21:48,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-09 14:21:48,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:21:48,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d512f8932ecfe2320a4170 HTTP/1.1" 200 None 2026-04-09 14:21:48,770 - lava_callback - ERROR - Error processing callback for node 69d512f8932ecfe2320a4170: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:38:35,708 - lava_callback - INFO - Received callback for node 69d6fd7135ac66e13269ab81 INFO: 172.21.0.1:33510 - "POST /node/69d6fd7135ac66e13269ab81 HTTP/1.0" 202 Accepted 2026-04-09 14:38:35,715 - lava_callback - INFO - Starting async job submit for node 69d6fd7135ac66e13269ab81 2026-04-09 14:38:35,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:35,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd7135ac66e13269ab81 HTTP/1.1" 200 None 2026-04-09 14:38:35,754 - lava_callback - DEBUG - Processing node 69d6fd7135ac66e13269ab81: baseline-arm64 2026-04-09 14:38:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:38:36,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:38:36,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6fd7135ac66e13269ab81/log.txt.gz INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:38:36,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:38:36,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:38:36,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6fd7135ac66e13269ab81/lava-logs.yaml 2026-04-09 14:38:36,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:38:37,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:38:37,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d6fd7135ac66e13269ab81/lava_callback.json.gz 2026-04-09 14:38:37,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:37,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd7135ac66e13269ab81 HTTP/1.1" 200 None 2026-04-09 14:38:37,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:37,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-09 14:38:37,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:37,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d6fd7135ac66e13269ab81 HTTP/1.1" 200 None 2026-04-09 14:38:37,244 - lava_callback - INFO - Completed processing callback for node 69d6fd7135ac66e13269ab81 INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:38:49,988 - lava_callback - INFO - Received callback for node 69d516f6932ecfe2320a4221 INFO: 172.21.0.1:44542 - "POST /node/69d516f6932ecfe2320a4221 HTTP/1.0" 202 Accepted 2026-04-09 14:38:49,994 - lava_callback - INFO - Starting async job submit for node 69d516f6932ecfe2320a4221 2026-04-09 14:38:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:50,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d516f6932ecfe2320a4221 HTTP/1.1" 200 None 2026-04-09 14:38:50,011 - lava_callback - DEBUG - Processing node 69d516f6932ecfe2320a4221: baseline-arm-baylibre 2026-04-09 14:38:50,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d516f6932ecfe2320a4221 2026-04-09 14:38:50,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:50,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d516f6932ecfe2320a4221 HTTP/1.1" 200 None 2026-04-09 14:38:50,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:50,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:38:50,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:50,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d516f6932ecfe2320a4221 HTTP/1.1" 200 None 2026-04-09 14:38:50,066 - lava_callback - ERROR - Error processing callback for node 69d516f6932ecfe2320a4221: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 14:38:50,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:38:50,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:39:29,634 - lava_callback - INFO - Received callback for node 69d51715932ecfe2320a4256 INFO: 172.21.0.1:57296 - "POST /node/69d51715932ecfe2320a4256 HTTP/1.0" 202 Accepted 2026-04-09 14:39:29,640 - lava_callback - INFO - Starting async job submit for node 69d51715932ecfe2320a4256 2026-04-09 14:39:29,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:39:29,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51715932ecfe2320a4256 HTTP/1.1" 200 None 2026-04-09 14:39:29,663 - lava_callback - DEBUG - Processing node 69d51715932ecfe2320a4256: baseline-arm-baylibre 2026-04-09 14:39:29,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51715932ecfe2320a4256 2026-04-09 14:39:29,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:39:29,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51715932ecfe2320a4256 HTTP/1.1" 200 None 2026-04-09 14:39:29,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:39:29,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:39:29,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:39:29,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51715932ecfe2320a4256 HTTP/1.1" 200 None 2026-04-09 14:39:29,729 - lava_callback - ERROR - Error processing callback for node 69d51715932ecfe2320a4256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:40:09,756 - lava_callback - INFO - Received callback for node 69d51738932ecfe2320a4277 INFO: 172.21.0.1:51242 - "POST /node/69d51738932ecfe2320a4277 HTTP/1.0" 202 Accepted 2026-04-09 14:40:09,763 - lava_callback - INFO - Starting async job submit for node 69d51738932ecfe2320a4277 2026-04-09 14:40:09,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:09,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51738932ecfe2320a4277 HTTP/1.1" 200 None 2026-04-09 14:40:09,779 - lava_callback - DEBUG - Processing node 69d51738932ecfe2320a4277: baseline-arm-baylibre 2026-04-09 14:40:09,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51738932ecfe2320a4277 2026-04-09 14:40:09,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:09,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51738932ecfe2320a4277 HTTP/1.1" 200 None 2026-04-09 14:40:09,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:09,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:40:09,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:09,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51738932ecfe2320a4277 HTTP/1.1" 200 None 2026-04-09 14:40:09,833 - lava_callback - ERROR - Error processing callback for node 69d51738932ecfe2320a4277: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:40:29,677 - lava_callback - INFO - Received callback for node 69d5175a932ecfe2320a4289 INFO: 172.21.0.1:53360 - "POST /node/69d5175a932ecfe2320a4289 HTTP/1.0" 202 Accepted 2026-04-09 14:40:29,683 - lava_callback - INFO - Starting async job submit for node 69d5175a932ecfe2320a4289 2026-04-09 14:40:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:29,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5175a932ecfe2320a4289 HTTP/1.1" 200 None 2026-04-09 14:40:29,708 - lava_callback - DEBUG - Processing node 69d5175a932ecfe2320a4289: baseline-arm-baylibre 2026-04-09 14:40:29,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5175a932ecfe2320a4289 2026-04-09 14:40:29,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:29,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5175a932ecfe2320a4289 HTTP/1.1" 200 None 2026-04-09 14:40:29,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:29,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:40:29,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:40:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5175a932ecfe2320a4289 HTTP/1.1" 200 None 2026-04-09 14:40:29,770 - lava_callback - ERROR - Error processing callback for node 69d5175a932ecfe2320a4289: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:41:09,769 - lava_callback - INFO - Received callback for node 69d5177f932ecfe2320a42ab INFO: 172.21.0.1:47504 - "POST /node/69d5177f932ecfe2320a42ab HTTP/1.0" 202 Accepted 2026-04-09 14:41:09,775 - lava_callback - INFO - Starting async job submit for node 69d5177f932ecfe2320a42ab 2026-04-09 14:41:09,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:41:09,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5177f932ecfe2320a42ab HTTP/1.1" 200 None 2026-04-09 14:41:09,791 - lava_callback - DEBUG - Processing node 69d5177f932ecfe2320a42ab: baseline-arm-baylibre 2026-04-09 14:41:09,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5177f932ecfe2320a42ab 2026-04-09 14:41:09,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:41:09,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5177f932ecfe2320a42ab HTTP/1.1" 200 None 2026-04-09 14:41:09,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:41:09,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:41:09,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:41:09,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5177f932ecfe2320a42ab HTTP/1.1" 200 None 2026-04-09 14:41:09,858 - lava_callback - ERROR - Error processing callback for node 69d5177f932ecfe2320a42ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:42:10,127 - lava_callback - INFO - Received callback for node 69d6fd8335ac66e13269abc0 INFO: 172.21.0.1:37382 - "POST /node/69d6fd8335ac66e13269abc0 HTTP/1.0" 202 Accepted 2026-04-09 14:42:10,134 - lava_callback - INFO - Starting async job submit for node 69d6fd8335ac66e13269abc0 2026-04-09 14:42:10,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:10,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd8335ac66e13269abc0 HTTP/1.1" 200 None 2026-04-09 14:42:10,182 - lava_callback - DEBUG - Processing node 69d6fd8335ac66e13269abc0: baseline-nfs-arm64 2026-04-09 14:42:10,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:42:10,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:42:11,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6fd8335ac66e13269abc0/log.txt.gz 2026-04-09 14:42:11,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:42:11,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:42:11,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6fd8335ac66e13269abc0/lava-logs.yaml 2026-04-09 14:42:11,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:42:11,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:42:11,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d6fd8335ac66e13269abc0/lava_callback.json.gz 2026-04-09 14:42:11,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:11,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6fd8335ac66e13269abc0 HTTP/1.1" 200 None 2026-04-09 14:42:11,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:11,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-09 14:42:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:11,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d6fd8335ac66e13269abc0 HTTP/1.1" 200 None 2026-04-09 14:42:11,816 - lava_callback - INFO - Completed processing callback for node 69d6fd8335ac66e13269abc0 INFO: 172.21.0.1:37392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:42:20,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:20,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:42:49,676 - lava_callback - INFO - Received callback for node 69d517e4932ecfe2320a4314 INFO: 172.21.0.1:48418 - "POST /node/69d517e4932ecfe2320a4314 HTTP/1.0" 202 Accepted 2026-04-09 14:42:49,683 - lava_callback - INFO - Starting async job submit for node 69d517e4932ecfe2320a4314 2026-04-09 14:42:49,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:49,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d517e4932ecfe2320a4314 HTTP/1.1" 200 None 2026-04-09 14:42:49,700 - lava_callback - DEBUG - Processing node 69d517e4932ecfe2320a4314: baseline-arm-clabbe 2026-04-09 14:42:49,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d517e4932ecfe2320a4314 2026-04-09 14:42:49,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:49,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d517e4932ecfe2320a4314 HTTP/1.1" 200 None 2026-04-09 14:42:49,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:42:49,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:42:49,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d517e4932ecfe2320a4314 HTTP/1.1" 200 None 2026-04-09 14:42:49,771 - lava_callback - ERROR - Error processing callback for node 69d517e4932ecfe2320a4314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:43:29,695 - lava_callback - INFO - Received callback for node 69d51805932ecfe2320a432f INFO: 172.21.0.1:32898 - "POST /node/69d51805932ecfe2320a432f HTTP/1.0" 202 Accepted 2026-04-09 14:43:29,704 - lava_callback - INFO - Starting async job submit for node 69d51805932ecfe2320a432f 2026-04-09 14:43:29,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:43:29,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51805932ecfe2320a432f HTTP/1.1" 200 None 2026-04-09 14:43:29,720 - lava_callback - DEBUG - Processing node 69d51805932ecfe2320a432f: baseline-arm-clabbe 2026-04-09 14:43:29,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51805932ecfe2320a432f 2026-04-09 14:43:29,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:43:29,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51805932ecfe2320a432f HTTP/1.1" 200 None 2026-04-09 14:43:29,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:43:29,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:43:29,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:43:29,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51805932ecfe2320a432f HTTP/1.1" 200 None 2026-04-09 14:43:29,772 - lava_callback - ERROR - Error processing callback for node 69d51805932ecfe2320a432f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:44:09,700 - lava_callback - INFO - Received callback for node 69d51824932ecfe2320a435e INFO: 172.21.0.1:57280 - "POST /node/69d51824932ecfe2320a435e HTTP/1.0" 202 Accepted 2026-04-09 14:44:09,709 - lava_callback - INFO - Starting async job submit for node 69d51824932ecfe2320a435e 2026-04-09 14:44:09,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:09,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51824932ecfe2320a435e HTTP/1.1" 200 None 2026-04-09 14:44:09,731 - lava_callback - DEBUG - Processing node 69d51824932ecfe2320a435e: baseline-arm-clabbe 2026-04-09 14:44:09,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51824932ecfe2320a435e 2026-04-09 14:44:09,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:09,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51824932ecfe2320a435e HTTP/1.1" 200 None 2026-04-09 14:44:09,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:09,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:44:09,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:09,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51824932ecfe2320a435e HTTP/1.1" 200 None 2026-04-09 14:44:09,789 - lava_callback - ERROR - Error processing callback for node 69d51824932ecfe2320a435e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:44:20,820 - lava_callback - INFO - Received callback for node 69d7030b50e7993d3c1433ab INFO: 172.21.0.1:49418 - "POST /node/69d7030b50e7993d3c1433ab HTTP/1.0" 202 Accepted 2026-04-09 14:44:20,826 - lava_callback - INFO - Starting async job submit for node 69d7030b50e7993d3c1433ab 2026-04-09 14:44:20,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:20,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7030b50e7993d3c1433ab HTTP/1.1" 200 None 2026-04-09 14:44:20,859 - lava_callback - DEBUG - Processing node 69d7030b50e7993d3c1433ab: baseline-x86 2026-04-09 14:44:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:44:21,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:44:21,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d7030b50e7993d3c1433ab/log.txt.gz 2026-04-09 14:44:21,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:44:21,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:44:21,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d7030b50e7993d3c1433ab/lava-logs.yaml 2026-04-09 14:44:21,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:44:21,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:44:21,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d7030b50e7993d3c1433ab/lava_callback.json.gz 2026-04-09 14:44:21,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:21,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7030b50e7993d3c1433ab HTTP/1.1" 200 None 2026-04-09 14:44:21,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:22,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f3bdf16ca753839b3459 HTTP/1.1" 200 None 2026-04-09 14:44:22,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:22,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7030b50e7993d3c1433ab HTTP/1.1" 200 None 2026-04-09 14:44:22,042 - lava_callback - INFO - Completed processing callback for node 69d7030b50e7993d3c1433ab INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:44:29,746 - lava_callback - INFO - Received callback for node 69d51847932ecfe2320a4380 INFO: 172.21.0.1:53106 - "POST /node/69d51847932ecfe2320a4380 HTTP/1.0" 202 Accepted 2026-04-09 14:44:29,752 - lava_callback - INFO - Starting async job submit for node 69d51847932ecfe2320a4380 2026-04-09 14:44:29,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51847932ecfe2320a4380 HTTP/1.1" 200 None 2026-04-09 14:44:29,770 - lava_callback - DEBUG - Processing node 69d51847932ecfe2320a4380: baseline-arm-clabbe 2026-04-09 14:44:29,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51847932ecfe2320a4380 2026-04-09 14:44:29,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:29,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51847932ecfe2320a4380 HTTP/1.1" 200 None 2026-04-09 14:44:29,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:29,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:44:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:29,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51847932ecfe2320a4380 HTTP/1.1" 200 None 2026-04-09 14:44:29,817 - lava_callback - ERROR - Error processing callback for node 69d51847932ecfe2320a4380: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:44:50,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:44:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:45:09,686 - lava_callback - INFO - Received callback for node 69d5186c932ecfe2320a439d INFO: 172.21.0.1:56074 - "POST /node/69d5186c932ecfe2320a439d HTTP/1.0" 202 Accepted 2026-04-09 14:45:09,692 - lava_callback - INFO - Starting async job submit for node 69d5186c932ecfe2320a439d 2026-04-09 14:45:09,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:09,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5186c932ecfe2320a439d HTTP/1.1" 200 None 2026-04-09 14:45:09,708 - lava_callback - DEBUG - Processing node 69d5186c932ecfe2320a439d: baseline-arm-clabbe 2026-04-09 14:45:09,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5186c932ecfe2320a439d 2026-04-09 14:45:09,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:09,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5186c932ecfe2320a439d HTTP/1.1" 200 None 2026-04-09 14:45:09,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:09,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:45:09,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:09,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5186c932ecfe2320a439d HTTP/1.1" 200 None 2026-04-09 14:45:09,759 - lava_callback - ERROR - Error processing callback for node 69d5186c932ecfe2320a439d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:45:49,729 - lava_callback - INFO - Received callback for node 69d51890932ecfe2320a43bd INFO: 172.21.0.1:39918 - "POST /node/69d51890932ecfe2320a43bd HTTP/1.0" 202 Accepted 2026-04-09 14:45:49,734 - lava_callback - INFO - Starting async job submit for node 69d51890932ecfe2320a43bd 2026-04-09 14:45:49,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:49,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51890932ecfe2320a43bd HTTP/1.1" 200 None 2026-04-09 14:45:49,758 - lava_callback - DEBUG - Processing node 69d51890932ecfe2320a43bd: baseline-arm-clabbe 2026-04-09 14:45:49,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51890932ecfe2320a43bd 2026-04-09 14:45:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:49,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51890932ecfe2320a43bd HTTP/1.1" 200 None 2026-04-09 14:45:49,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:49,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:45:49,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:45:49,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51890932ecfe2320a43bd HTTP/1.1" 200 None 2026-04-09 14:45:49,807 - lava_callback - ERROR - Error processing callback for node 69d51890932ecfe2320a43bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:46:29,799 - lava_callback - INFO - Received callback for node 69d518b4932ecfe2320a43d9 INFO: 172.21.0.1:48600 - "POST /node/69d518b4932ecfe2320a43d9 HTTP/1.0" 202 Accepted 2026-04-09 14:46:29,808 - lava_callback - INFO - Starting async job submit for node 69d518b4932ecfe2320a43d9 2026-04-09 14:46:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:29,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518b4932ecfe2320a43d9 HTTP/1.1" 200 None 2026-04-09 14:46:29,841 - lava_callback - DEBUG - Processing node 69d518b4932ecfe2320a43d9: baseline-arm-clabbe 2026-04-09 14:46:29,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d518b4932ecfe2320a43d9 2026-04-09 14:46:29,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:29,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518b4932ecfe2320a43d9 HTTP/1.1" 200 None 2026-04-09 14:46:29,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:29,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:46:29,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:29,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d518b4932ecfe2320a43d9 HTTP/1.1" 200 None 2026-04-09 14:46:29,916 - lava_callback - ERROR - Error processing callback for node 69d518b4932ecfe2320a43d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:46:47,603 - lava_callback - INFO - Received callback for node 69d707e450e7993d3c143cf3 INFO: 172.21.0.1:43394 - "POST /node/69d707e450e7993d3c143cf3 HTTP/1.0" 202 Accepted 2026-04-09 14:46:47,609 - lava_callback - INFO - Starting async job submit for node 69d707e450e7993d3c143cf3 2026-04-09 14:46:47,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:47,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d707e450e7993d3c143cf3 HTTP/1.1" 200 None 2026-04-09 14:46:47,642 - lava_callback - DEBUG - Processing node 69d707e450e7993d3c143cf3: baseline-x86 2026-04-09 14:46:47,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:46:48,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:46:48,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d707e450e7993d3c143cf3/log.txt.gz 2026-04-09 14:46:48,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:46:48,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:46:48,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d707e450e7993d3c143cf3/lava-logs.yaml 2026-04-09 14:46:48,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:46:48,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:46:48,550 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d707e450e7993d3c143cf3/lava_callback.json.gz 2026-04-09 14:46:48,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:48,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d707e450e7993d3c143cf3 HTTP/1.1" 200 None 2026-04-09 14:46:48,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:48,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702fa50e7993d3c143379 HTTP/1.1" 200 None 2026-04-09 14:46:48,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:48,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d707e450e7993d3c143cf3 HTTP/1.1" 200 None 2026-04-09 14:46:48,619 - lava_callback - INFO - Completed processing callback for node 69d707e450e7993d3c143cf3 2026-04-09 14:46:50,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:46:50,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:47:09,792 - lava_callback - INFO - Received callback for node 69d518da932ecfe2320a43e8 INFO: 172.21.0.1:48970 - "POST /node/69d518da932ecfe2320a43e8 HTTP/1.0" 202 Accepted 2026-04-09 14:47:09,801 - lava_callback - INFO - Starting async job submit for node 69d518da932ecfe2320a43e8 2026-04-09 14:47:09,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:09,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518da932ecfe2320a43e8 HTTP/1.1" 200 None 2026-04-09 14:47:09,821 - lava_callback - DEBUG - Processing node 69d518da932ecfe2320a43e8: baseline-arm-clabbe 2026-04-09 14:47:09,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d518da932ecfe2320a43e8 2026-04-09 14:47:09,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:09,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518da932ecfe2320a43e8 HTTP/1.1" 200 None 2026-04-09 14:47:09,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:09,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:47:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:09,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d518da932ecfe2320a43e8 HTTP/1.1" 200 None 2026-04-09 14:47:09,878 - lava_callback - ERROR - Error processing callback for node 69d518da932ecfe2320a43e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:47:29,850 - lava_callback - INFO - Received callback for node 69d518fe932ecfe2320a43fe INFO: 172.21.0.1:47744 - "POST /node/69d518fe932ecfe2320a43fe HTTP/1.0" 202 Accepted 2026-04-09 14:47:29,857 - lava_callback - INFO - Starting async job submit for node 69d518fe932ecfe2320a43fe 2026-04-09 14:47:29,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:29,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518fe932ecfe2320a43fe HTTP/1.1" 200 None 2026-04-09 14:47:29,871 - lava_callback - DEBUG - Processing node 69d518fe932ecfe2320a43fe: baseline-arm-clabbe 2026-04-09 14:47:29,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d518fe932ecfe2320a43fe 2026-04-09 14:47:29,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:29,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d518fe932ecfe2320a43fe HTTP/1.1" 200 None 2026-04-09 14:47:29,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:29,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-09 14:47:29,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:47:29,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d518fe932ecfe2320a43fe HTTP/1.1" 200 None 2026-04-09 14:47:29,924 - lava_callback - ERROR - Error processing callback for node 69d518fe932ecfe2320a43fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:48:10,253 - lava_callback - INFO - Received callback for node 69d5191f932ecfe2320a4418 INFO: 172.21.0.1:48364 - "POST /node/69d5191f932ecfe2320a4418 HTTP/1.0" 202 Accepted 2026-04-09 14:48:10,258 - lava_callback - INFO - Starting async job submit for node 69d5191f932ecfe2320a4418 2026-04-09 14:48:10,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:10,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5191f932ecfe2320a4418 HTTP/1.1" 200 None 2026-04-09 14:48:10,278 - lava_callback - DEBUG - Processing node 69d5191f932ecfe2320a4418: baseline-arm-baylibre 2026-04-09 14:48:10,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5191f932ecfe2320a4418 2026-04-09 14:48:10,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:10,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5191f932ecfe2320a4418 HTTP/1.1" 200 None 2026-04-09 14:48:10,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:10,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:48:10,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:10,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5191f932ecfe2320a4418 HTTP/1.1" 200 None 2026-04-09 14:48:10,333 - lava_callback - ERROR - Error processing callback for node 69d5191f932ecfe2320a4418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:48:50,167 - lava_callback - INFO - Received callback for node 69d5193f932ecfe2320a4429 INFO: 172.21.0.1:40152 - "POST /node/69d5193f932ecfe2320a4429 HTTP/1.0" 202 Accepted 2026-04-09 14:48:50,173 - lava_callback - INFO - Starting async job submit for node 69d5193f932ecfe2320a4429 2026-04-09 14:48:50,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:50,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5193f932ecfe2320a4429 HTTP/1.1" 200 None 2026-04-09 14:48:50,194 - lava_callback - DEBUG - Processing node 69d5193f932ecfe2320a4429: baseline-arm-baylibre 2026-04-09 14:48:50,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5193f932ecfe2320a4429 2026-04-09 14:48:50,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:50,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5193f932ecfe2320a4429 HTTP/1.1" 200 None 2026-04-09 14:48:50,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:50,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:48:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:48:50,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5193f932ecfe2320a4429 HTTP/1.1" 200 None 2026-04-09 14:48:50,247 - lava_callback - ERROR - Error processing callback for node 69d5193f932ecfe2320a4429: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:49:10,171 - lava_callback - INFO - Received callback for node 69d51962932ecfe2320a445c INFO: 172.21.0.1:54324 - "POST /node/69d51962932ecfe2320a445c HTTP/1.0" 202 Accepted 2026-04-09 14:49:10,179 - lava_callback - INFO - Starting async job submit for node 69d51962932ecfe2320a445c 2026-04-09 14:49:10,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:49:10,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51962932ecfe2320a445c HTTP/1.1" 200 None 2026-04-09 14:49:10,198 - lava_callback - DEBUG - Processing node 69d51962932ecfe2320a445c: baseline-arm-baylibre 2026-04-09 14:49:10,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51962932ecfe2320a445c 2026-04-09 14:49:10,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:49:10,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51962932ecfe2320a445c HTTP/1.1" 200 None 2026-04-09 14:49:10,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:49:10,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:49:10,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:49:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51962932ecfe2320a445c HTTP/1.1" 200 None 2026-04-09 14:49:10,263 - lava_callback - ERROR - Error processing callback for node 69d51962932ecfe2320a445c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:50:09,962 - lava_callback - INFO - Received callback for node 69d5198c932ecfe2320a447e INFO: 172.21.0.1:39362 - "POST /node/69d5198c932ecfe2320a447e HTTP/1.0" 202 Accepted 2026-04-09 14:50:09,970 - lava_callback - INFO - Starting async job submit for node 69d5198c932ecfe2320a447e 2026-04-09 14:50:09,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:09,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5198c932ecfe2320a447e HTTP/1.1" 200 None 2026-04-09 14:50:09,993 - lava_callback - DEBUG - Processing node 69d5198c932ecfe2320a447e: baseline-arm-clabbe 2026-04-09 14:50:09,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5198c932ecfe2320a447e 2026-04-09 14:50:09,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:10,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5198c932ecfe2320a447e HTTP/1.1" 200 None 2026-04-09 14:50:10,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:10,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:50:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:10,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5198c932ecfe2320a447e HTTP/1.1" 200 None 2026-04-09 14:50:10,056 - lava_callback - ERROR - Error processing callback for node 69d5198c932ecfe2320a447e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:50:22,953 - lava_callback - INFO - Received callback for node 69d7062e50e7993d3c143806 INFO: 172.21.0.1:36898 - "POST /node/69d7062e50e7993d3c143806 HTTP/1.0" 202 Accepted 2026-04-09 14:50:22,960 - lava_callback - INFO - Starting async job submit for node 69d7062e50e7993d3c143806 2026-04-09 14:50:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7062e50e7993d3c143806 HTTP/1.1" 200 None 2026-04-09 14:50:23,004 - lava_callback - DEBUG - Processing node 69d7062e50e7993d3c143806: baseline-arm64 2026-04-09 14:50:23,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:50:23,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:50:23,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7062e50e7993d3c143806/log.txt.gz 2026-04-09 14:50:23,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:50:24,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:50:24,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7062e50e7993d3c143806/lava-logs.yaml 2026-04-09 14:50:24,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:50:24,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:50:24,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7062e50e7993d3c143806/lava_callback.json.gz 2026-04-09 14:50:24,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:24,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7062e50e7993d3c143806 HTTP/1.1" 200 None 2026-04-09 14:50:24,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:24,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-09 14:50:24,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:24,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7062e50e7993d3c143806 HTTP/1.1" 200 None 2026-04-09 14:50:24,674 - lava_callback - INFO - Completed processing callback for node 69d7062e50e7993d3c143806 INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:50:29,954 - lava_callback - INFO - Received callback for node 69d519aa932ecfe2320a44a8 INFO: 172.21.0.1:36226 - "POST /node/69d519aa932ecfe2320a44a8 HTTP/1.0" 202 Accepted 2026-04-09 14:50:29,960 - lava_callback - INFO - Starting async job submit for node 69d519aa932ecfe2320a44a8 2026-04-09 14:50:29,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:29,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519aa932ecfe2320a44a8 HTTP/1.1" 200 None 2026-04-09 14:50:29,975 - lava_callback - DEBUG - Processing node 69d519aa932ecfe2320a44a8: baseline-arm-clabbe 2026-04-09 14:50:29,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d519aa932ecfe2320a44a8 2026-04-09 14:50:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519aa932ecfe2320a44a8 HTTP/1.1" 200 None 2026-04-09 14:50:29,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:30,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:50:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:30,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d519aa932ecfe2320a44a8 HTTP/1.1" 200 None 2026-04-09 14:50:30,024 - lava_callback - ERROR - Error processing callback for node 69d519aa932ecfe2320a44a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:50:50,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:50:50,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:51:10,080 - lava_callback - INFO - Received callback for node 69d519cb932ecfe2320a44ce INFO: 172.21.0.1:48558 - "POST /node/69d519cb932ecfe2320a44ce HTTP/1.0" 202 Accepted 2026-04-09 14:51:10,085 - lava_callback - INFO - Starting async job submit for node 69d519cb932ecfe2320a44ce 2026-04-09 14:51:10,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:10,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519cb932ecfe2320a44ce HTTP/1.1" 200 None 2026-04-09 14:51:10,108 - lava_callback - DEBUG - Processing node 69d519cb932ecfe2320a44ce: baseline-arm-clabbe 2026-04-09 14:51:10,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d519cb932ecfe2320a44ce 2026-04-09 14:51:10,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:10,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519cb932ecfe2320a44ce HTTP/1.1" 200 None 2026-04-09 14:51:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:51:10,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:10,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d519cb932ecfe2320a44ce HTTP/1.1" 200 None 2026-04-09 14:51:10,161 - lava_callback - ERROR - Error processing callback for node 69d519cb932ecfe2320a44ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:51:30,329 - lava_callback - INFO - Received callback for node 69d519e9932ecfe2320a44e4 INFO: 172.21.0.1:46308 - "POST /node/69d519e9932ecfe2320a44e4 HTTP/1.0" 202 Accepted 2026-04-09 14:51:30,335 - lava_callback - INFO - Starting async job submit for node 69d519e9932ecfe2320a44e4 2026-04-09 14:51:30,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:30,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519e9932ecfe2320a44e4 HTTP/1.1" 200 None 2026-04-09 14:51:30,351 - lava_callback - DEBUG - Processing node 69d519e9932ecfe2320a44e4: baseline-arm-baylibre 2026-04-09 14:51:30,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d519e9932ecfe2320a44e4 2026-04-09 14:51:30,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:30,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d519e9932ecfe2320a44e4 HTTP/1.1" 200 None 2026-04-09 14:51:30,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:30,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:51:30,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:51:30,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d519e9932ecfe2320a44e4 HTTP/1.1" 200 None 2026-04-09 14:51:30,401 - lava_callback - ERROR - Error processing callback for node 69d519e9932ecfe2320a44e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:53:10,101 - lava_callback - INFO - Received callback for node 69d51a51932ecfe2320a451f INFO: 172.21.0.1:56934 - "POST /node/69d51a51932ecfe2320a451f HTTP/1.0" 202 Accepted 2026-04-09 14:53:10,110 - lava_callback - INFO - Starting async job submit for node 69d51a51932ecfe2320a451f 2026-04-09 14:53:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:10,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a51932ecfe2320a451f HTTP/1.1" 200 None 2026-04-09 14:53:10,126 - lava_callback - DEBUG - Processing node 69d51a51932ecfe2320a451f: baseline-arm-clabbe 2026-04-09 14:53:10,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51a51932ecfe2320a451f 2026-04-09 14:53:10,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:10,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a51932ecfe2320a451f HTTP/1.1" 200 None 2026-04-09 14:53:10,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:10,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:53:10,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:10,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51a51932ecfe2320a451f HTTP/1.1" 200 None 2026-04-09 14:53:10,188 - lava_callback - ERROR - Error processing callback for node 69d51a51932ecfe2320a451f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:53:50,096 - lava_callback - INFO - Received callback for node 69d51a73932ecfe2320a453e INFO: 172.21.0.1:32922 - "POST /node/69d51a73932ecfe2320a453e HTTP/1.0" 202 Accepted 2026-04-09 14:53:50,102 - lava_callback - INFO - Starting async job submit for node 69d51a73932ecfe2320a453e 2026-04-09 14:53:50,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:50,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a73932ecfe2320a453e HTTP/1.1" 200 None 2026-04-09 14:53:50,117 - lava_callback - DEBUG - Processing node 69d51a73932ecfe2320a453e: baseline-arm-clabbe 2026-04-09 14:53:50,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51a73932ecfe2320a453e 2026-04-09 14:53:50,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:50,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a73932ecfe2320a453e HTTP/1.1" 200 None 2026-04-09 14:53:50,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:50,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:53:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:53:50,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51a73932ecfe2320a453e HTTP/1.1" 200 None 2026-04-09 14:53:50,174 - lava_callback - ERROR - Error processing callback for node 69d51a73932ecfe2320a453e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:54:30,521 - lava_callback - INFO - Received callback for node 69d51a94932ecfe2320a454f INFO: 172.21.0.1:60254 - "POST /node/69d51a94932ecfe2320a454f HTTP/1.0" 202 Accepted 2026-04-09 14:54:30,527 - lava_callback - INFO - Starting async job submit for node 69d51a94932ecfe2320a454f 2026-04-09 14:54:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:30,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a94932ecfe2320a454f HTTP/1.1" 200 None 2026-04-09 14:54:30,544 - lava_callback - DEBUG - Processing node 69d51a94932ecfe2320a454f: baseline-arm-baylibre 2026-04-09 14:54:30,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51a94932ecfe2320a454f 2026-04-09 14:54:30,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51a94932ecfe2320a454f HTTP/1.1" 200 None 2026-04-09 14:54:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:30,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:54:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:30,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51a94932ecfe2320a454f HTTP/1.1" 200 None 2026-04-09 14:54:30,592 - lava_callback - ERROR - Error processing callback for node 69d51a94932ecfe2320a454f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:54:48,926 - lava_callback - INFO - Received callback for node 69d7064450e7993d3c143869 INFO: 172.21.0.1:49252 - "POST /node/69d7064450e7993d3c143869 HTTP/1.0" 202 Accepted 2026-04-09 14:54:48,933 - lava_callback - INFO - Starting async job submit for node 69d7064450e7993d3c143869 2026-04-09 14:54:48,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:48,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7064450e7993d3c143869 HTTP/1.1" 200 None 2026-04-09 14:54:48,974 - lava_callback - DEBUG - Processing node 69d7064450e7993d3c143869: baseline-nfs-arm64 2026-04-09 14:54:49,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:54:49,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:54:49,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7064450e7993d3c143869/log.txt.gz 2026-04-09 14:54:49,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:54:50,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:54:50,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7064450e7993d3c143869/lava-logs.yaml 2026-04-09 14:54:50,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 14:54:50,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 14:54:50,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7064450e7993d3c143869/lava_callback.json.gz 2026-04-09 14:54:50,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7064450e7993d3c143869 HTTP/1.1" 200 None 2026-04-09 14:54:50,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-09 14:54:50,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,433 - lava_callback - INFO - Received callback for node 69d51ab6932ecfe2320a4569 2026-04-09 14:54:50,439 - lava_callback - INFO - Starting async job submit for node 69d51ab6932ecfe2320a4569 INFO: 172.21.0.1:51508 - "POST /node/69d51ab6932ecfe2320a4569 HTTP/1.0" 202 Accepted 2026-04-09 14:54:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7064450e7993d3c143869 HTTP/1.1" 200 None 2026-04-09 14:54:50,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51ab6932ecfe2320a4569 HTTP/1.1" 200 None 2026-04-09 14:54:50,506 - lava_callback - DEBUG - Processing node 69d51ab6932ecfe2320a4569: baseline-arm-baylibre 2026-04-09 14:54:50,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51ab6932ecfe2320a4569 2026-04-09 14:54:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,546 - lava_callback - INFO - Completed processing callback for node 69d7064450e7993d3c143869 2026-04-09 14:54:50,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51ab6932ecfe2320a4569 HTTP/1.1" 200 None 2026-04-09 14:54:50,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:54:50,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:54:50,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51ab6932ecfe2320a4569 HTTP/1.1" 200 None 2026-04-09 14:54:50,644 - lava_callback - ERROR - Error processing callback for node 69d51ab6932ecfe2320a4569: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:55:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:55:20,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:55:30,194 - lava_callback - INFO - Received callback for node 69d51ad5932ecfe2320a4598 INFO: 172.21.0.1:39954 - "POST /node/69d51ad5932ecfe2320a4598 HTTP/1.0" 202 Accepted 2026-04-09 14:55:30,204 - lava_callback - INFO - Starting async job submit for node 69d51ad5932ecfe2320a4598 2026-04-09 14:55:30,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:55:30,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51ad5932ecfe2320a4598 HTTP/1.1" 200 None 2026-04-09 14:55:30,232 - lava_callback - DEBUG - Processing node 69d51ad5932ecfe2320a4598: baseline-arm-clabbe 2026-04-09 14:55:30,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51ad5932ecfe2320a4598 2026-04-09 14:55:30,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:55:30,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51ad5932ecfe2320a4598 HTTP/1.1" 200 None 2026-04-09 14:55:30,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:55:30,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:55:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:55:30,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51ad5932ecfe2320a4598 HTTP/1.1" 200 None 2026-04-09 14:55:30,284 - lava_callback - ERROR - Error processing callback for node 69d51ad5932ecfe2320a4598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:57:11,137 - lava_callback - INFO - Received callback for node 69d51b34932ecfe2320a45d1 INFO: 172.21.0.1:49796 - "POST /node/69d51b34932ecfe2320a45d1 HTTP/1.0" 202 Accepted 2026-04-09 14:57:11,143 - lava_callback - INFO - Starting async job submit for node 69d51b34932ecfe2320a45d1 2026-04-09 14:57:11,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:57:11,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b34932ecfe2320a45d1 HTTP/1.1" 200 None 2026-04-09 14:57:11,160 - lava_callback - DEBUG - Processing node 69d51b34932ecfe2320a45d1: baseline-arm-baylibre 2026-04-09 14:57:11,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51b34932ecfe2320a45d1 2026-04-09 14:57:11,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:57:11,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b34932ecfe2320a45d1 HTTP/1.1" 200 None 2026-04-09 14:57:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:57:11,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:57:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:57:11,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51b34932ecfe2320a45d1 HTTP/1.1" 200 None 2026-04-09 14:57:11,238 - lava_callback - ERROR - Error processing callback for node 69d51b34932ecfe2320a45d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:58:10,306 - lava_callback - INFO - Received callback for node 69d51b7f932ecfe2320a45ec INFO: 172.21.0.1:37388 - "POST /node/69d51b7f932ecfe2320a45ec HTTP/1.0" 202 Accepted 2026-04-09 14:58:10,311 - lava_callback - INFO - Starting async job submit for node 69d51b7f932ecfe2320a45ec 2026-04-09 14:58:10,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:10,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b7f932ecfe2320a45ec HTTP/1.1" 200 None 2026-04-09 14:58:10,327 - lava_callback - DEBUG - Processing node 69d51b7f932ecfe2320a45ec: baseline-arm-clabbe 2026-04-09 14:58:10,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51b7f932ecfe2320a45ec 2026-04-09 14:58:10,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:10,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b7f932ecfe2320a45ec HTTP/1.1" 200 None 2026-04-09 14:58:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:10,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:58:10,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:10,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51b7f932ecfe2320a45ec HTTP/1.1" 200 None 2026-04-09 14:58:10,384 - lava_callback - ERROR - Error processing callback for node 69d51b7f932ecfe2320a45ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:58:50,274 - lava_callback - INFO - Received callback for node 69d51b9d932ecfe2320a461b INFO: 172.21.0.1:32868 - "POST /node/69d51b9d932ecfe2320a461b HTTP/1.0" 202 Accepted 2026-04-09 14:58:50,283 - lava_callback - INFO - Starting async job submit for node 69d51b9d932ecfe2320a461b 2026-04-09 14:58:50,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:50,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b9d932ecfe2320a461b HTTP/1.1" 200 None 2026-04-09 14:58:50,300 - lava_callback - DEBUG - Processing node 69d51b9d932ecfe2320a461b: baseline-arm-clabbe 2026-04-09 14:58:50,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51b9d932ecfe2320a461b 2026-04-09 14:58:50,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:50,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51b9d932ecfe2320a461b HTTP/1.1" 200 None 2026-04-09 14:58:50,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:50,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:58:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:58:50,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51b9d932ecfe2320a461b HTTP/1.1" 200 None 2026-04-09 14:58:50,362 - lava_callback - ERROR - Error processing callback for node 69d51b9d932ecfe2320a461b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK 2026-04-09 14:59:50,361 - lava_callback - INFO - Received callback for node 69d51be3932ecfe2320a4633 INFO: 172.21.0.1:60580 - "POST /node/69d51be3932ecfe2320a4633 HTTP/1.0" 202 Accepted 2026-04-09 14:59:50,367 - lava_callback - INFO - Starting async job submit for node 69d51be3932ecfe2320a4633 2026-04-09 14:59:50,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:59:50,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51be3932ecfe2320a4633 HTTP/1.1" 200 None 2026-04-09 14:59:50,393 - lava_callback - DEBUG - Processing node 69d51be3932ecfe2320a4633: baseline-arm-clabbe 2026-04-09 14:59:50,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51be3932ecfe2320a4633 2026-04-09 14:59:50,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:59:50,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51be3932ecfe2320a4633 HTTP/1.1" 200 None 2026-04-09 14:59:50,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:59:50,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 14:59:50,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 14:59:50,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51be3932ecfe2320a4633 HTTP/1.1" 200 None 2026-04-09 14:59:50,503 - lava_callback - ERROR - Error processing callback for node 69d51be3932ecfe2320a4633: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:00:30,356 - lava_callback - INFO - Received callback for node 69d51c05932ecfe2320a4658 INFO: 172.21.0.1:40564 - "POST /node/69d51c05932ecfe2320a4658 HTTP/1.0" 202 Accepted 2026-04-09 15:00:30,362 - lava_callback - INFO - Starting async job submit for node 69d51c05932ecfe2320a4658 2026-04-09 15:00:30,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:00:30,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c05932ecfe2320a4658 HTTP/1.1" 200 None 2026-04-09 15:00:30,378 - lava_callback - DEBUG - Processing node 69d51c05932ecfe2320a4658: baseline-arm-clabbe 2026-04-09 15:00:30,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51c05932ecfe2320a4658 2026-04-09 15:00:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:00:30,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c05932ecfe2320a4658 HTTP/1.1" 200 None 2026-04-09 15:00:30,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:00:30,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:00:30,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:00:30,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51c05932ecfe2320a4658 HTTP/1.1" 200 None 2026-04-09 15:00:30,436 - lava_callback - ERROR - Error processing callback for node 69d51c05932ecfe2320a4658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:01:10,438 - lava_callback - INFO - Received callback for node 69d51c27932ecfe2320a4677 INFO: 172.21.0.1:33502 - "POST /node/69d51c27932ecfe2320a4677 HTTP/1.0" 202 Accepted 2026-04-09 15:01:10,447 - lava_callback - INFO - Starting async job submit for node 69d51c27932ecfe2320a4677 2026-04-09 15:01:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:10,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c27932ecfe2320a4677 HTTP/1.1" 200 None 2026-04-09 15:01:10,466 - lava_callback - DEBUG - Processing node 69d51c27932ecfe2320a4677: baseline-arm-clabbe 2026-04-09 15:01:10,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51c27932ecfe2320a4677 2026-04-09 15:01:10,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:10,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c27932ecfe2320a4677 HTTP/1.1" 200 None 2026-04-09 15:01:10,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:10,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:01:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:10,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51c27932ecfe2320a4677 HTTP/1.1" 200 None 2026-04-09 15:01:10,550 - lava_callback - ERROR - Error processing callback for node 69d51c27932ecfe2320a4677: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:01:50,440 - lava_callback - INFO - Received callback for node 69d51c49932ecfe2320a4693 INFO: 172.21.0.1:33432 - "POST /node/69d51c49932ecfe2320a4693 HTTP/1.0" 202 Accepted 2026-04-09 15:01:50,445 - lava_callback - INFO - Starting async job submit for node 69d51c49932ecfe2320a4693 2026-04-09 15:01:50,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:50,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c49932ecfe2320a4693 HTTP/1.1" 200 None 2026-04-09 15:01:50,463 - lava_callback - DEBUG - Processing node 69d51c49932ecfe2320a4693: baseline-arm-clabbe 2026-04-09 15:01:50,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51c49932ecfe2320a4693 2026-04-09 15:01:50,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:50,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c49932ecfe2320a4693 HTTP/1.1" 200 None 2026-04-09 15:01:50,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:50,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:01:50,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:01:50,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51c49932ecfe2320a4693 HTTP/1.1" 200 None 2026-04-09 15:01:50,511 - lava_callback - ERROR - Error processing callback for node 69d51c49932ecfe2320a4693: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:02:10,474 - lava_callback - INFO - Received callback for node 69d51c6d932ecfe2320a46bb INFO: 172.21.0.1:50912 - "POST /node/69d51c6d932ecfe2320a46bb HTTP/1.0" 202 Accepted 2026-04-09 15:02:10,479 - lava_callback - INFO - Starting async job submit for node 69d51c6d932ecfe2320a46bb 2026-04-09 15:02:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:10,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c6d932ecfe2320a46bb HTTP/1.1" 200 None 2026-04-09 15:02:10,495 - lava_callback - DEBUG - Processing node 69d51c6d932ecfe2320a46bb: baseline-arm-clabbe 2026-04-09 15:02:10,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51c6d932ecfe2320a46bb 2026-04-09 15:02:10,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c6d932ecfe2320a46bb HTTP/1.1" 200 None 2026-04-09 15:02:10,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:10,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:02:10,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:10,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51c6d932ecfe2320a46bb HTTP/1.1" 200 None 2026-04-09 15:02:10,563 - lava_callback - ERROR - Error processing callback for node 69d51c6d932ecfe2320a46bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 15:02:14,546 - lava_callback - INFO - Received callback for node 69d708f950e7993d3c143ea1 INFO: 172.21.0.1:50928 - "POST /node/69d708f950e7993d3c143ea1 HTTP/1.0" 202 Accepted 2026-04-09 15:02:14,553 - lava_callback - INFO - Starting async job submit for node 69d708f950e7993d3c143ea1 2026-04-09 15:02:14,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:14,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d708f950e7993d3c143ea1 HTTP/1.1" 200 None 2026-04-09 15:02:14,601 - lava_callback - DEBUG - Processing node 69d708f950e7993d3c143ea1: baseline-nfs-arm64 INFO: 172.21.0.1:50936 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-09 15:02:15,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:15,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:15,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d708f950e7993d3c143ea1/log.txt.gz 2026-04-09 15:02:15,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:15,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:15,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d708f950e7993d3c143ea1/lava-logs.yaml 2026-04-09 15:02:15,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:16,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:16,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d708f950e7993d3c143ea1/lava_callback.json.gz 2026-04-09 15:02:16,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:16,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d708f950e7993d3c143ea1 HTTP/1.1" 200 None 2026-04-09 15:02:16,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:16,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-09 15:02:16,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:16,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d708f950e7993d3c143ea1 HTTP/1.1" 200 None 2026-04-09 15:02:16,317 - lava_callback - INFO - Completed processing callback for node 69d708f950e7993d3c143ea1 INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:02:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:20,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:02:44,333 - lava_callback - INFO - Received callback for node 69d708e950e7993d3c143e75 INFO: 172.21.0.1:58850 - "POST /node/69d708e950e7993d3c143e75 HTTP/1.0" 202 Accepted 2026-04-09 15:02:44,341 - lava_callback - INFO - Starting async job submit for node 69d708e950e7993d3c143e75 2026-04-09 15:02:44,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:44,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d708e950e7993d3c143e75 HTTP/1.1" 200 None 2026-04-09 15:02:44,400 - lava_callback - DEBUG - Processing node 69d708e950e7993d3c143e75: baseline-arm64 2026-04-09 15:02:44,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:45,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:45,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d708e950e7993d3c143e75/log.txt.gz 2026-04-09 15:02:45,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:45,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:45,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d708e950e7993d3c143e75/lava-logs.yaml 2026-04-09 15:02:45,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:02:45,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:02:45,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d708e950e7993d3c143e75/lava_callback.json.gz 2026-04-09 15:02:45,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:45,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d708e950e7993d3c143e75 HTTP/1.1" 200 None 2026-04-09 15:02:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:45,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-09 15:02:45,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:45,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d708e950e7993d3c143e75 HTTP/1.1" 200 None 2026-04-09 15:02:46,012 - lava_callback - INFO - Completed processing callback for node 69d708e950e7993d3c143e75 INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:02:50,480 - lava_callback - INFO - Received callback for node 69d51c90932ecfe2320a46db INFO: 172.21.0.1:54002 - "POST /node/69d51c90932ecfe2320a46db HTTP/1.0" 202 Accepted 2026-04-09 15:02:50,485 - lava_callback - INFO - Starting async job submit for node 69d51c90932ecfe2320a46db 2026-04-09 15:02:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:50,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c90932ecfe2320a46db HTTP/1.1" 200 None 2026-04-09 15:02:50,502 - lava_callback - DEBUG - Processing node 69d51c90932ecfe2320a46db: baseline-arm-clabbe 2026-04-09 15:02:50,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51c90932ecfe2320a46db 2026-04-09 15:02:50,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:50,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51c90932ecfe2320a46db HTTP/1.1" 200 None 2026-04-09 15:02:50,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:50,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:02:50,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:50,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:02:50,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51c90932ecfe2320a46db HTTP/1.1" 200 None 2026-04-09 15:02:50,575 - lava_callback - ERROR - Error processing callback for node 69d51c90932ecfe2320a46db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-09 15:02:50,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:03:30,597 - lava_callback - INFO - Received callback for node 69d51cb2932ecfe2320a4704 INFO: 172.21.0.1:48026 - "POST /node/69d51cb2932ecfe2320a4704 HTTP/1.0" 202 Accepted 2026-04-09 15:03:30,603 - lava_callback - INFO - Starting async job submit for node 69d51cb2932ecfe2320a4704 2026-04-09 15:03:30,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:30,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cb2932ecfe2320a4704 HTTP/1.1" 200 None 2026-04-09 15:03:30,619 - lava_callback - DEBUG - Processing node 69d51cb2932ecfe2320a4704: baseline-arm-clabbe 2026-04-09 15:03:30,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51cb2932ecfe2320a4704 2026-04-09 15:03:30,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:30,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cb2932ecfe2320a4704 HTTP/1.1" 200 None 2026-04-09 15:03:30,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:30,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:03:30,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:30,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51cb2932ecfe2320a4704 HTTP/1.1" 200 None 2026-04-09 15:03:30,685 - lava_callback - ERROR - Error processing callback for node 69d51cb2932ecfe2320a4704: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:03:50,541 - lava_callback - INFO - Received callback for node 69d51cd3932ecfe2320a472e INFO: 172.21.0.1:37994 - "POST /node/69d51cd3932ecfe2320a472e HTTP/1.0" 202 Accepted 2026-04-09 15:03:50,547 - lava_callback - INFO - Starting async job submit for node 69d51cd3932ecfe2320a472e 2026-04-09 15:03:50,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:50,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cd3932ecfe2320a472e HTTP/1.1" 200 None 2026-04-09 15:03:50,563 - lava_callback - DEBUG - Processing node 69d51cd3932ecfe2320a472e: baseline-arm-clabbe 2026-04-09 15:03:50,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51cd3932ecfe2320a472e 2026-04-09 15:03:50,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:50,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cd3932ecfe2320a472e HTTP/1.1" 200 None 2026-04-09 15:03:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:50,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:03:50,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:03:50,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51cd3932ecfe2320a472e HTTP/1.1" 200 None 2026-04-09 15:03:50,616 - lava_callback - ERROR - Error processing callback for node 69d51cd3932ecfe2320a472e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:04:30,637 - lava_callback - INFO - Received callback for node 69d51cf7932ecfe2320a4743 INFO: 172.21.0.1:37376 - "POST /node/69d51cf7932ecfe2320a4743 HTTP/1.0" 202 Accepted 2026-04-09 15:04:30,643 - lava_callback - INFO - Starting async job submit for node 69d51cf7932ecfe2320a4743 2026-04-09 15:04:30,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:04:30,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cf7932ecfe2320a4743 HTTP/1.1" 200 None 2026-04-09 15:04:30,661 - lava_callback - DEBUG - Processing node 69d51cf7932ecfe2320a4743: baseline-arm-clabbe 2026-04-09 15:04:30,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51cf7932ecfe2320a4743 2026-04-09 15:04:30,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:04:30,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51cf7932ecfe2320a4743 HTTP/1.1" 200 None 2026-04-09 15:04:30,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:04:30,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:04:30,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:04:30,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51cf7932ecfe2320a4743 HTTP/1.1" 200 None 2026-04-09 15:04:30,712 - lava_callback - ERROR - Error processing callback for node 69d51cf7932ecfe2320a4743: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:05:10,570 - lava_callback - INFO - Received callback for node 69d51d1b932ecfe2320a4755 INFO: 172.21.0.1:47866 - "POST /node/69d51d1b932ecfe2320a4755 HTTP/1.0" 202 Accepted 2026-04-09 15:05:10,579 - lava_callback - INFO - Starting async job submit for node 69d51d1b932ecfe2320a4755 2026-04-09 15:05:10,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:10,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d1b932ecfe2320a4755 HTTP/1.1" 200 None 2026-04-09 15:05:10,596 - lava_callback - DEBUG - Processing node 69d51d1b932ecfe2320a4755: baseline-arm-clabbe 2026-04-09 15:05:10,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51d1b932ecfe2320a4755 2026-04-09 15:05:10,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:10,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d1b932ecfe2320a4755 HTTP/1.1" 200 None 2026-04-09 15:05:10,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:10,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-09 15:05:10,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:10,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51d1b932ecfe2320a4755 HTTP/1.1" 200 None 2026-04-09 15:05:10,673 - lava_callback - ERROR - Error processing callback for node 69d51d1b932ecfe2320a4755: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:05:51,481 - lava_callback - INFO - Received callback for node 69d51d42932ecfe2320a4783 INFO: 172.21.0.1:58188 - "POST /node/69d51d42932ecfe2320a4783 HTTP/1.0" 202 Accepted 2026-04-09 15:05:51,487 - lava_callback - INFO - Starting async job submit for node 69d51d42932ecfe2320a4783 2026-04-09 15:05:51,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:51,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d42932ecfe2320a4783 HTTP/1.1" 200 None 2026-04-09 15:05:51,507 - lava_callback - DEBUG - Processing node 69d51d42932ecfe2320a4783: baseline-arm64-baylibre 2026-04-09 15:05:51,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51d42932ecfe2320a4783 2026-04-09 15:05:51,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:51,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d42932ecfe2320a4783 HTTP/1.1" 200 None 2026-04-09 15:05:51,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:51,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:05:51,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:05:51,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51d42932ecfe2320a4783 HTTP/1.1" 200 None 2026-04-09 15:05:51,556 - lava_callback - ERROR - Error processing callback for node 69d51d42932ecfe2320a4783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:06:51,151 - lava_callback - INFO - Received callback for node 69d51d86932ecfe2320a47c6 INFO: 172.21.0.1:49932 - "POST /node/69d51d86932ecfe2320a47c6 HTTP/1.0" 202 Accepted 2026-04-09 15:06:51,157 - lava_callback - INFO - Starting async job submit for node 69d51d86932ecfe2320a47c6 2026-04-09 15:06:51,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:06:51,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d86932ecfe2320a47c6 HTTP/1.1" 200 None 2026-04-09 15:06:51,177 - lava_callback - DEBUG - Processing node 69d51d86932ecfe2320a47c6: baseline-arm64-baylibre 2026-04-09 15:06:51,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51d86932ecfe2320a47c6 2026-04-09 15:06:51,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:06:51,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51d86932ecfe2320a47c6 HTTP/1.1" 200 None 2026-04-09 15:06:51,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:06:51,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:06:51,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:06:51,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51d86932ecfe2320a47c6 HTTP/1.1" 200 None 2026-04-09 15:06:51,255 - lava_callback - ERROR - Error processing callback for node 69d51d86932ecfe2320a47c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:09:31,457 - lava_callback - INFO - Received callback for node 69d51e16932ecfe2320a482a INFO: 172.21.0.1:37830 - "POST /node/69d51e16932ecfe2320a482a HTTP/1.0" 202 Accepted 2026-04-09 15:09:31,462 - lava_callback - INFO - Starting async job submit for node 69d51e16932ecfe2320a482a 2026-04-09 15:09:31,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:09:31,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51e16932ecfe2320a482a HTTP/1.1" 200 None 2026-04-09 15:09:31,486 - lava_callback - DEBUG - Processing node 69d51e16932ecfe2320a482a: baseline-arm64-baylibre 2026-04-09 15:09:31,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51e16932ecfe2320a482a 2026-04-09 15:09:31,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:09:31,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51e16932ecfe2320a482a HTTP/1.1" 200 None 2026-04-09 15:09:31,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:09:31,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:09:31,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:09:31,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51e16932ecfe2320a482a HTTP/1.1" 200 None 2026-04-09 15:09:31,535 - lava_callback - ERROR - Error processing callback for node 69d51e16932ecfe2320a482a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:10:31,332 - lava_callback - INFO - Received callback for node 69d51e62932ecfe2320a487c INFO: 172.21.0.1:34314 - "POST /node/69d51e62932ecfe2320a487c HTTP/1.0" 202 Accepted 2026-04-09 15:10:31,341 - lava_callback - INFO - Starting async job submit for node 69d51e62932ecfe2320a487c 2026-04-09 15:10:31,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:10:31,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51e62932ecfe2320a487c HTTP/1.1" 200 None 2026-04-09 15:10:31,357 - lava_callback - DEBUG - Processing node 69d51e62932ecfe2320a487c: baseline-arm64-baylibre 2026-04-09 15:10:31,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51e62932ecfe2320a487c 2026-04-09 15:10:31,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:10:31,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51e62932ecfe2320a487c HTTP/1.1" 200 None 2026-04-09 15:10:31,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:10:31,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:10:31,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:10:31,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51e62932ecfe2320a487c HTTP/1.1" 200 None 2026-04-09 15:10:31,414 - lava_callback - ERROR - Error processing callback for node 69d51e62932ecfe2320a487c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:11:51,447 - lava_callback - INFO - Received callback for node 69d51eac932ecfe2320a48ae INFO: 172.21.0.1:35336 - "POST /node/69d51eac932ecfe2320a48ae HTTP/1.0" 202 Accepted 2026-04-09 15:11:51,453 - lava_callback - INFO - Starting async job submit for node 69d51eac932ecfe2320a48ae 2026-04-09 15:11:51,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:11:51,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51eac932ecfe2320a48ae HTTP/1.1" 200 None 2026-04-09 15:11:51,478 - lava_callback - DEBUG - Processing node 69d51eac932ecfe2320a48ae: baseline-arm64-baylibre 2026-04-09 15:11:51,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51eac932ecfe2320a48ae 2026-04-09 15:11:51,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:11:51,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51eac932ecfe2320a48ae HTTP/1.1" 200 None 2026-04-09 15:11:51,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:11:51,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:11:51,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:11:51,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51eac932ecfe2320a48ae HTTP/1.1" 200 None 2026-04-09 15:11:51,535 - lava_callback - ERROR - Error processing callback for node 69d51eac932ecfe2320a48ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:12:51,496 - lava_callback - INFO - Received callback for node 69d51eea932ecfe2320a4906 INFO: 172.21.0.1:59678 - "POST /node/69d51eea932ecfe2320a4906 HTTP/1.0" 202 Accepted 2026-04-09 15:12:51,502 - lava_callback - INFO - Starting async job submit for node 69d51eea932ecfe2320a4906 2026-04-09 15:12:51,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:12:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51eea932ecfe2320a4906 HTTP/1.1" 200 None 2026-04-09 15:12:51,518 - lava_callback - DEBUG - Processing node 69d51eea932ecfe2320a4906: baseline-arm64-baylibre 2026-04-09 15:12:51,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51eea932ecfe2320a4906 2026-04-09 15:12:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:12:51,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51eea932ecfe2320a4906 HTTP/1.1" 200 None 2026-04-09 15:12:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:12:51,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:12:51,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:12:51,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51eea932ecfe2320a4906 HTTP/1.1" 200 None 2026-04-09 15:12:51,573 - lava_callback - ERROR - Error processing callback for node 69d51eea932ecfe2320a4906: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:14:11,606 - lava_callback - INFO - Received callback for node 69d51f30932ecfe2320a4941 INFO: 172.21.0.1:45230 - "POST /node/69d51f30932ecfe2320a4941 HTTP/1.0" 202 Accepted 2026-04-09 15:14:11,611 - lava_callback - INFO - Starting async job submit for node 69d51f30932ecfe2320a4941 2026-04-09 15:14:11,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:14:11,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51f30932ecfe2320a4941 HTTP/1.1" 200 None 2026-04-09 15:14:11,636 - lava_callback - DEBUG - Processing node 69d51f30932ecfe2320a4941: baseline-arm64-baylibre 2026-04-09 15:14:11,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51f30932ecfe2320a4941 2026-04-09 15:14:11,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:14:11,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51f30932ecfe2320a4941 HTTP/1.1" 200 None 2026-04-09 15:14:11,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:14:11,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:14:11,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:14:11,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51f30932ecfe2320a4941 HTTP/1.1" 200 None 2026-04-09 15:14:11,688 - lava_callback - ERROR - Error processing callback for node 69d51f30932ecfe2320a4941: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:15:11,590 - lava_callback - INFO - Received callback for node 69d51f74932ecfe2320a4984 INFO: 172.21.0.1:41016 - "POST /node/69d51f74932ecfe2320a4984 HTTP/1.0" 202 Accepted 2026-04-09 15:15:11,596 - lava_callback - INFO - Starting async job submit for node 69d51f74932ecfe2320a4984 2026-04-09 15:15:11,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:15:11,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51f74932ecfe2320a4984 HTTP/1.1" 200 None 2026-04-09 15:15:11,613 - lava_callback - DEBUG - Processing node 69d51f74932ecfe2320a4984: baseline-arm64-baylibre 2026-04-09 15:15:11,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51f74932ecfe2320a4984 2026-04-09 15:15:11,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:15:11,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51f74932ecfe2320a4984 HTTP/1.1" 200 None 2026-04-09 15:15:11,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:15:11,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:15:11,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:15:11,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51f74932ecfe2320a4984 HTTP/1.1" 200 None 2026-04-09 15:15:11,670 - lava_callback - ERROR - Error processing callback for node 69d51f74932ecfe2320a4984: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:16:11,762 - lava_callback - INFO - Received callback for node 69d51fb5932ecfe2320a49c9 INFO: 172.21.0.1:33968 - "POST /node/69d51fb5932ecfe2320a49c9 HTTP/1.0" 202 Accepted 2026-04-09 15:16:11,768 - lava_callback - INFO - Starting async job submit for node 69d51fb5932ecfe2320a49c9 2026-04-09 15:16:11,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:16:11,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51fb5932ecfe2320a49c9 HTTP/1.1" 200 None 2026-04-09 15:16:11,784 - lava_callback - DEBUG - Processing node 69d51fb5932ecfe2320a49c9: baseline-arm64-baylibre 2026-04-09 15:16:11,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51fb5932ecfe2320a49c9 2026-04-09 15:16:11,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:16:11,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51fb5932ecfe2320a49c9 HTTP/1.1" 200 None 2026-04-09 15:16:11,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:16:11,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:16:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:16:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51fb5932ecfe2320a49c9 HTTP/1.1" 200 None 2026-04-09 15:16:11,832 - lava_callback - ERROR - Error processing callback for node 69d51fb5932ecfe2320a49c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:17:31,725 - lava_callback - INFO - Received callback for node 69d51fff932ecfe2320a49f6 INFO: 172.21.0.1:34788 - "POST /node/69d51fff932ecfe2320a49f6 HTTP/1.0" 202 Accepted 2026-04-09 15:17:31,731 - lava_callback - INFO - Starting async job submit for node 69d51fff932ecfe2320a49f6 2026-04-09 15:17:31,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:17:31,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51fff932ecfe2320a49f6 HTTP/1.1" 200 None 2026-04-09 15:17:31,748 - lava_callback - DEBUG - Processing node 69d51fff932ecfe2320a49f6: baseline-arm64-baylibre 2026-04-09 15:17:31,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d51fff932ecfe2320a49f6 2026-04-09 15:17:31,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:17:31,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d51fff932ecfe2320a49f6 HTTP/1.1" 200 None 2026-04-09 15:17:31,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:17:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:17:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:17:31,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d51fff932ecfe2320a49f6 HTTP/1.1" 200 None 2026-04-09 15:17:31,798 - lava_callback - ERROR - Error processing callback for node 69d51fff932ecfe2320a49f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:18:51,321 - lava_callback - INFO - Received callback for node 69d52049932ecfe2320a4a2b INFO: 172.21.0.1:45504 - "POST /node/69d52049932ecfe2320a4a2b HTTP/1.0" 202 Accepted 2026-04-09 15:18:51,327 - lava_callback - INFO - Starting async job submit for node 69d52049932ecfe2320a4a2b 2026-04-09 15:18:51,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:18:51,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52049932ecfe2320a4a2b HTTP/1.1" 200 None 2026-04-09 15:18:51,343 - lava_callback - DEBUG - Processing node 69d52049932ecfe2320a4a2b: baseline-arm64-clabbe 2026-04-09 15:18:51,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52049932ecfe2320a4a2b 2026-04-09 15:18:51,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:18:51,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52049932ecfe2320a4a2b HTTP/1.1" 200 None 2026-04-09 15:18:51,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:18:51,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:18:51,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:18:51,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52049932ecfe2320a4a2b HTTP/1.1" 200 None 2026-04-09 15:18:51,410 - lava_callback - ERROR - Error processing callback for node 69d52049932ecfe2320a4a2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:19:51,948 - lava_callback - INFO - Received callback for node 69d5208b932ecfe2320a4a67 INFO: 172.21.0.1:34462 - "POST /node/69d5208b932ecfe2320a4a67 HTTP/1.0" 202 Accepted 2026-04-09 15:19:51,954 - lava_callback - INFO - Starting async job submit for node 69d5208b932ecfe2320a4a67 2026-04-09 15:19:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:19:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5208b932ecfe2320a4a67 HTTP/1.1" 200 None 2026-04-09 15:19:51,970 - lava_callback - DEBUG - Processing node 69d5208b932ecfe2320a4a67: baseline-arm64-baylibre 2026-04-09 15:19:51,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5208b932ecfe2320a4a67 2026-04-09 15:19:51,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:19:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5208b932ecfe2320a4a67 HTTP/1.1" 200 None 2026-04-09 15:19:51,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:19:51,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:19:52,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:19:52,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5208b932ecfe2320a4a67 HTTP/1.1" 200 None 2026-04-09 15:19:52,018 - lava_callback - ERROR - Error processing callback for node 69d5208b932ecfe2320a4a67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:25:29,094 - lava_callback - INFO - Received callback for node 69d7a2582f329ad125013ad7 INFO: 172.21.0.1:50214 - "POST /node/69d7a2582f329ad125013ad7 HTTP/1.0" 202 Accepted 2026-04-09 15:25:29,100 - lava_callback - INFO - Starting async job submit for node 69d7a2582f329ad125013ad7 2026-04-09 15:25:29,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:29,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7a2582f329ad125013ad7 HTTP/1.1" 200 None 2026-04-09 15:25:29,144 - lava_callback - DEBUG - Processing node 69d7a2582f329ad125013ad7: baseline-arm64 2026-04-09 15:25:29,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:25:29,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:25:29,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7a2582f329ad125013ad7/log.txt.gz 2026-04-09 15:25:30,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:25:30,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:25:30,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7a2582f329ad125013ad7/lava-logs.yaml 2026-04-09 15:25:30,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:25:30,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:25:30,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7a2582f329ad125013ad7/lava_callback.json.gz 2026-04-09 15:25:30,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:30,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7a2582f329ad125013ad7 HTTP/1.1" 200 None 2026-04-09 15:25:30,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 15:25:30,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:30,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7a2582f329ad125013ad7 HTTP/1.1" 200 None 2026-04-09 15:25:30,677 - lava_callback - INFO - Completed processing callback for node 69d7a2582f329ad125013ad7 INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:25:50,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:50,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-09 15:25:51,606 - lava_callback - INFO - Received callback for node 69d521f6932ecfe2320a4b18 INFO: 172.21.0.1:42346 - "POST /node/69d521f6932ecfe2320a4b18 HTTP/1.0" 202 Accepted 2026-04-09 15:25:51,614 - lava_callback - INFO - Starting async job submit for node 69d521f6932ecfe2320a4b18 2026-04-09 15:25:51,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:51,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d521f6932ecfe2320a4b18 HTTP/1.1" 200 None 2026-04-09 15:25:51,633 - lava_callback - DEBUG - Processing node 69d521f6932ecfe2320a4b18: baseline-arm64-clabbe 2026-04-09 15:25:51,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d521f6932ecfe2320a4b18 2026-04-09 15:25:51,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:51,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d521f6932ecfe2320a4b18 HTTP/1.1" 200 None 2026-04-09 15:25:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:51,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:25:51,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:25:51,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d521f6932ecfe2320a4b18 HTTP/1.1" 200 None 2026-04-09 15:25:51,691 - lava_callback - ERROR - Error processing callback for node 69d521f6932ecfe2320a4b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:26:52,364 - lava_callback - INFO - Received callback for node 69d52233932ecfe2320a4b3e INFO: 172.21.0.1:52774 - "POST /node/69d52233932ecfe2320a4b3e HTTP/1.0" 202 Accepted 2026-04-09 15:26:52,373 - lava_callback - INFO - Starting async job submit for node 69d52233932ecfe2320a4b3e 2026-04-09 15:26:52,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:26:52,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52233932ecfe2320a4b3e HTTP/1.1" 200 None 2026-04-09 15:26:52,392 - lava_callback - DEBUG - Processing node 69d52233932ecfe2320a4b3e: baseline-arm64-baylibre 2026-04-09 15:26:52,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52233932ecfe2320a4b3e 2026-04-09 15:26:52,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:26:52,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52233932ecfe2320a4b3e HTTP/1.1" 200 None 2026-04-09 15:26:52,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:26:52,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:26:52,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:26:52,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52233932ecfe2320a4b3e HTTP/1.1" 200 None 2026-04-09 15:26:52,450 - lava_callback - ERROR - Error processing callback for node 69d52233932ecfe2320a4b3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:28:12,412 - lava_callback - INFO - Received callback for node 69d5227b932ecfe2320a4b5f INFO: 172.21.0.1:53690 - "POST /node/69d5227b932ecfe2320a4b5f HTTP/1.0" 202 Accepted 2026-04-09 15:28:12,418 - lava_callback - INFO - Starting async job submit for node 69d5227b932ecfe2320a4b5f 2026-04-09 15:28:12,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:28:12,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5227b932ecfe2320a4b5f HTTP/1.1" 200 None 2026-04-09 15:28:12,436 - lava_callback - DEBUG - Processing node 69d5227b932ecfe2320a4b5f: baseline-arm64-baylibre 2026-04-09 15:28:12,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5227b932ecfe2320a4b5f 2026-04-09 15:28:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:28:12,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5227b932ecfe2320a4b5f HTTP/1.1" 200 None 2026-04-09 15:28:12,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:28:12,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:28:12,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:28:12,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5227b932ecfe2320a4b5f HTTP/1.1" 200 None 2026-04-09 15:28:12,485 - lava_callback - ERROR - Error processing callback for node 69d5227b932ecfe2320a4b5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:29:12,343 - lava_callback - INFO - Received callback for node 69d522c1932ecfe2320a4b90 INFO: 172.21.0.1:37090 - "POST /node/69d522c1932ecfe2320a4b90 HTTP/1.0" 202 Accepted 2026-04-09 15:29:12,353 - lava_callback - INFO - Starting async job submit for node 69d522c1932ecfe2320a4b90 2026-04-09 15:29:12,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:29:12,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d522c1932ecfe2320a4b90 HTTP/1.1" 200 None 2026-04-09 15:29:12,376 - lava_callback - DEBUG - Processing node 69d522c1932ecfe2320a4b90: baseline-arm64-baylibre 2026-04-09 15:29:12,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d522c1932ecfe2320a4b90 2026-04-09 15:29:12,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:29:12,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d522c1932ecfe2320a4b90 HTTP/1.1" 200 None 2026-04-09 15:29:12,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:29:12,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:29:12,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:29:12,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d522c1932ecfe2320a4b90 HTTP/1.1" 200 None 2026-04-09 15:29:12,444 - lava_callback - ERROR - Error processing callback for node 69d522c1932ecfe2320a4b90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:30:32,573 - lava_callback - INFO - Received callback for node 69d52309932ecfe2320a4bc6 INFO: 172.21.0.1:49280 - "POST /node/69d52309932ecfe2320a4bc6 HTTP/1.0" 202 Accepted 2026-04-09 15:30:32,579 - lava_callback - INFO - Starting async job submit for node 69d52309932ecfe2320a4bc6 2026-04-09 15:30:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:30:32,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52309932ecfe2320a4bc6 HTTP/1.1" 200 None 2026-04-09 15:30:32,597 - lava_callback - DEBUG - Processing node 69d52309932ecfe2320a4bc6: baseline-arm64-baylibre 2026-04-09 15:30:32,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52309932ecfe2320a4bc6 2026-04-09 15:30:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:30:32,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52309932ecfe2320a4bc6 HTTP/1.1" 200 None 2026-04-09 15:30:32,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:30:32,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:30:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:30:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52309932ecfe2320a4bc6 HTTP/1.1" 200 None 2026-04-09 15:30:32,658 - lava_callback - ERROR - Error processing callback for node 69d52309932ecfe2320a4bc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:31:32,486 - lava_callback - INFO - Received callback for node 69d52350932ecfe2320a4bea INFO: 172.21.0.1:36802 - "POST /node/69d52350932ecfe2320a4bea HTTP/1.0" 202 Accepted 2026-04-09 15:31:32,495 - lava_callback - INFO - Starting async job submit for node 69d52350932ecfe2320a4bea 2026-04-09 15:31:32,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:31:32,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52350932ecfe2320a4bea HTTP/1.1" 200 None 2026-04-09 15:31:32,512 - lava_callback - DEBUG - Processing node 69d52350932ecfe2320a4bea: baseline-arm64-baylibre 2026-04-09 15:31:32,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52350932ecfe2320a4bea 2026-04-09 15:31:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:31:32,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52350932ecfe2320a4bea HTTP/1.1" 200 None 2026-04-09 15:31:32,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:31:32,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:31:32,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:31:32,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52350932ecfe2320a4bea HTTP/1.1" 200 None 2026-04-09 15:31:32,569 - lava_callback - ERROR - Error processing callback for node 69d52350932ecfe2320a4bea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:32:52,732 - lava_callback - INFO - Received callback for node 69d5239b932ecfe2320a4c00 INFO: 172.21.0.1:38622 - "POST /node/69d5239b932ecfe2320a4c00 HTTP/1.0" 202 Accepted 2026-04-09 15:32:52,738 - lava_callback - INFO - Starting async job submit for node 69d5239b932ecfe2320a4c00 2026-04-09 15:32:52,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:32:52,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5239b932ecfe2320a4c00 HTTP/1.1" 200 None 2026-04-09 15:32:52,756 - lava_callback - DEBUG - Processing node 69d5239b932ecfe2320a4c00: baseline-arm64-baylibre 2026-04-09 15:32:52,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5239b932ecfe2320a4c00 2026-04-09 15:32:52,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:32:52,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5239b932ecfe2320a4c00 HTTP/1.1" 200 None 2026-04-09 15:32:52,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:32:52,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:32:52,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:32:52,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5239b932ecfe2320a4c00 HTTP/1.1" 200 None 2026-04-09 15:32:52,808 - lava_callback - ERROR - Error processing callback for node 69d5239b932ecfe2320a4c00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:34:12,039 - lava_callback - INFO - Received callback for node 69d523e9932ecfe2320a4c1d INFO: 172.21.0.1:54702 - "POST /node/69d523e9932ecfe2320a4c1d HTTP/1.0" 202 Accepted 2026-04-09 15:34:12,045 - lava_callback - INFO - Starting async job submit for node 69d523e9932ecfe2320a4c1d 2026-04-09 15:34:12,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:34:12,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d523e9932ecfe2320a4c1d HTTP/1.1" 200 None 2026-04-09 15:34:12,061 - lava_callback - DEBUG - Processing node 69d523e9932ecfe2320a4c1d: baseline-arm64-clabbe 2026-04-09 15:34:12,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d523e9932ecfe2320a4c1d 2026-04-09 15:34:12,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:34:12,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d523e9932ecfe2320a4c1d HTTP/1.1" 200 None 2026-04-09 15:34:12,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:34:12,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:34:12,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:34:12,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d523e9932ecfe2320a4c1d HTTP/1.1" 200 None 2026-04-09 15:34:12,115 - lava_callback - ERROR - Error processing callback for node 69d523e9932ecfe2320a4c1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:35:11,998 - lava_callback - INFO - Received callback for node 69d5242a932ecfe2320a4c67 INFO: 172.21.0.1:50792 - "POST /node/69d5242a932ecfe2320a4c67 HTTP/1.0" 202 Accepted 2026-04-09 15:35:12,005 - lava_callback - INFO - Starting async job submit for node 69d5242a932ecfe2320a4c67 2026-04-09 15:35:12,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:35:12,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5242a932ecfe2320a4c67 HTTP/1.1" 200 None 2026-04-09 15:35:12,022 - lava_callback - DEBUG - Processing node 69d5242a932ecfe2320a4c67: baseline-arm64-clabbe 2026-04-09 15:35:12,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5242a932ecfe2320a4c67 2026-04-09 15:35:12,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:35:12,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5242a932ecfe2320a4c67 HTTP/1.1" 200 None 2026-04-09 15:35:12,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:35:12,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:35:12,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:35:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5242a932ecfe2320a4c67 HTTP/1.1" 200 None 2026-04-09 15:35:12,070 - lava_callback - ERROR - Error processing callback for node 69d5242a932ecfe2320a4c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:36:32,191 - lava_callback - INFO - Received callback for node 69d5246d932ecfe2320a4cb0 INFO: 172.21.0.1:55052 - "POST /node/69d5246d932ecfe2320a4cb0 HTTP/1.0" 202 Accepted 2026-04-09 15:36:32,197 - lava_callback - INFO - Starting async job submit for node 69d5246d932ecfe2320a4cb0 2026-04-09 15:36:32,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:36:32,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5246d932ecfe2320a4cb0 HTTP/1.1" 200 None 2026-04-09 15:36:32,213 - lava_callback - DEBUG - Processing node 69d5246d932ecfe2320a4cb0: baseline-arm64-clabbe 2026-04-09 15:36:32,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5246d932ecfe2320a4cb0 2026-04-09 15:36:32,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:36:32,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5246d932ecfe2320a4cb0 HTTP/1.1" 200 None 2026-04-09 15:36:32,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:36:32,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:36:32,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:36:32,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5246d932ecfe2320a4cb0 HTTP/1.1" 200 None 2026-04-09 15:36:32,263 - lava_callback - ERROR - Error processing callback for node 69d5246d932ecfe2320a4cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:37:32,189 - lava_callback - INFO - Received callback for node 69d524af932ecfe2320a4cfd INFO: 172.21.0.1:36492 - "POST /node/69d524af932ecfe2320a4cfd HTTP/1.0" 202 Accepted 2026-04-09 15:37:32,198 - lava_callback - INFO - Starting async job submit for node 69d524af932ecfe2320a4cfd 2026-04-09 15:37:32,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:37:32,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d524af932ecfe2320a4cfd HTTP/1.1" 200 None 2026-04-09 15:37:32,219 - lava_callback - DEBUG - Processing node 69d524af932ecfe2320a4cfd: baseline-arm64-clabbe 2026-04-09 15:37:32,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d524af932ecfe2320a4cfd 2026-04-09 15:37:32,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:37:32,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d524af932ecfe2320a4cfd HTTP/1.1" 200 None 2026-04-09 15:37:32,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:37:32,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:37:32,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:37:32,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d524af932ecfe2320a4cfd HTTP/1.1" 200 None 2026-04-09 15:37:32,281 - lava_callback - ERROR - Error processing callback for node 69d524af932ecfe2320a4cfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:38:52,275 - lava_callback - INFO - Received callback for node 69d524f7932ecfe2320a4d17 INFO: 172.21.0.1:59366 - "POST /node/69d524f7932ecfe2320a4d17 HTTP/1.0" 202 Accepted 2026-04-09 15:38:52,280 - lava_callback - INFO - Starting async job submit for node 69d524f7932ecfe2320a4d17 2026-04-09 15:38:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:38:52,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d524f7932ecfe2320a4d17 HTTP/1.1" 200 None 2026-04-09 15:38:52,296 - lava_callback - DEBUG - Processing node 69d524f7932ecfe2320a4d17: baseline-arm64-clabbe 2026-04-09 15:38:52,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d524f7932ecfe2320a4d17 2026-04-09 15:38:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:38:52,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d524f7932ecfe2320a4d17 HTTP/1.1" 200 None 2026-04-09 15:38:52,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:38:52,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:38:52,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:38:52,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d524f7932ecfe2320a4d17 HTTP/1.1" 200 None 2026-04-09 15:38:52,350 - lava_callback - ERROR - Error processing callback for node 69d524f7932ecfe2320a4d17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:39:52,306 - lava_callback - INFO - Received callback for node 69d5253b932ecfe2320a4d6d INFO: 172.21.0.1:46414 - "POST /node/69d5253b932ecfe2320a4d6d HTTP/1.0" 202 Accepted 2026-04-09 15:39:52,313 - lava_callback - INFO - Starting async job submit for node 69d5253b932ecfe2320a4d6d 2026-04-09 15:39:52,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:39:52,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5253b932ecfe2320a4d6d HTTP/1.1" 200 None 2026-04-09 15:39:52,338 - lava_callback - DEBUG - Processing node 69d5253b932ecfe2320a4d6d: baseline-arm64-clabbe 2026-04-09 15:39:52,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5253b932ecfe2320a4d6d 2026-04-09 15:39:52,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:39:52,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5253b932ecfe2320a4d6d HTTP/1.1" 200 None 2026-04-09 15:39:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:39:52,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:39:52,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:39:52,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5253b932ecfe2320a4d6d HTTP/1.1" 200 None 2026-04-09 15:39:52,405 - lava_callback - ERROR - Error processing callback for node 69d5253b932ecfe2320a4d6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:41:12,292 - lava_callback - INFO - Received callback for node 69d52585932ecfe2320a4d92 INFO: 172.21.0.1:50286 - "POST /node/69d52585932ecfe2320a4d92 HTTP/1.0" 202 Accepted 2026-04-09 15:41:12,297 - lava_callback - INFO - Starting async job submit for node 69d52585932ecfe2320a4d92 2026-04-09 15:41:12,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:12,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52585932ecfe2320a4d92 HTTP/1.1" 200 None 2026-04-09 15:41:12,326 - lava_callback - DEBUG - Processing node 69d52585932ecfe2320a4d92: baseline-arm64-clabbe 2026-04-09 15:41:12,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52585932ecfe2320a4d92 2026-04-09 15:41:12,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:12,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52585932ecfe2320a4d92 HTTP/1.1" 200 None 2026-04-09 15:41:12,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:12,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-09 15:41:12,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:12,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52585932ecfe2320a4d92 HTTP/1.1" 200 None 2026-04-09 15:41:12,408 - lava_callback - ERROR - Error processing callback for node 69d52585932ecfe2320a4d92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:41:27,486 - lava_callback - INFO - Received callback for node 69d7a33b2f329ad125013b97 INFO: 172.21.0.1:50324 - "POST /node/69d7a33b2f329ad125013b97 HTTP/1.0" 202 Accepted 2026-04-09 15:41:27,493 - lava_callback - INFO - Starting async job submit for node 69d7a33b2f329ad125013b97 2026-04-09 15:41:27,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:27,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7a33b2f329ad125013b97 HTTP/1.1" 200 None 2026-04-09 15:41:27,536 - lava_callback - DEBUG - Processing node 69d7a33b2f329ad125013b97: baseline-nfs-arm64 2026-04-09 15:41:28,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:41:28,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:41:28,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7a33b2f329ad125013b97/log.txt.gz 2026-04-09 15:41:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:41:28,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:41:28,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7a33b2f329ad125013b97/lava-logs.yaml 2026-04-09 15:41:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:41:28,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:41:28,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7a33b2f329ad125013b97/lava_callback.json.gz 2026-04-09 15:41:28,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:28,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7a33b2f329ad125013b97 HTTP/1.1" 200 None 2026-04-09 15:41:28,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:28,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 15:41:28,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:28,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7a33b2f329ad125013b97 HTTP/1.1" 200 None 2026-04-09 15:41:29,069 - lava_callback - INFO - Completed processing callback for node 69d7a33b2f329ad125013b97 INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:41:50,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:41:50,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:42:12,376 - lava_callback - INFO - Received callback for node 69d525cf932ecfe2320a4da0 INFO: 172.21.0.1:49258 - "POST /node/69d525cf932ecfe2320a4da0 HTTP/1.0" 202 Accepted 2026-04-09 15:42:12,384 - lava_callback - INFO - Starting async job submit for node 69d525cf932ecfe2320a4da0 2026-04-09 15:42:12,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:42:12,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d525cf932ecfe2320a4da0 HTTP/1.1" 200 None 2026-04-09 15:42:12,422 - lava_callback - DEBUG - Processing node 69d525cf932ecfe2320a4da0: baseline-arm64-clabbe 2026-04-09 15:42:12,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d525cf932ecfe2320a4da0 2026-04-09 15:42:12,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:42:12,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d525cf932ecfe2320a4da0 HTTP/1.1" 200 None 2026-04-09 15:42:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:42:12,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:42:12,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:42:12,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d525cf932ecfe2320a4da0 HTTP/1.1" 200 None 2026-04-09 15:42:12,469 - lava_callback - ERROR - Error processing callback for node 69d525cf932ecfe2320a4da0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:43:32,455 - lava_callback - INFO - Received callback for node 69d52610932ecfe2320a4df1 INFO: 172.21.0.1:35594 - "POST /node/69d52610932ecfe2320a4df1 HTTP/1.0" 202 Accepted 2026-04-09 15:43:32,461 - lava_callback - INFO - Starting async job submit for node 69d52610932ecfe2320a4df1 2026-04-09 15:43:32,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:43:32,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52610932ecfe2320a4df1 HTTP/1.1" 200 None 2026-04-09 15:43:32,479 - lava_callback - DEBUG - Processing node 69d52610932ecfe2320a4df1: baseline-arm64-clabbe 2026-04-09 15:43:32,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52610932ecfe2320a4df1 2026-04-09 15:43:32,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:43:32,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52610932ecfe2320a4df1 HTTP/1.1" 200 None 2026-04-09 15:43:32,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:43:32,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:43:32,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:43:32,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52610932ecfe2320a4df1 HTTP/1.1" 200 None 2026-04-09 15:43:32,544 - lava_callback - ERROR - Error processing callback for node 69d52610932ecfe2320a4df1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:44:32,453 - lava_callback - INFO - Received callback for node 69d52651932ecfe2320a4e59 INFO: 172.21.0.1:50876 - "POST /node/69d52651932ecfe2320a4e59 HTTP/1.0" 202 Accepted 2026-04-09 15:44:32,459 - lava_callback - INFO - Starting async job submit for node 69d52651932ecfe2320a4e59 2026-04-09 15:44:32,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:32,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52651932ecfe2320a4e59 HTTP/1.1" 200 None 2026-04-09 15:44:32,474 - lava_callback - DEBUG - Processing node 69d52651932ecfe2320a4e59: baseline-arm64-clabbe 2026-04-09 15:44:32,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52651932ecfe2320a4e59 2026-04-09 15:44:32,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:32,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52651932ecfe2320a4e59 HTTP/1.1" 200 None 2026-04-09 15:44:32,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:44:32,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:32,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52651932ecfe2320a4e59 HTTP/1.1" 200 None 2026-04-09 15:44:32,538 - lava_callback - ERROR - Error processing callback for node 69d52651932ecfe2320a4e59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:44:54,940 - lava_callback - INFO - Received callback for node 69d7b1ce2f329ad1250149d9 INFO: 172.21.0.1:53518 - "POST /node/69d7b1ce2f329ad1250149d9 HTTP/1.0" 202 Accepted 2026-04-09 15:44:54,947 - lava_callback - INFO - Starting async job submit for node 69d7b1ce2f329ad1250149d9 2026-04-09 15:44:54,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:54,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b1ce2f329ad1250149d9 HTTP/1.1" 200 None 2026-04-09 15:44:54,988 - lava_callback - DEBUG - Processing node 69d7b1ce2f329ad1250149d9: baseline-arm64 2026-04-09 15:44:55,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:55,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:55,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b1ce2f329ad1250149d9/log.txt.gz 2026-04-09 15:44:55,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:56,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:56,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b1ce2f329ad1250149d9/lava-logs.yaml 2026-04-09 15:44:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:56,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:56,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b1ce2f329ad1250149d9/lava_callback.json.gz 2026-04-09 15:44:56,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:56,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b1ce2f329ad1250149d9 HTTP/1.1" 200 None 2026-04-09 15:44:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:56,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 15:44:56,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7b1ce2f329ad1250149d9 HTTP/1.1" 200 None INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:44:56,531 - lava_callback - INFO - Completed processing callback for node 69d7b1ce2f329ad1250149d9 2026-04-09 15:44:58,032 - lava_callback - INFO - Received callback for node 69d7b2e12f329ad125014a31 INFO: 172.21.0.1:53538 - "POST /node/69d7b2e12f329ad125014a31 HTTP/1.0" 202 Accepted 2026-04-09 15:44:58,039 - lava_callback - INFO - Starting async job submit for node 69d7b2e12f329ad125014a31 2026-04-09 15:44:58,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:58,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b2e12f329ad125014a31 HTTP/1.1" 200 None 2026-04-09 15:44:58,093 - lava_callback - DEBUG - Processing node 69d7b2e12f329ad125014a31: baseline-nfs-arm64 2026-04-09 15:44:58,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:58,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:58,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7b2e12f329ad125014a31/log.txt.gz 2026-04-09 15:44:58,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:59,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:59,192 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7b2e12f329ad125014a31/lava-logs.yaml 2026-04-09 15:44:59,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:44:59,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:44:59,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7b2e12f329ad125014a31/lava_callback.json.gz 2026-04-09 15:44:59,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:59,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b2e12f329ad125014a31 HTTP/1.1" 200 None 2026-04-09 15:44:59,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:59,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-09 15:44:59,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:44:59,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7b2e12f329ad125014a31 HTTP/1.1" 200 None 2026-04-09 15:44:59,566 - lava_callback - INFO - Completed processing callback for node 69d7b2e12f329ad125014a31 INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:45:20,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:45:20,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:45:32,479 - lava_callback - INFO - Received callback for node 69d5268f932ecfe2320a4eb4 INFO: 172.21.0.1:60356 - "POST /node/69d5268f932ecfe2320a4eb4 HTTP/1.0" 202 Accepted 2026-04-09 15:45:32,485 - lava_callback - INFO - Starting async job submit for node 69d5268f932ecfe2320a4eb4 2026-04-09 15:45:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:45:32,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5268f932ecfe2320a4eb4 HTTP/1.1" 200 None 2026-04-09 15:45:32,505 - lava_callback - DEBUG - Processing node 69d5268f932ecfe2320a4eb4: baseline-arm64-clabbe 2026-04-09 15:45:32,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5268f932ecfe2320a4eb4 2026-04-09 15:45:32,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:45:32,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5268f932ecfe2320a4eb4 HTTP/1.1" 200 None 2026-04-09 15:45:32,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:45:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:45:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:45:32,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5268f932ecfe2320a4eb4 HTTP/1.1" 200 None 2026-04-09 15:45:32,555 - lava_callback - ERROR - Error processing callback for node 69d5268f932ecfe2320a4eb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:46:32,553 - lava_callback - INFO - Received callback for node 69d526d5932ecfe2320a4edc INFO: 172.21.0.1:41794 - "POST /node/69d526d5932ecfe2320a4edc HTTP/1.0" 202 Accepted 2026-04-09 15:46:32,558 - lava_callback - INFO - Starting async job submit for node 69d526d5932ecfe2320a4edc 2026-04-09 15:46:32,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:46:32,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d526d5932ecfe2320a4edc HTTP/1.1" 200 None 2026-04-09 15:46:32,579 - lava_callback - DEBUG - Processing node 69d526d5932ecfe2320a4edc: baseline-arm64-clabbe 2026-04-09 15:46:32,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d526d5932ecfe2320a4edc 2026-04-09 15:46:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:46:32,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d526d5932ecfe2320a4edc HTTP/1.1" 200 None 2026-04-09 15:46:32,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:46:32,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:46:32,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:46:32,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d526d5932ecfe2320a4edc HTTP/1.1" 200 None 2026-04-09 15:46:32,627 - lava_callback - ERROR - Error processing callback for node 69d526d5932ecfe2320a4edc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:47:52,649 - lava_callback - INFO - Received callback for node 69d52717932ecfe2320a4f2a INFO: 172.21.0.1:57130 - "POST /node/69d52717932ecfe2320a4f2a HTTP/1.0" 202 Accepted 2026-04-09 15:47:52,655 - lava_callback - INFO - Starting async job submit for node 69d52717932ecfe2320a4f2a 2026-04-09 15:47:52,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:47:52,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52717932ecfe2320a4f2a HTTP/1.1" 200 None 2026-04-09 15:47:52,676 - lava_callback - DEBUG - Processing node 69d52717932ecfe2320a4f2a: baseline-arm64-clabbe 2026-04-09 15:47:52,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52717932ecfe2320a4f2a 2026-04-09 15:47:52,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:47:52,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52717932ecfe2320a4f2a HTTP/1.1" 200 None 2026-04-09 15:47:52,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:47:52,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:47:52,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:47:52,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52717932ecfe2320a4f2a HTTP/1.1" 200 None 2026-04-09 15:47:52,759 - lava_callback - ERROR - Error processing callback for node 69d52717932ecfe2320a4f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:48:52,669 - lava_callback - INFO - Received callback for node 69d5275b932ecfe2320a4f71 INFO: 172.21.0.1:42268 - "POST /node/69d5275b932ecfe2320a4f71 HTTP/1.0" 202 Accepted 2026-04-09 15:48:52,675 - lava_callback - INFO - Starting async job submit for node 69d5275b932ecfe2320a4f71 2026-04-09 15:48:52,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:48:52,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5275b932ecfe2320a4f71 HTTP/1.1" 200 None 2026-04-09 15:48:52,691 - lava_callback - DEBUG - Processing node 69d5275b932ecfe2320a4f71: baseline-arm64-clabbe 2026-04-09 15:48:52,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5275b932ecfe2320a4f71 2026-04-09 15:48:52,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:48:52,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5275b932ecfe2320a4f71 HTTP/1.1" 200 None 2026-04-09 15:48:52,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:48:52,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:48:52,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:48:52,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5275b932ecfe2320a4f71 HTTP/1.1" 200 None 2026-04-09 15:48:52,752 - lava_callback - ERROR - Error processing callback for node 69d5275b932ecfe2320a4f71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:49:52,698 - lava_callback - INFO - Received callback for node 69d5279b932ecfe2320a4fd4 INFO: 172.21.0.1:54412 - "POST /node/69d5279b932ecfe2320a4fd4 HTTP/1.0" 202 Accepted 2026-04-09 15:49:52,703 - lava_callback - INFO - Starting async job submit for node 69d5279b932ecfe2320a4fd4 2026-04-09 15:49:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:49:52,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5279b932ecfe2320a4fd4 HTTP/1.1" 200 None 2026-04-09 15:49:52,720 - lava_callback - DEBUG - Processing node 69d5279b932ecfe2320a4fd4: baseline-arm64-clabbe 2026-04-09 15:49:52,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5279b932ecfe2320a4fd4 2026-04-09 15:49:52,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:49:52,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5279b932ecfe2320a4fd4 HTTP/1.1" 200 None 2026-04-09 15:49:52,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:49:52,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:49:52,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:49:52,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5279b932ecfe2320a4fd4 HTTP/1.1" 200 None 2026-04-09 15:49:52,791 - lava_callback - ERROR - Error processing callback for node 69d5279b932ecfe2320a4fd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:51:12,793 - lava_callback - INFO - Received callback for node 69d527e3932ecfe2320a5003 INFO: 172.21.0.1:33982 - "POST /node/69d527e3932ecfe2320a5003 HTTP/1.0" 202 Accepted 2026-04-09 15:51:12,798 - lava_callback - INFO - Starting async job submit for node 69d527e3932ecfe2320a5003 2026-04-09 15:51:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:51:12,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d527e3932ecfe2320a5003 HTTP/1.1" 200 None 2026-04-09 15:51:12,814 - lava_callback - DEBUG - Processing node 69d527e3932ecfe2320a5003: baseline-arm64-clabbe 2026-04-09 15:51:12,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d527e3932ecfe2320a5003 2026-04-09 15:51:12,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:51:12,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d527e3932ecfe2320a5003 HTTP/1.1" 200 None 2026-04-09 15:51:12,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:51:12,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:51:12,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:51:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d527e3932ecfe2320a5003 HTTP/1.1" 200 None 2026-04-09 15:51:12,888 - lava_callback - ERROR - Error processing callback for node 69d527e3932ecfe2320a5003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:52:12,837 - lava_callback - INFO - Received callback for node 69d52827932ecfe2320a5033 INFO: 172.21.0.1:37374 - "POST /node/69d52827932ecfe2320a5033 HTTP/1.0" 202 Accepted 2026-04-09 15:52:12,843 - lava_callback - INFO - Starting async job submit for node 69d52827932ecfe2320a5033 2026-04-09 15:52:12,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:52:12,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52827932ecfe2320a5033 HTTP/1.1" 200 None 2026-04-09 15:52:12,860 - lava_callback - DEBUG - Processing node 69d52827932ecfe2320a5033: baseline-arm64-clabbe 2026-04-09 15:52:12,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52827932ecfe2320a5033 2026-04-09 15:52:12,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:52:12,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52827932ecfe2320a5033 HTTP/1.1" 200 None 2026-04-09 15:52:12,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:52:12,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:52:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:52:12,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52827932ecfe2320a5033 HTTP/1.1" 200 None 2026-04-09 15:52:12,913 - lava_callback - ERROR - Error processing callback for node 69d52827932ecfe2320a5033: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:53:32,852 - lava_callback - INFO - Received callback for node 69d52871932ecfe2320a5059 INFO: 172.21.0.1:47734 - "POST /node/69d52871932ecfe2320a5059 HTTP/1.0" 202 Accepted 2026-04-09 15:53:32,858 - lava_callback - INFO - Starting async job submit for node 69d52871932ecfe2320a5059 2026-04-09 15:53:32,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:32,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52871932ecfe2320a5059 HTTP/1.1" 200 None 2026-04-09 15:53:32,874 - lava_callback - DEBUG - Processing node 69d52871932ecfe2320a5059: baseline-arm64-clabbe 2026-04-09 15:53:32,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52871932ecfe2320a5059 2026-04-09 15:53:32,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:32,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52871932ecfe2320a5059 HTTP/1.1" 200 None 2026-04-09 15:53:32,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:32,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:53:32,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:32,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52871932ecfe2320a5059 HTTP/1.1" 200 None 2026-04-09 15:53:32,929 - lava_callback - ERROR - Error processing callback for node 69d52871932ecfe2320a5059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:53:39,471 - lava_callback - INFO - Received callback for node 69d7b9f22f329ad125014ad8 INFO: 172.21.0.1:47750 - "POST /node/69d7b9f22f329ad125014ad8 HTTP/1.0" 202 Accepted 2026-04-09 15:53:39,478 - lava_callback - INFO - Starting async job submit for node 69d7b9f22f329ad125014ad8 2026-04-09 15:53:39,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b9f22f329ad125014ad8 HTTP/1.1" 200 None 2026-04-09 15:53:39,523 - lava_callback - DEBUG - Processing node 69d7b9f22f329ad125014ad8: baseline-arm64 2026-04-09 15:53:40,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:53:40,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:53:40,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b9f22f329ad125014ad8/log.txt.gz 2026-04-09 15:53:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:53:40,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:53:40,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b9f22f329ad125014ad8/lava-logs.yaml 2026-04-09 15:53:40,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:53:41,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:53:41,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7b9f22f329ad125014ad8/lava_callback.json.gz 2026-04-09 15:53:41,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:41,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7b9f22f329ad125014ad8 HTTP/1.1" 200 None 2026-04-09 15:53:41,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:41,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-09 15:53:41,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:41,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7b9f22f329ad125014ad8 HTTP/1.1" 200 None 2026-04-09 15:53:41,144 - lava_callback - INFO - Completed processing callback for node 69d7b9f22f329ad125014ad8 INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:53:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:53:50,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:54:52,886 - lava_callback - INFO - Received callback for node 69d528b9932ecfe2320a507b INFO: 172.21.0.1:51554 - "POST /node/69d528b9932ecfe2320a507b HTTP/1.0" 202 Accepted 2026-04-09 15:54:52,892 - lava_callback - INFO - Starting async job submit for node 69d528b9932ecfe2320a507b 2026-04-09 15:54:52,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:54:52,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d528b9932ecfe2320a507b HTTP/1.1" 200 None 2026-04-09 15:54:52,912 - lava_callback - DEBUG - Processing node 69d528b9932ecfe2320a507b: baseline-arm64-clabbe 2026-04-09 15:54:52,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d528b9932ecfe2320a507b 2026-04-09 15:54:52,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:54:52,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d528b9932ecfe2320a507b HTTP/1.1" 200 None 2026-04-09 15:54:52,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:54:52,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-09 15:54:52,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:54:52,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d528b9932ecfe2320a507b HTTP/1.1" 200 None 2026-04-09 15:54:52,984 - lava_callback - ERROR - Error processing callback for node 69d528b9932ecfe2320a507b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:55:54,038 - lava_callback - INFO - Received callback for node 69d528f9932ecfe2320a509a INFO: 172.21.0.1:38606 - "POST /node/69d528f9932ecfe2320a509a HTTP/1.0" 202 Accepted 2026-04-09 15:55:54,044 - lava_callback - INFO - Starting async job submit for node 69d528f9932ecfe2320a509a 2026-04-09 15:55:54,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:55:54,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d528f9932ecfe2320a509a HTTP/1.1" 200 None 2026-04-09 15:55:54,068 - lava_callback - DEBUG - Processing node 69d528f9932ecfe2320a509a: baseline-arm64-baylibre 2026-04-09 15:55:54,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d528f9932ecfe2320a509a 2026-04-09 15:55:54,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:55:54,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d528f9932ecfe2320a509a HTTP/1.1" 200 None 2026-04-09 15:55:54,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:55:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 15:55:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:55:54,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d528f9932ecfe2320a509a HTTP/1.1" 200 None 2026-04-09 15:55:54,146 - lava_callback - ERROR - Error processing callback for node 69d528f9932ecfe2320a509a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:56:44,933 - lava_callback - INFO - Received callback for node 69d7bfb62f329ad1250150f1 INFO: 172.21.0.1:39470 - "POST /node/69d7bfb62f329ad1250150f1 HTTP/1.0" 202 Accepted 2026-04-09 15:56:44,939 - lava_callback - INFO - Starting async job submit for node 69d7bfb62f329ad1250150f1 2026-04-09 15:56:44,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:44,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7bfb62f329ad1250150f1 HTTP/1.1" 200 None 2026-04-09 15:56:44,980 - lava_callback - DEBUG - Processing node 69d7bfb62f329ad1250150f1: baseline-arm64 2026-04-09 15:56:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:56:45,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:56:45,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7bfb62f329ad1250150f1/log.txt.gz 2026-04-09 15:56:45,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:56:46,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:56:46,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7bfb62f329ad1250150f1/lava-logs.yaml 2026-04-09 15:56:46,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 15:56:46,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 15:56:46,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7bfb62f329ad1250150f1/lava_callback.json.gz 2026-04-09 15:56:46,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:46,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7bfb62f329ad1250150f1 HTTP/1.1" 200 None 2026-04-09 15:56:46,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:46,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-09 15:56:46,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:46,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7bfb62f329ad1250150f1 HTTP/1.1" 200 None INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:56:46,613 - lava_callback - INFO - Completed processing callback for node 69d7bfb62f329ad1250150f1 2026-04-09 15:56:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:50,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-09 15:56:53,915 - lava_callback - INFO - Received callback for node 69d52943932ecfe2320a50c3 INFO: 172.21.0.1:49192 - "POST /node/69d52943932ecfe2320a50c3 HTTP/1.0" 202 Accepted 2026-04-09 15:56:53,921 - lava_callback - INFO - Starting async job submit for node 69d52943932ecfe2320a50c3 2026-04-09 15:56:53,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:53,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52943932ecfe2320a50c3 HTTP/1.1" 200 None 2026-04-09 15:56:53,938 - lava_callback - DEBUG - Processing node 69d52943932ecfe2320a50c3: baseline-arm64-baylibre 2026-04-09 15:56:53,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52943932ecfe2320a50c3 2026-04-09 15:56:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:53,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52943932ecfe2320a50c3 HTTP/1.1" 200 None 2026-04-09 15:56:53,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:53,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 15:56:53,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:56:53,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52943932ecfe2320a50c3 HTTP/1.1" 200 None 2026-04-09 15:56:53,987 - lava_callback - ERROR - Error processing callback for node 69d52943932ecfe2320a50c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:58:13,991 - lava_callback - INFO - Received callback for node 69d5298c932ecfe2320a50e8 INFO: 172.21.0.1:46128 - "POST /node/69d5298c932ecfe2320a50e8 HTTP/1.0" 202 Accepted 2026-04-09 15:58:13,997 - lava_callback - INFO - Starting async job submit for node 69d5298c932ecfe2320a50e8 2026-04-09 15:58:13,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:58:14,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5298c932ecfe2320a50e8 HTTP/1.1" 200 None 2026-04-09 15:58:14,017 - lava_callback - DEBUG - Processing node 69d5298c932ecfe2320a50e8: baseline-arm64-baylibre 2026-04-09 15:58:14,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d5298c932ecfe2320a50e8 2026-04-09 15:58:14,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:58:14,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5298c932ecfe2320a50e8 HTTP/1.1" 200 None 2026-04-09 15:58:14,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:58:14,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 15:58:14,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:58:14,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5298c932ecfe2320a50e8 HTTP/1.1" 200 None 2026-04-09 15:58:14,090 - lava_callback - ERROR - Error processing callback for node 69d5298c932ecfe2320a50e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK 2026-04-09 15:59:33,093 - lava_callback - INFO - Received callback for node 69d529d8932ecfe2320a511b INFO: 172.21.0.1:39598 - "POST /node/69d529d8932ecfe2320a511b HTTP/1.0" 202 Accepted 2026-04-09 15:59:33,102 - lava_callback - INFO - Starting async job submit for node 69d529d8932ecfe2320a511b 2026-04-09 15:59:33,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:59:33,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d529d8932ecfe2320a511b HTTP/1.1" 200 None 2026-04-09 15:59:33,118 - lava_callback - DEBUG - Processing node 69d529d8932ecfe2320a511b: baseline-arm64-clabbe 2026-04-09 15:59:33,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d529d8932ecfe2320a511b 2026-04-09 15:59:33,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:59:33,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d529d8932ecfe2320a511b HTTP/1.1" 200 None 2026-04-09 15:59:33,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:59:33,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 15:59:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 15:59:33,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d529d8932ecfe2320a511b HTTP/1.1" 200 None 2026-04-09 15:59:33,174 - lava_callback - ERROR - Error processing callback for node 69d529d8932ecfe2320a511b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:00:53,149 - lava_callback - INFO - Received callback for node 69d52a21932ecfe2320a5140 INFO: 172.21.0.1:52556 - "POST /node/69d52a21932ecfe2320a5140 HTTP/1.0" 202 Accepted 2026-04-09 16:00:53,154 - lava_callback - INFO - Starting async job submit for node 69d52a21932ecfe2320a5140 2026-04-09 16:00:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:00:53,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52a21932ecfe2320a5140 HTTP/1.1" 200 None 2026-04-09 16:00:53,171 - lava_callback - DEBUG - Processing node 69d52a21932ecfe2320a5140: baseline-arm64-clabbe 2026-04-09 16:00:53,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52a21932ecfe2320a5140 2026-04-09 16:00:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:00:53,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52a21932ecfe2320a5140 HTTP/1.1" 200 None 2026-04-09 16:00:53,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:00:53,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:00:53,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:00:53,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52a21932ecfe2320a5140 HTTP/1.1" 200 None 2026-04-09 16:00:53,231 - lava_callback - ERROR - Error processing callback for node 69d52a21932ecfe2320a5140: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:01:33,408 - lava_callback - INFO - Received callback for node 69d7bbd12f329ad125014d16 INFO: 172.21.0.1:34558 - "POST /node/69d7bbd12f329ad125014d16 HTTP/1.0" 202 Accepted 2026-04-09 16:01:33,415 - lava_callback - INFO - Starting async job submit for node 69d7bbd12f329ad125014d16 2026-04-09 16:01:33,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:33,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7bbd12f329ad125014d16 HTTP/1.1" 200 None 2026-04-09 16:01:33,478 - lava_callback - DEBUG - Processing node 69d7bbd12f329ad125014d16: baseline-nfs-arm64 2026-04-09 16:01:33,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:01:34,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:01:34,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7bbd12f329ad125014d16/log.txt.gz 2026-04-09 16:01:34,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:01:34,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:01:34,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7bbd12f329ad125014d16/lava-logs.yaml 2026-04-09 16:01:34,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:01:34,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:01:34,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7bbd12f329ad125014d16/lava_callback.json.gz 2026-04-09 16:01:34,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:34,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7bbd12f329ad125014d16 HTTP/1.1" 200 None 2026-04-09 16:01:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:34,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-09 16:01:34,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:34,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7bbd12f329ad125014d16 HTTP/1.1" 200 None 2026-04-09 16:01:34,908 - lava_callback - INFO - Completed processing callback for node 69d7bbd12f329ad125014d16 INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:01:50,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:50,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-09 16:01:53,161 - lava_callback - INFO - Received callback for node 69d52a60932ecfe2320a5193 INFO: 172.21.0.1:38104 - "POST /node/69d52a60932ecfe2320a5193 HTTP/1.0" 202 Accepted 2026-04-09 16:01:53,167 - lava_callback - INFO - Starting async job submit for node 69d52a60932ecfe2320a5193 2026-04-09 16:01:53,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:53,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52a60932ecfe2320a5193 HTTP/1.1" 200 None 2026-04-09 16:01:53,210 - lava_callback - DEBUG - Processing node 69d52a60932ecfe2320a5193: baseline-arm64-clabbe 2026-04-09 16:01:53,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52a60932ecfe2320a5193 2026-04-09 16:01:53,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:53,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52a60932ecfe2320a5193 HTTP/1.1" 200 None 2026-04-09 16:01:53,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:53,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:01:53,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:01:53,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52a60932ecfe2320a5193 HTTP/1.1" 200 None 2026-04-09 16:01:53,267 - lava_callback - ERROR - Error processing callback for node 69d52a60932ecfe2320a5193: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:02:53,206 - lava_callback - INFO - Received callback for node 69d52aa3932ecfe2320a51df INFO: 172.21.0.1:40450 - "POST /node/69d52aa3932ecfe2320a51df HTTP/1.0" 202 Accepted 2026-04-09 16:02:53,215 - lava_callback - INFO - Starting async job submit for node 69d52aa3932ecfe2320a51df 2026-04-09 16:02:53,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:02:53,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52aa3932ecfe2320a51df HTTP/1.1" 200 None 2026-04-09 16:02:53,242 - lava_callback - DEBUG - Processing node 69d52aa3932ecfe2320a51df: baseline-arm64-clabbe 2026-04-09 16:02:53,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52aa3932ecfe2320a51df 2026-04-09 16:02:53,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:02:53,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52aa3932ecfe2320a51df HTTP/1.1" 200 None 2026-04-09 16:02:53,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:02:53,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:02:53,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:02:53,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52aa3932ecfe2320a51df HTTP/1.1" 200 None 2026-04-09 16:02:53,320 - lava_callback - ERROR - Error processing callback for node 69d52aa3932ecfe2320a51df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:04:13,269 - lava_callback - INFO - Received callback for node 69d52ae9932ecfe2320a5215 INFO: 172.21.0.1:59762 - "POST /node/69d52ae9932ecfe2320a5215 HTTP/1.0" 202 Accepted 2026-04-09 16:04:13,274 - lava_callback - INFO - Starting async job submit for node 69d52ae9932ecfe2320a5215 2026-04-09 16:04:13,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:04:13,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52ae9932ecfe2320a5215 HTTP/1.1" 200 None 2026-04-09 16:04:13,291 - lava_callback - DEBUG - Processing node 69d52ae9932ecfe2320a5215: baseline-arm64-clabbe 2026-04-09 16:04:13,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52ae9932ecfe2320a5215 2026-04-09 16:04:13,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:04:13,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52ae9932ecfe2320a5215 HTTP/1.1" 200 None 2026-04-09 16:04:13,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:04:13,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:04:13,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:04:13,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52ae9932ecfe2320a5215 HTTP/1.1" 200 None 2026-04-09 16:04:13,347 - lava_callback - ERROR - Error processing callback for node 69d52ae9932ecfe2320a5215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50376 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:05:13,390 - lava_callback - INFO - Received callback for node 69d52b2f932ecfe2320a5249 INFO: 172.21.0.1:58042 - "POST /node/69d52b2f932ecfe2320a5249 HTTP/1.0" 202 Accepted 2026-04-09 16:05:13,396 - lava_callback - INFO - Starting async job submit for node 69d52b2f932ecfe2320a5249 2026-04-09 16:05:13,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:05:13,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b2f932ecfe2320a5249 HTTP/1.1" 200 None 2026-04-09 16:05:13,413 - lava_callback - DEBUG - Processing node 69d52b2f932ecfe2320a5249: baseline-arm64-clabbe 2026-04-09 16:05:13,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52b2f932ecfe2320a5249 2026-04-09 16:05:13,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:05:13,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b2f932ecfe2320a5249 HTTP/1.1" 200 None 2026-04-09 16:05:13,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:05:13,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:05:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:05:13,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52b2f932ecfe2320a5249 HTTP/1.1" 200 None 2026-04-09 16:05:13,482 - lava_callback - ERROR - Error processing callback for node 69d52b2f932ecfe2320a5249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:06:08,014 - lava_callback - INFO - Received callback for node 69d7c1bf2f329ad125015356 INFO: 172.21.0.1:39378 - "POST /node/69d7c1bf2f329ad125015356 HTTP/1.0" 202 Accepted 2026-04-09 16:06:08,024 - lava_callback - INFO - Starting async job submit for node 69d7c1bf2f329ad125015356 2026-04-09 16:06:08,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:08,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c1bf2f329ad125015356 HTTP/1.1" 200 None 2026-04-09 16:06:08,066 - lava_callback - DEBUG - Processing node 69d7c1bf2f329ad125015356: baseline-nfs-arm64 2026-04-09 16:06:08,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:06:08,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:06:08,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c1bf2f329ad125015356/log.txt.gz 2026-04-09 16:06:09,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:06:09,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:06:09,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c1bf2f329ad125015356/lava-logs.yaml 2026-04-09 16:06:09,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:06:09,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:06:09,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c1bf2f329ad125015356/lava_callback.json.gz 2026-04-09 16:06:09,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:09,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c1bf2f329ad125015356 HTTP/1.1" 200 None 2026-04-09 16:06:09,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:09,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-09 16:06:09,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:09,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7c1bf2f329ad125015356 HTTP/1.1" 200 None 2026-04-09 16:06:09,608 - lava_callback - INFO - Completed processing callback for node 69d7c1bf2f329ad125015356 2026-04-09 16:06:14,504 - lava_callback - INFO - Received callback for node 69d52b66932ecfe2320a5263 INFO: 172.21.0.1:35656 - "POST /node/69d52b66932ecfe2320a5263 HTTP/1.0" 202 Accepted 2026-04-09 16:06:14,510 - lava_callback - INFO - Starting async job submit for node 69d52b66932ecfe2320a5263 2026-04-09 16:06:14,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:14,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b66932ecfe2320a5263 HTTP/1.1" 200 None 2026-04-09 16:06:14,532 - lava_callback - DEBUG - Processing node 69d52b66932ecfe2320a5263: baseline-arm-baylibre 2026-04-09 16:06:14,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52b66932ecfe2320a5263 2026-04-09 16:06:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:14,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b66932ecfe2320a5263 HTTP/1.1" 200 None 2026-04-09 16:06:14,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:14,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:06:14,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:14,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52b66932ecfe2320a5263 HTTP/1.1" 200 None 2026-04-09 16:06:14,583 - lava_callback - ERROR - Error processing callback for node 69d52b66932ecfe2320a5263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:06:20,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:20,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:06:34,384 - lava_callback - INFO - Received callback for node 69d52b88932ecfe2320a526f INFO: 172.21.0.1:46692 - "POST /node/69d52b88932ecfe2320a526f HTTP/1.0" 202 Accepted 2026-04-09 16:06:34,389 - lava_callback - INFO - Starting async job submit for node 69d52b88932ecfe2320a526f 2026-04-09 16:06:34,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:34,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b88932ecfe2320a526f HTTP/1.1" 200 None 2026-04-09 16:06:34,407 - lava_callback - DEBUG - Processing node 69d52b88932ecfe2320a526f: baseline-arm-baylibre 2026-04-09 16:06:34,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52b88932ecfe2320a526f 2026-04-09 16:06:34,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:34,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52b88932ecfe2320a526f HTTP/1.1" 200 None 2026-04-09 16:06:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:06:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:06:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52b88932ecfe2320a526f HTTP/1.1" 200 None 2026-04-09 16:06:34,472 - lava_callback - ERROR - Error processing callback for node 69d52b88932ecfe2320a526f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:07:34,535 - lava_callback - INFO - Received callback for node 69d52bb3932ecfe2320a5298 INFO: 172.21.0.1:35424 - "POST /node/69d52bb3932ecfe2320a5298 HTTP/1.0" 202 Accepted 2026-04-09 16:07:34,542 - lava_callback - INFO - Starting async job submit for node 69d52bb3932ecfe2320a5298 2026-04-09 16:07:34,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:07:34,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52bb3932ecfe2320a5298 HTTP/1.1" 200 None 2026-04-09 16:07:34,565 - lava_callback - DEBUG - Processing node 69d52bb3932ecfe2320a5298: baseline-arm64-baylibre 2026-04-09 16:07:34,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52bb3932ecfe2320a5298 2026-04-09 16:07:34,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:07:34,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52bb3932ecfe2320a5298 HTTP/1.1" 200 None 2026-04-09 16:07:34,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:07:34,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:07:34,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:07:34,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52bb3932ecfe2320a5298 HTTP/1.1" 200 None 2026-04-09 16:07:34,621 - lava_callback - ERROR - Error processing callback for node 69d52bb3932ecfe2320a5298: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:08:34,519 - lava_callback - INFO - Received callback for node 69d52bfc932ecfe2320a52b4 INFO: 172.21.0.1:47380 - "POST /node/69d52bfc932ecfe2320a52b4 HTTP/1.0" 202 Accepted 2026-04-09 16:08:34,527 - lava_callback - INFO - Starting async job submit for node 69d52bfc932ecfe2320a52b4 2026-04-09 16:08:34,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:08:34,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52bfc932ecfe2320a52b4 HTTP/1.1" 200 None 2026-04-09 16:08:34,548 - lava_callback - DEBUG - Processing node 69d52bfc932ecfe2320a52b4: baseline-arm64-baylibre 2026-04-09 16:08:34,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52bfc932ecfe2320a52b4 2026-04-09 16:08:34,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:08:34,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52bfc932ecfe2320a52b4 HTTP/1.1" 200 None 2026-04-09 16:08:34,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:08:34,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:08:34,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:08:34,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52bfc932ecfe2320a52b4 HTTP/1.1" 200 None 2026-04-09 16:08:34,608 - lava_callback - ERROR - Error processing callback for node 69d52bfc932ecfe2320a52b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:09:54,623 - lava_callback - INFO - Received callback for node 69d52c3d932ecfe2320a52c3 INFO: 172.21.0.1:38046 - "POST /node/69d52c3d932ecfe2320a52c3 HTTP/1.0" 202 Accepted 2026-04-09 16:09:54,628 - lava_callback - INFO - Starting async job submit for node 69d52c3d932ecfe2320a52c3 2026-04-09 16:09:54,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:09:54,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c3d932ecfe2320a52c3 HTTP/1.1" 200 None 2026-04-09 16:09:54,644 - lava_callback - DEBUG - Processing node 69d52c3d932ecfe2320a52c3: baseline-arm-baylibre 2026-04-09 16:09:54,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52c3d932ecfe2320a52c3 2026-04-09 16:09:54,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:09:54,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c3d932ecfe2320a52c3 HTTP/1.1" 200 None 2026-04-09 16:09:54,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:09:54,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:09:54,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:09:54,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52c3d932ecfe2320a52c3 HTTP/1.1" 200 None 2026-04-09 16:09:54,694 - lava_callback - ERROR - Error processing callback for node 69d52c3d932ecfe2320a52c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:10:14,586 - lava_callback - INFO - Received callback for node 69d52c5e932ecfe2320a52e0 INFO: 172.21.0.1:48988 - "POST /node/69d52c5e932ecfe2320a52e0 HTTP/1.0" 202 Accepted 2026-04-09 16:10:14,592 - lava_callback - INFO - Starting async job submit for node 69d52c5e932ecfe2320a52e0 2026-04-09 16:10:14,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:14,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c5e932ecfe2320a52e0 HTTP/1.1" 200 None 2026-04-09 16:10:14,608 - lava_callback - DEBUG - Processing node 69d52c5e932ecfe2320a52e0: baseline-arm-baylibre 2026-04-09 16:10:14,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52c5e932ecfe2320a52e0 2026-04-09 16:10:14,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:14,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c5e932ecfe2320a52e0 HTTP/1.1" 200 None 2026-04-09 16:10:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:14,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:10:14,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:14,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52c5e932ecfe2320a52e0 HTTP/1.1" 200 None 2026-04-09 16:10:14,657 - lava_callback - ERROR - Error processing callback for node 69d52c5e932ecfe2320a52e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:10:54,631 - lava_callback - INFO - Received callback for node 69d52c86932ecfe2320a5324 INFO: 172.21.0.1:34156 - "POST /node/69d52c86932ecfe2320a5324 HTTP/1.0" 202 Accepted 2026-04-09 16:10:54,637 - lava_callback - INFO - Starting async job submit for node 69d52c86932ecfe2320a5324 2026-04-09 16:10:54,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:54,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c86932ecfe2320a5324 HTTP/1.1" 200 None 2026-04-09 16:10:54,657 - lava_callback - DEBUG - Processing node 69d52c86932ecfe2320a5324: baseline-arm64-baylibre 2026-04-09 16:10:54,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52c86932ecfe2320a5324 2026-04-09 16:10:54,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:54,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52c86932ecfe2320a5324 HTTP/1.1" 200 None 2026-04-09 16:10:54,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:54,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:10:54,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:10:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52c86932ecfe2320a5324 HTTP/1.1" 200 None 2026-04-09 16:10:54,705 - lava_callback - ERROR - Error processing callback for node 69d52c86932ecfe2320a5324: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:11:53,638 - lava_callback - INFO - Received callback for node 69d52cc5932ecfe2320a5359 INFO: 172.21.0.1:33366 - "POST /node/69d52cc5932ecfe2320a5359 HTTP/1.0" 202 Accepted 2026-04-09 16:11:53,644 - lava_callback - INFO - Starting async job submit for node 69d52cc5932ecfe2320a5359 2026-04-09 16:11:53,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:11:53,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52cc5932ecfe2320a5359 HTTP/1.1" 200 None 2026-04-09 16:11:53,660 - lava_callback - DEBUG - Processing node 69d52cc5932ecfe2320a5359: baseline-arm-clabbe 2026-04-09 16:11:53,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52cc5932ecfe2320a5359 2026-04-09 16:11:53,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:11:53,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52cc5932ecfe2320a5359 HTTP/1.1" 200 None 2026-04-09 16:11:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:11:53,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:11:53,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:11:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52cc5932ecfe2320a5359 HTTP/1.1" 200 None 2026-04-09 16:11:53,708 - lava_callback - ERROR - Error processing callback for node 69d52cc5932ecfe2320a5359: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:12:13,563 - lava_callback - INFO - Received callback for node 69d7c4082f329ad1250155a7 INFO: 172.21.0.1:41678 - "POST /node/69d7c4082f329ad1250155a7 HTTP/1.0" 202 Accepted 2026-04-09 16:12:13,569 - lava_callback - INFO - Starting async job submit for node 69d7c4082f329ad1250155a7 2026-04-09 16:12:13,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:13,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c4082f329ad1250155a7 HTTP/1.1" 200 None 2026-04-09 16:12:13,617 - lava_callback - DEBUG - Processing node 69d7c4082f329ad1250155a7: baseline-nfs-arm64 2026-04-09 16:12:14,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:12:14,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:12:14,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c4082f329ad1250155a7/log.txt.gz 2026-04-09 16:12:14,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:12:14,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:12:14,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c4082f329ad1250155a7/lava-logs.yaml 2026-04-09 16:12:14,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:12:14,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:12:14,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d7c4082f329ad1250155a7/lava_callback.json.gz 2026-04-09 16:12:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:14,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c4082f329ad1250155a7 HTTP/1.1" 200 None 2026-04-09 16:12:14,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:14,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-09 16:12:14,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:14,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7c4082f329ad1250155a7 HTTP/1.1" 200 None 2026-04-09 16:12:14,846 - lava_callback - INFO - Completed processing callback for node 69d7c4082f329ad1250155a7 INFO: 172.21.0.1:41684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41690 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:12:20,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:20,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:12:33,584 - lava_callback - INFO - Received callback for node 69d52ce7932ecfe2320a5374 INFO: 172.21.0.1:55356 - "POST /node/69d52ce7932ecfe2320a5374 HTTP/1.0" 202 Accepted 2026-04-09 16:12:33,589 - lava_callback - INFO - Starting async job submit for node 69d52ce7932ecfe2320a5374 2026-04-09 16:12:33,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:33,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52ce7932ecfe2320a5374 HTTP/1.1" 200 None 2026-04-09 16:12:33,607 - lava_callback - DEBUG - Processing node 69d52ce7932ecfe2320a5374: baseline-arm-clabbe 2026-04-09 16:12:33,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52ce7932ecfe2320a5374 2026-04-09 16:12:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:33,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52ce7932ecfe2320a5374 HTTP/1.1" 200 None 2026-04-09 16:12:33,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:33,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-09 16:12:33,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:12:33,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52ce7932ecfe2320a5374 HTTP/1.1" 200 None 2026-04-09 16:12:33,666 - lava_callback - ERROR - Error processing callback for node 69d52ce7932ecfe2320a5374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:13:15,032 - lava_callback - INFO - Received callback for node 69d52d10932ecfe2320a538b INFO: 172.21.0.1:57498 - "POST /node/69d52d10932ecfe2320a538b HTTP/1.0" 202 Accepted 2026-04-09 16:13:15,038 - lava_callback - INFO - Starting async job submit for node 69d52d10932ecfe2320a538b 2026-04-09 16:13:15,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:15,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52d10932ecfe2320a538b HTTP/1.1" 200 None 2026-04-09 16:13:15,054 - lava_callback - DEBUG - Processing node 69d52d10932ecfe2320a538b: baseline-arm64-baylibre 2026-04-09 16:13:15,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d52d10932ecfe2320a538b 2026-04-09 16:13:15,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:15,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d52d10932ecfe2320a538b HTTP/1.1" 200 None 2026-04-09 16:13:15,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:15,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-09 16:13:15,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:15,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d52d10932ecfe2320a538b HTTP/1.1" 200 None 2026-04-09 16:13:15,105 - lava_callback - ERROR - Error processing callback for node 69d52d10932ecfe2320a538b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 116, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:13:55,493 - lava_callback - INFO - Received callback for node 69d7c44f2f329ad1250155d7 INFO: 172.21.0.1:59198 - "POST /node/69d7c44f2f329ad1250155d7 HTTP/1.0" 202 Accepted 2026-04-09 16:13:55,502 - lava_callback - INFO - Starting async job submit for node 69d7c44f2f329ad1250155d7 2026-04-09 16:13:55,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:55,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c44f2f329ad1250155d7 HTTP/1.1" 200 None 2026-04-09 16:13:55,565 - lava_callback - DEBUG - Processing node 69d7c44f2f329ad1250155d7: baseline-arm64 2026-04-09 16:13:56,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK 2026-04-09 16:13:56,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:13:56,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7c44f2f329ad1250155d7/log.txt.gz 2026-04-09 16:13:56,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:13:57,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:13:57,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7c44f2f329ad1250155d7/lava-logs.yaml 2026-04-09 16:13:57,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-09 16:13:57,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-09 16:13:57,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d7c44f2f329ad1250155d7/lava_callback.json.gz 2026-04-09 16:13:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d7c44f2f329ad1250155d7 HTTP/1.1" 200 None 2026-04-09 16:13:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:57,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-09 16:13:57,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-09 16:13:57,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d7c44f2f329ad1250155d7 HTTP/1.1" 200 None 2026-04-09 16:13:57,514 - lava_callback - INFO - Completed processing callback for node 69d7c44f2f329ad1250155d7 INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]